-- Logs begin at Sun 2022-10-02 00:10:50 UTC, end at Sun 2022-10-02 01:11:27 UTC. -- Oct 02 00:40:18.321495 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 02 00:40:18.329379 dv-cinder-master-3-smb devstack@keystone.service[81439]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 02 00:40:18.332173 dv-cinder-master-3-smb devstack@keystone.service[81439]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 2 00:40:18 2022] *** Oct 02 00:40:18.332313 dv-cinder-master-3-smb devstack@keystone.service[81439]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 02 00:40:18.332434 dv-cinder-master-3-smb devstack@keystone.service[81439]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 02 00:40:18.332540 dv-cinder-master-3-smb devstack@keystone.service[81439]: nodename: dv-cinder-master-3-smb Oct 02 00:40:18.332641 dv-cinder-master-3-smb devstack@keystone.service[81439]: machine: x86_64 Oct 02 00:40:18.332744 dv-cinder-master-3-smb devstack@keystone.service[81439]: clock source: unix Oct 02 00:40:18.332836 dv-cinder-master-3-smb devstack@keystone.service[81439]: pcre jit disabled Oct 02 00:40:18.332958 dv-cinder-master-3-smb devstack@keystone.service[81439]: detected number of CPU cores: 4 Oct 02 00:40:18.333072 dv-cinder-master-3-smb devstack@keystone.service[81439]: current working directory: / Oct 02 00:40:18.333172 dv-cinder-master-3-smb devstack@keystone.service[81439]: detected binary path: /usr/bin/uwsgi-core Oct 02 00:40:18.333271 dv-cinder-master-3-smb devstack@keystone.service[81439]: your processes number limit is 47680 Oct 02 00:40:18.333372 dv-cinder-master-3-smb devstack@keystone.service[81439]: your memory page size is 4096 bytes Oct 02 00:40:18.333472 dv-cinder-master-3-smb devstack@keystone.service[81439]: detected max file descriptor number: 2048 Oct 02 00:40:18.333581 dv-cinder-master-3-smb devstack@keystone.service[81439]: lock engine: pthread robust mutexes Oct 02 00:40:18.333845 dv-cinder-master-3-smb devstack@keystone.service[81439]: thunder lock: enabled Oct 02 00:40:18.334129 dv-cinder-master-3-smb devstack@keystone.service[81439]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 02 00:40:18.334335 dv-cinder-master-3-smb devstack@keystone.service[81439]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 02 00:40:18.373732 dv-cinder-master-3-smb devstack@keystone.service[81439]: Python main interpreter initialized at 0x559e799999c0 Oct 02 00:40:18.373732 dv-cinder-master-3-smb devstack@keystone.service[81439]: python threads support enabled Oct 02 00:40:18.373732 dv-cinder-master-3-smb devstack@keystone.service[81439]: your server socket listen backlog is limited to 100 connections Oct 02 00:40:18.373732 dv-cinder-master-3-smb devstack@keystone.service[81439]: your mercy for graceful operations on workers is 90 seconds Oct 02 00:40:18.374134 dv-cinder-master-3-smb devstack@keystone.service[81439]: mapped 403077 bytes (393 KB) for 2 cores Oct 02 00:40:18.374216 dv-cinder-master-3-smb devstack@keystone.service[81439]: *** Operational MODE: preforking *** Oct 02 00:40:18.374440 dv-cinder-master-3-smb devstack@keystone.service[81439]: *** uWSGI is running in multiple interpreter mode *** Oct 02 00:40:18.374440 dv-cinder-master-3-smb devstack@keystone.service[81439]: spawned uWSGI master process (pid: 81439) Oct 02 00:40:18.374654 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 02 00:40:18.376974 dv-cinder-master-3-smb devstack@keystone.service[81439]: spawned uWSGI worker 1 (pid: 81450, cores: 1) Oct 02 00:40:18.376974 dv-cinder-master-3-smb devstack@keystone.service[81439]: spawned uWSGI worker 2 (pid: 81451, cores: 1) Oct 02 00:40:18.376974 dv-cinder-master-3-smb devstack@keystone.service[81439]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 02 00:40:22.712882 dv-cinder-master-3-smb devstack@keystone.service[81450]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:40:22.712882 dv-cinder-master-3-smb devstack@keystone.service[81450]: from cryptography.utils import int_from_bytes Oct 02 00:40:22.713862 dv-cinder-master-3-smb devstack@keystone.service[81450]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:40:22.713862 dv-cinder-master-3-smb devstack@keystone.service[81450]: from cryptography.utils import int_from_bytes Oct 02 00:40:22.718997 dv-cinder-master-3-smb devstack@keystone.service[81451]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:40:22.718997 dv-cinder-master-3-smb devstack@keystone.service[81451]: from cryptography.utils import int_from_bytes Oct 02 00:40:22.719694 dv-cinder-master-3-smb devstack@keystone.service[81451]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:40:22.719694 dv-cinder-master-3-smb devstack@keystone.service[81451]: from cryptography.utils import int_from_bytes Oct 02 00:40:22.764244 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 02 00:40:22.764455 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 02 00:40:22.764612 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] command line args: [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 02 00:40:22.764878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 02 00:40:22.765082 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ================================================================================ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 02 00:40:22.765336 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] admin_token = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.765577 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] config_dir = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.765762 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.766020 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] config_source = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.766160 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] debug = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.766357 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.767734 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.767734 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.767734 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.767734 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.767734 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.767734 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_config_append = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.768057 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.768057 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_dir = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.768289 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_file = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.768463 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.768621 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 02 00:40:22.768704 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.768821 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 02 00:40:22.768968 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.769060 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] command line args: [] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 02 00:40:22.769210 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.769311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 02 00:40:22.769396 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.769496 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ================================================================================ {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 02 00:40:22.769580 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.769758 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] admin_token = **** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.769841 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.770010 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] config_dir = [] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.770095 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.770217 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.770332 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.770444 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] config_source = [] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.770564 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.770689 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] debug = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.770809 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.770923 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.771051 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.771163 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.771286 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.771397 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.771509 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.771621 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.771734 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.771854 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.771854 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] list_limit = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.772086 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] log_config_append = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.772199 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.772319 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.772441 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] publish_errors = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.772562 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] log_dir = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.772684 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.772799 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] log_file = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.772918 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.773059 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.773172 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.773299 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.773414 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.773526 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.773647 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.773771 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.773895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] standard_threads = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.774009 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.774129 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.774249 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.774365 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.774483 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.774606 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.774719 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.774838 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_journal = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.774838 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_json = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.775048 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.775166 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_stderr = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.775290 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.775414 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_syslog = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.775528 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.775657 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.775778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.775899 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.776019 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.776138 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.776258 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.776372 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.776496 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.776612 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.776612 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.776828 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.776972 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.777163 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] publish_errors = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.777281 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.777394 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.777508 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.777627 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.777753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.777868 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.777981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.778099 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.778213 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.778325 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.778445 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.778567 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] standard_threads = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.778680 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.778793 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.778905 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.779023 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.779145 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.779260 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.779260 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] use_journal = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.779477 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.779592 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] use_json = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.779704 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.779828 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] use_stderr = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.779949 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.780068 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] use_syslog = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.780187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.780307 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:40:22.780420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.780543 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.780658 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.780770 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.780882 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.781034 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.781161 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.781294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.781413 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.781526 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.781638 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.781759 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.781923 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.782118 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.782312 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.782486 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.782613 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.782730 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.782842 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.783037 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.783160 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.783274 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.783386 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.783505 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.783619 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.783740 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.783855 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.783968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.784080 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.784192 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.784319 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.784434 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.784547 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.784660 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.784772 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.784892 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.785070 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.785187 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.785306 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.785424 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.785536 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.785649 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.785770 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.785886 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.786006 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.786119 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.786238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.786238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.786458 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.786572 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.786691 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.786805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.786926 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.787046 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.787169 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.787289 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.787403 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.787516 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.787629 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.787741 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.787865 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.787986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.788100 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.788212 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.788331 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.788445 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.788637 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.788754 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.788874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.789011 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.789127 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.789240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.789366 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.789481 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.789594 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.789712 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.789826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.789937 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.790062 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.790177 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.790290 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.790407 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.790522 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.790640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.790763 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.790883 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.791004 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.791128 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.791243 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.791355 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.791479 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.791600 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.791714 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.791841 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.791947 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.792058 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.792175 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.792282 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.792378 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.792473 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.792568 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.792669 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.792773 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.792870 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.792994 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.793104 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.793215 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.793321 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.793419 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.793534 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.793631 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.793727 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.793822 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.793924 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.794019 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.794122 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.794219 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.794322 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.794417 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.794512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.794612 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.794727 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.794825 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.794927 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.795023 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.795119 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.795220 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.795333 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.795451 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.795550 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.795658 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.795757 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.795852 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.795956 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.796060 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.796156 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.796251 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.796348 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.796449 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.796555 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.796652 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.796746 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.796842 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.797013 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.797126 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.797812 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.797950 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.798136 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.798306 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.798494 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.798494 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.798906 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.799021 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.799125 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.799238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.799352 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.799466 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.799466 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.799691 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.799796 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.799908 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.800006 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.800103 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.800296 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.800415 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.800523 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.800622 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.800725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.800832 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.800968 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.801089 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.801189 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.801286 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.801382 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.external = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.801477 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.801573 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.801678 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.801776 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.801873 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.801969 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.802064 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.802188 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.password = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.802312 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.802418 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.token = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.802530 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.802645 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.802759 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.802873 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.802999 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.803121 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.803226 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.803338 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.803443 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.803555 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.803700 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.803825 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.803951 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.804067 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.804182 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.804304 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.804420 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.804535 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.804662 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.804780 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.804904 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.805104 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.805223 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.805342 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.805470 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.805593 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.805716 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.805834 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.805949 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.806063 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.806187 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.806309 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.806425 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.806540 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.806655 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] auth.external = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.806769 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.806898 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.807015 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.807137 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.807256 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.807371 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.807486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.807614 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] auth.password = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.807732 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.807847 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] auth.token = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.807963 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.808078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.808192 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.808320 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.808444 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.808561 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.808676 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.808792 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.808907 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.809060 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.809179 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.809294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.809409 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.809524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.809638 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.809762 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] credential.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.809879 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.809995 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.810110 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.810225 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.810340 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.810340 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.810567 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.810682 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.810797 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.810911 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.811026 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.811149 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.811266 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.811382 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.811497 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.811612 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.811727 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.811853 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.811970 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.812086 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.812201 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.812316 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.812439 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.812555 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.812671 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.812826 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.813536 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.813704 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.813931 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.814125 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.814125 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.814423 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.814541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.814656 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] federation.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.814854 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.814974 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.815090 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.815239 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.815362 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.815478 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.815478 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.815712 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.815838 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.815956 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.816072 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.816186 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.816311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.816429 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.816544 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.816658 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.816773 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.816895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.816895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.817184 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.817300 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.817416 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.817532 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.817647 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.817771 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.817889 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.818004 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.818119 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.818234 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.818350 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.818475 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.818599 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.818718 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.818834 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.818949 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.819063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.819187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.819311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.819428 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.819543 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.819657 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.819772 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.819895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.820011 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.820126 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.820240 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.820355 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.820471 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.820594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.820711 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.820826 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.820955 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.821073 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.821188 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.821315 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.821433 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.821550 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.821664 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.821780 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.821895 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.822017 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.822124 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.822238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.822353 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.822474 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.822591 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.822714 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.822831 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.822953 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.823070 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.823185 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.823299 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.823423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.823539 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.823655 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.823769 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.823883 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.824006 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.824128 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.824244 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.824359 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.824474 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.824588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.824713 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.824829 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.825014 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.825134 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.825249 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.825367 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.825495 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.825613 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.825730 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.825845 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.825961 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.826076 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.826200 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.826316 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.826431 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.826546 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.826661 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.826777 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.826900 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.827016 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.827132 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.827246 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.827361 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.827476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.827600 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.827716 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.827832 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.827947 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.828062 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.828177 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.828301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.828481 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.828654 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.828835 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.829060 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.829242 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.829380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.829499 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.829615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.829731 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.829731 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.829949 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.830079 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.830197 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.830312 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.830427 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.830542 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.830658 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.830782 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.830899 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.831015 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.831131 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.831247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.831362 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.831486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.831604 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.831719 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.831835 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.831950 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.832067 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.832191 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.832309 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.832425 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.832540 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.832655 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.832770 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.832894 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.833077 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.833195 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.833311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.833427 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.833543 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.833671 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.833796 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.833913 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.834029 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.834146 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.834261 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.834386 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.834503 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.834619 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.834734 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.834850 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.834965 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.835095 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.835213 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.835333 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] role.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.835450 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.835565 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] role.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.835680 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.835804 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.835921 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.836037 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.836152 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.836268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.836384 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.836512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.836629 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.836744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.836860 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.836993 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.837125 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.837244 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.837360 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.837476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.837592 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.837707 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.837900 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.838026 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.838143 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.838265 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.838383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.838498 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.838622 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.838739 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.838855 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.838970 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.839085 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] resource.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.839085 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.839309 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.839428 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.839543 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.839658 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.839774 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.839889 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.840012 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.840129 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.840244 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.840359 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.840475 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.840591 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.840715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.840833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.841013 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.841133 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.841248 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.841363 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] role.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.841491 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.841610 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] role.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.841726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.841842 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.841956 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.841956 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.842181 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.842288 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.842402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.842519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.842635 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.842750 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.842874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.842990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.843105 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.843220 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.843335 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.843450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.843575 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.843692 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.843807 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.843922 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.844557 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.844666 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.844817 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.845102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.845296 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.845458 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.845578 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.845710 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.845829 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.845945 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.845945 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.846162 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.846277 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.846402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.846519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.846634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.846752 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.846868 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.846983 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.847107 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.847225 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.847341 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.847456 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.847572 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.847688 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.847813 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.847930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.848055 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.848181 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.848297 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.848412 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.848527 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.848643 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.848766 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.848883 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.849024 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.849141 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.849257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.849372 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.849500 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.849618 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.849733 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.849849 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.849965 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.850089 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.850206 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.850322 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.850438 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.850553 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.850667 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] token.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.850791 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.850909 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.851025 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.851140 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.851256 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.851372 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.851496 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.851614 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.851729 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.851845 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.851961 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.852077 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.852201 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.852318 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.852442 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.852559 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.852674 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.852790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.852914 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.853068 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.853184 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 02 00:40:22.853300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.853300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.853300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.853300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.853300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.853300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.853300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.853300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.connection = **** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.853300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.854254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.854254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.854254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.854254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.854254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.854254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.854254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.854254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.854254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.855194 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.855194 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.855194 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.855194 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.855615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.855615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.855840 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.855955 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:40:22.856069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 02 00:40:22.880012 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:22.880224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:22.880442 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:22.882560 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:22.882800 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:22.883031 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:22.889187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:22.892534 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:22.918566 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:22.918780 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:22.919511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:22.919723 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:22.973774 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:22.974154 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.024224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.024534 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.026940 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.027179 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.183341 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.183554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.183722 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.183809 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.183917 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.183996 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.184070 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.184173 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.184257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.184385 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.184478 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.184632 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.211362 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.211603 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.211794 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.212010 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.212183 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.212358 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.212534 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.212703 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.212836 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.212999 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.213134 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.213257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.213429 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.213572 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.225435 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.225647 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.239371 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.239591 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.239812 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.240041 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.240264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.240485 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.240703 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.242569 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.242805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.243033 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.243254 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.243465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.243695 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.243907 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:40:23.258462 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.258680 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 02 00:40:23.259030 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.259234 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 02 00:40:23.259316 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.259514 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.259599 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 02 00:40:23.259784 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.259887 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.260044 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 02 00:40:23.260138 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.260306 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.260385 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.260567 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.260830 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.261111 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.270405 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.270690 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.270964 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.271236 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.271321 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.271516 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.271786 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.272069 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.278329 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.279074 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.281296 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.281633 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.281926 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.282036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.282222 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.282336 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.282512 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.282622 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.282779 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.282863 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.283056 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.283151 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.283340 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.283420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.283618 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.283703 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.283888 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.283968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.284157 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.284237 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.284428 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.284693 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.307825 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.308060 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.309359 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.309579 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.309662 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.309865 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.315363 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.315494 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.315648 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.315733 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.315918 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.316005 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.322281 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.322382 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.322569 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.322652 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.328682 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.328857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.329068 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.329215 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.329364 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.329551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.329664 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.329846 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.329954 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.330122 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.330233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.330396 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.330507 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.330666 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.330779 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.330934 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.346579 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.346790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.346877 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.347077 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.350684 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.350961 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.353901 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.354201 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.354283 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.354520 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.358373 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.358761 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.362097 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.362444 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.365298 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.365597 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.365682 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.365882 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.365965 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.366167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.366259 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.366447 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.366530 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.366727 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.366809 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.367041 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.383179 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.383470 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.383555 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.383737 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.383820 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.383997 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.384080 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.384291 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.391283 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.392037 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.392924 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.393632 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.394548 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.394820 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.395319 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.395615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.397679 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.397941 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.398259 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.398502 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.398660 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.398889 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.399075 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.399264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.399442 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.399866 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.415271 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.415271 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.415271 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.415271 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.415271 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.415271 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.416338 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.416694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.416694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.416694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.416694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.416694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.416694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.417653 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.429635 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.432599 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.434348 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.435534 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.437050 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.437291 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.439097 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.439375 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.439790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.440871 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.442406 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.443868 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.444151 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.444558 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.446285 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.447781 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.450740 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.450955 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.451139 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.451430 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.451711 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.452458 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.455554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.455964 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.456248 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.456525 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.459751 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.460045 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.460330 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.464389 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.464677 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.464974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.467288 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.467590 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.467860 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.468139 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.468414 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.468698 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.469015 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.469310 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.469586 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.469858 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.470150 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.470419 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.470684 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.470946 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.472115 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:40:23.472401 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.472683 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.472979 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.473255 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.473526 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.473800 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.474077 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.474346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.474622 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.474900 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.475181 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.475489 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.475710 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:40:23.506944 dv-cinder-master-3-smb devstack@keystone.service[81451]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559e799999c0 pid: 81451 (default app) Oct 02 00:40:23.510453 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6bff6-0e81-43dd-8af4-3699161280f5 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:23.510744 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6bff6-0e81-43dd-8af4-3699161280f5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:23.511018 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6bff6-0e81-43dd-8af4-3699161280f5 None None] PATH_INFO: `/v3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:23.511102 dv-cinder-master-3-smb devstack@keystone.service[81450]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559e799999c0 pid: 81450 (default app) Oct 02 00:40:23.515492 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Sun Oct 2 00:40:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:30.537614 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846bb7ca-ab37-45e5-9a30-9fc1a32358a1 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:30.538149 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846bb7ca-ab37-45e5-9a30-9fc1a32358a1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:30.538149 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846bb7ca-ab37-45e5-9a30-9fc1a32358a1 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:30.542414 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:40:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:40:30.547777 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfd008-a243-42f2-939f-045d16ddb5d7 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:30.548215 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfd008-a243-42f2-939f-045d16ddb5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:30.548353 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfd008-a243-42f2-939f-045d16ddb5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:30.619476 dv-cinder-master-3-smb devstack@keystone.service[81451]: INFO dbcounter [None req-97bfd008-a243-42f2-939f-045d16ddb5d7 None None] Registered counter for database keystone Oct 02 00:40:30.638926 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG oslo_db.sqlalchemy.engines [None req-97bfd008-a243-42f2-939f-045d16ddb5d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:40:30.646027 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writer thread running {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:40:30.826462 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG passlib.handlers.bcrypt [None req-97bfd008-a243-42f2-939f-045d16ddb5d7 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81451) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 02 00:40:30.826769 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG passlib.handlers.bcrypt [None req-97bfd008-a243-42f2-939f-045d16ddb5d7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81451) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 02 00:40:30.886479 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-97bfd008-a243-42f2-939f-045d16ddb5d7 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:40:30.888123 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-97bfd008-a243-42f2-939f-045d16ddb5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:40:31.019599 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:40:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 02 00:40:31.318033 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846bb7ca-ab37-45e5-9a30-9fc1a32358a1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:31.387772 dv-cinder-master-3-smb devstack@keystone.service[81450]: INFO dbcounter [None req-846bb7ca-ab37-45e5-9a30-9fc1a32358a1 None None] Registered counter for database keystone Oct 02 00:40:31.410892 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG oslo_db.sqlalchemy.engines [None req-846bb7ca-ab37-45e5-9a30-9fc1a32358a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:40:31.417401 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writer thread running {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:40:31.543168 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846bb7ca-ab37-45e5-9a30-9fc1a32358a1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:31.547994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf7879-4605-4b9b-b5a2-ff021b16091b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:31.548647 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7879-4605-4b9b-b5a2-ff021b16091b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:31.548933 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7879-4605-4b9b-b5a2-ff021b16091b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:31.549240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7879-4605-4b9b-b5a2-ff021b16091b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:31.558277 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf7879-4605-4b9b-b5a2-ff021b16091b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:31.614314 dv-cinder-master-3-smb devstack@keystone.service[81450]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7abf7879-4605-4b9b-b5a2-ff021b16091b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 02 00:40:31.614581 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf7879-4605-4b9b-b5a2-ff021b16091b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:31.624909 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Sun Oct 2 00:40:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 00:40:31.631125 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfd008-a243-42f2-939f-045d16ddb5d7 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:31.648586 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfd008-a243-42f2-939f-045d16ddb5d7 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:31.652998 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f961b-6c51-406e-a019-322aacbf8fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:31.654112 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f961b-6c51-406e-a019-322aacbf8fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:31.654391 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f961b-6c51-406e-a019-322aacbf8fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:31.654662 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f961b-6c51-406e-a019-322aacbf8fb3 admin admin] PATH_INFO: `/v3/projects/6575bddc339f4fb18300234b880a2b64` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:31.656243 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f961b-6c51-406e-a019-322aacbf8fb3 admin admin] RBAC: Authorizing `identity:get_project(project_id=6575bddc339f4fb18300234b880a2b64)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:31.709017 dv-cinder-master-3-smb devstack@keystone.service[81451]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8c7f961b-6c51-406e-a019-322aacbf8fb3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 02 00:40:31.709363 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f961b-6c51-406e-a019-322aacbf8fb3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:31.714118 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Sun Oct 2 00:40:31 2022] GET /identity/v3/projects/6575bddc339f4fb18300234b880a2b64 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:33.907352 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b2a17-aa7b-4b77-8fb8-27ef6e3c0ca0 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:33.907947 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b2a17-aa7b-4b77-8fb8-27ef6e3c0ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:33.907947 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b2a17-aa7b-4b77-8fb8-27ef6e3c0ca0 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:33.912050 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:40:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:40:33.917836 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cb3f8-f1ea-42a6-9542-5ee3a0802b46 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:33.918247 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cb3f8-f1ea-42a6-9542-5ee3a0802b46 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:33.918385 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cb3f8-f1ea-42a6-9542-5ee3a0802b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:33.938513 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-423cb3f8-f1ea-42a6-9542-5ee3a0802b46 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:40:33.940043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-423cb3f8-f1ea-42a6-9542-5ee3a0802b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:40:33.948377 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:40:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 02 00:40:34.219377 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b2a17-aa7b-4b77-8fb8-27ef6e3c0ca0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:34.231839 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b2a17-aa7b-4b77-8fb8-27ef6e3c0ca0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:34.237080 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d8419-afea-411a-bd11-511851c36c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:34.237677 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d8419-afea-411a-bd11-511851c36c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:34.237956 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d8419-afea-411a-bd11-511851c36c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:34.238230 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d8419-afea-411a-bd11-511851c36c44 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:34.245990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d8419-afea-411a-bd11-511851c36c44 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:34.247789 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d8419-afea-411a-bd11-511851c36c44 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:34.256902 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Sun Oct 2 00:40:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 00:40:34.262599 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cb3f8-f1ea-42a6-9542-5ee3a0802b46 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:34.272331 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cb3f8-f1ea-42a6-9542-5ee3a0802b46 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:34.276650 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbba765-78d7-4bb4-a2fc-d382572f0782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:34.277336 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbba765-78d7-4bb4-a2fc-d382572f0782 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:34.277621 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbba765-78d7-4bb4-a2fc-d382572f0782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:34.277897 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbba765-78d7-4bb4-a2fc-d382572f0782 admin admin] PATH_INFO: `/v3/users/1ae9e9d2d4e74a049733205286b14514` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:34.279207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbba765-78d7-4bb4-a2fc-d382572f0782 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ae9e9d2d4e74a049733205286b14514)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:34.281087 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbba765-78d7-4bb4-a2fc-d382572f0782 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:34.283143 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Sun Oct 2 00:40:34 2022] GET /identity/v3/users/1ae9e9d2d4e74a049733205286b14514 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:40:36.563699 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403ebd9-73e6-49e5-9427-4424eda5bb60 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:36.564232 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403ebd9-73e6-49e5-9427-4424eda5bb60 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:36.564232 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403ebd9-73e6-49e5-9427-4424eda5bb60 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:36.565599 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:40:36.571148 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eab637-6721-4b19-aac6-14d2ce16749f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:36.571557 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eab637-6721-4b19-aac6-14d2ce16749f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:36.571736 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eab637-6721-4b19-aac6-14d2ce16749f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:36.581595 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e468ccf-8c13-40c3-b68f-482d2fe6c114 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:36.581876 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e468ccf-8c13-40c3-b68f-482d2fe6c114 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:36.582147 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e468ccf-8c13-40c3-b68f-482d2fe6c114 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:36.583491 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:40:36.588596 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac90d3-0a0d-4bf9-bcf9-b0abd8de7c41 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:36.588872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac90d3-0a0d-4bf9-bcf9-b0abd8de7c41 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:36.589183 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac90d3-0a0d-4bf9-bcf9-b0abd8de7c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:36.590649 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-62eab637-6721-4b19-aac6-14d2ce16749f None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:40:36.591824 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-62eab637-6721-4b19-aac6-14d2ce16749f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:40:36.631638 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG passlib.handlers.bcrypt [None req-29ac90d3-0a0d-4bf9-bcf9-b0abd8de7c41 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81450) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 02 00:40:36.632020 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG passlib.handlers.bcrypt [None req-29ac90d3-0a0d-4bf9-bcf9-b0abd8de7c41 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81450) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 02 00:40:36.675342 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:40:36.681708 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-29ac90d3-0a0d-4bf9-bcf9-b0abd8de7c41 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:40:36.683318 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-29ac90d3-0a0d-4bf9-bcf9-b0abd8de7c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:40:36.784164 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:40:36.946987 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eab637-6721-4b19-aac6-14d2ce16749f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:36.973606 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:37.052016 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac90d3-0a0d-4bf9-bcf9-b0abd8de7c41 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:37.057481 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eab637-6721-4b19-aac6-14d2ce16749f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:37.092522 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e03057-a635-405a-aa2c-66321b88d897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:37.093192 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e03057-a635-405a-aa2c-66321b88d897 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:37.093472 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e03057-a635-405a-aa2c-66321b88d897 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:37.094260 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e03057-a635-405a-aa2c-66321b88d897 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:37.105298 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e03057-a635-405a-aa2c-66321b88d897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:40:37.114740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-94e03057-a635-405a-aa2c-66321b88d897 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:40:37.114740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:40:37.114740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:40:37.114740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:40:37.114740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:40:37.114740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:40:37.114740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:40:37.114740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:40:37.114740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:40:37.114740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:40:37.114740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:40:37.114740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:40:37.114740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:40:37.114740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:40:37.114740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:40:37.114740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:40:37.115873 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:40:37.115873 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:40:37.115873 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:40:37.115873 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:40:37.115873 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:40:37.115873 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:40:37.115873 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:40:37.115873 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:40:37.115873 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:40:37.115873 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:40:37.115873 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:40:37.115873 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:40:37.115873 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:40:37.115873 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:40:37.115873 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:40:37.115873 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:40:37.117884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:40:37.117884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:40:37.117884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:40:37.117884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:40:37.117884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:40:37.117884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:40:37.117884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:40:37.117884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:40:37.117884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:40:37.117884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:40:37.117884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:40:37.117884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:40:37.117884 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:40:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:40:37.121784 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e03057-a635-405a-aa2c-66321b88d897 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:37.158632 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac90d3-0a0d-4bf9-bcf9-b0abd8de7c41 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:37.160993 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:37.200605 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b45c5-b3d4-41c6-a6bc-49daab0c4b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:37.201424 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b45c5-b3d4-41c6-a6bc-49daab0c4b31 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:37.201711 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b45c5-b3d4-41c6-a6bc-49daab0c4b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:37.201987 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b45c5-b3d4-41c6-a6bc-49daab0c4b31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:37.208036 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:37.227485 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e03057-a635-405a-aa2c-66321b88d897 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:37.260851 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91c1e2-2a55-4680-b456-719a48ecdf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:37.261474 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91c1e2-2a55-4680-b456-719a48ecdf82 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:37.261751 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91c1e2-2a55-4680-b456-719a48ecdf82 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:37.262016 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91c1e2-2a55-4680-b456-719a48ecdf82 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:37.262672 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91c1e2-2a55-4680-b456-719a48ecdf82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:40:37.262968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91c1e2-2a55-4680-b456-719a48ecdf82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:37.264615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91c1e2-2a55-4680-b456-719a48ecdf82 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:37.270551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b45c5-b3d4-41c6-a6bc-49daab0c4b31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:37.272085 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b45c5-b3d4-41c6-a6bc-49daab0c4b31 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:37.276829 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:40:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:40:37.282561 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91c1e2-2a55-4680-b456-719a48ecdf82 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:37.375685 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:40:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 02 00:40:37.381447 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b45c5-b3d4-41c6-a6bc-49daab0c4b31 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:37.384239 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:37.390947 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91c1e2-2a55-4680-b456-719a48ecdf82 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:37.430196 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9f81e-395b-44a0-8ce7-5ea8cfe58197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:37.430827 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9f81e-395b-44a0-8ce7-5ea8cfe58197 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:37.431107 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9f81e-395b-44a0-8ce7-5ea8cfe58197 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:37.431373 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9f81e-395b-44a0-8ce7-5ea8cfe58197 None admin] PATH_INFO: `/v3/users/1ae9e9d2d4e74a049733205286b14514` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:37.432534 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9f81e-395b-44a0-8ce7-5ea8cfe58197 None admin] RBAC: Authorizing `identity:get_user(user_id=1ae9e9d2d4e74a049733205286b14514)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:37.434030 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9f81e-395b-44a0-8ce7-5ea8cfe58197 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:37.435581 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:40:37 2022] GET /identity/v3/users/1ae9e9d2d4e74a049733205286b14514 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:40:37.441605 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9f81e-395b-44a0-8ce7-5ea8cfe58197 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:37.457885 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:37.483993 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b45c5-b3d4-41c6-a6bc-49daab0c4b31 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:37.517913 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68216c62-df88-4f50-bec8-05815d278a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:37.518771 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68216c62-df88-4f50-bec8-05815d278a94 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:37.519050 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68216c62-df88-4f50-bec8-05815d278a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:37.519319 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68216c62-df88-4f50-bec8-05815d278a94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:37.539400 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68216c62-df88-4f50-bec8-05815d278a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:37.540889 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68216c62-df88-4f50-bec8-05815d278a94 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:37.545603 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9f81e-395b-44a0-8ce7-5ea8cfe58197 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:37.559022 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-68216c62-df88-4f50-bec8-05815d278a94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:40:37.559022 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:40:37.559022 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:40:37.559022 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:40:37.559022 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:40:37.559022 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:40:37.559022 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:40:37.559022 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:40:37.559022 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:40:37.559022 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:40:37.559022 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:40:37.559022 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:40:37.559022 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:40:37.559022 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:40:37.559022 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:40:37.559022 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:40:37.559965 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:40:37.559965 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:40:37.559965 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:40:37.559965 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:40:37.559965 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:40:37.559965 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:40:37.559965 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:40:37.559965 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:40:37.559965 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:40:37.559965 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:40:37.559965 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:40:37.559965 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:40:37.559965 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:40:37.559965 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:40:37.559965 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:40:37.559965 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:40:37.559965 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:40:37.560795 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:40:37.560795 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:40:37.560795 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:40:37.560795 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 9/18] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:40:37.566361 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68216c62-df88-4f50-bec8-05815d278a94 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:37.582816 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47ee88-ad40-4d96-8ba5-1ee37be82d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:37.583457 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47ee88-ad40-4d96-8ba5-1ee37be82d08 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:37.583739 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47ee88-ad40-4d96-8ba5-1ee37be82d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:37.584019 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47ee88-ad40-4d96-8ba5-1ee37be82d08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:37.585253 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47ee88-ad40-4d96-8ba5-1ee37be82d08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:37.586735 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47ee88-ad40-4d96-8ba5-1ee37be82d08 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:37.588312 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 10/19] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:40:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:40:37.594868 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47ee88-ad40-4d96-8ba5-1ee37be82d08 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:37.631671 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:37.682640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68216c62-df88-4f50-bec8-05815d278a94 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:37.684006 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:37.704317 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47ee88-ad40-4d96-8ba5-1ee37be82d08 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:37.717199 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ffd6b-1109-4fbe-bd6e-a52439f4c401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:37.717736 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ffd6b-1109-4fbe-bd6e-a52439f4c401 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:37.718016 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ffd6b-1109-4fbe-bd6e-a52439f4c401 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:37.718288 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ffd6b-1109-4fbe-bd6e-a52439f4c401 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:37.719505 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ffd6b-1109-4fbe-bd6e-a52439f4c401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:40:37.720024 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ffd6b-1109-4fbe-bd6e-a52439f4c401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:37.721548 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ffd6b-1109-4fbe-bd6e-a52439f4c401 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:37.738849 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5ce29-3c36-43c8-b892-8c26a9f0f647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:37.739046 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 10/20] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:40:37.739466 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5ce29-3c36-43c8-b892-8c26a9f0f647 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:37.739748 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5ce29-3c36-43c8-b892-8c26a9f0f647 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:37.740021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5ce29-3c36-43c8-b892-8c26a9f0f647 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:37.740750 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5ce29-3c36-43c8-b892-8c26a9f0f647 None admin] RBAC: Adding query filter params (role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.domain.id=default, user.id=1ae9e9d2d4e74a049733205286b14514) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:40:37.741089 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5ce29-3c36-43c8-b892-8c26a9f0f647 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:37.742573 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5ce29-3c36-43c8-b892-8c26a9f0f647 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:37.751389 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 11/21] 10.222.0.26 () {56 vars in 1322 bytes} [Sun Oct 2 00:40:37 2022] GET /identity/v3/role_assignments?user.id=1ae9e9d2d4e74a049733205286b14514&scope.domain.id=default&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:40:40.261369 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee21dc-8f5d-4e43-9495-30c5c9990221 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:40.261880 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee21dc-8f5d-4e43-9495-30c5c9990221 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:40.261953 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee21dc-8f5d-4e43-9495-30c5c9990221 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:40.263420 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 11/22] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:40:40.278742 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c0aee-904c-4d4f-bf01-807e2078d0df None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:40.279265 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c0aee-904c-4d4f-bf01-807e2078d0df None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:40.279265 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c0aee-904c-4d4f-bf01-807e2078d0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:40.309570 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-840c0aee-904c-4d4f-bf01-807e2078d0df None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:40:40.310770 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-840c0aee-904c-4d4f-bf01-807e2078d0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:40:40.400077 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 12/23] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:40:40.789899 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ba89f-83a5-4be2-90ee-1a29720ad68b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:40.790317 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ba89f-83a5-4be2-90ee-1a29720ad68b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:40.790464 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ba89f-83a5-4be2-90ee-1a29720ad68b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:40.792002 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 12/24] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:40:40.805803 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f898b-f29e-44d7-9682-e06f3e008b33 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:40.806699 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f898b-f29e-44d7-9682-e06f3e008b33 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:40.807453 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f898b-f29e-44d7-9682-e06f3e008b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:40.816528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebed17-0b33-43e0-b732-a1ad377524b8 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:40.817198 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebed17-0b33-43e0-b732-a1ad377524b8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:40.817700 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebed17-0b33-43e0-b732-a1ad377524b8 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:40.819238 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 13/25] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:40:40.824592 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccccf2-547b-4aa7-9416-651be6e7cfc1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:40.825177 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccccf2-547b-4aa7-9416-651be6e7cfc1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:40.825716 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccccf2-547b-4aa7-9416-651be6e7cfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:40.850694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b28f898b-f29e-44d7-9682-e06f3e008b33 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:40:40.852683 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b28f898b-f29e-44d7-9682-e06f3e008b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:40:40.862201 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ddccccf2-547b-4aa7-9416-651be6e7cfc1 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:40:40.863858 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ddccccf2-547b-4aa7-9416-651be6e7cfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:40:41.019098 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 14/26] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:40:41.020368 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccccf2-547b-4aa7-9416-651be6e7cfc1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:41.052622 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 13/27] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:40:41.055063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1bf94-695a-47c7-baa7-4c12067e8e2d None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:41.055380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1bf94-695a-47c7-baa7-4c12067e8e2d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:41.055657 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1bf94-695a-47c7-baa7-4c12067e8e2d None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:41.056922 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 14/28] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:40:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:40:41.066542 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5e69c-135d-44aa-b5ae-dbc08be6db67 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:41.066813 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5e69c-135d-44aa-b5ae-dbc08be6db67 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:41.067100 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5e69c-135d-44aa-b5ae-dbc08be6db67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:41.091177 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:41.116427 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-55f5e69c-135d-44aa-b5ae-dbc08be6db67 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:40:41.117685 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-55f5e69c-135d-44aa-b5ae-dbc08be6db67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:40:41.150103 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:41.258265 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccccf2-547b-4aa7-9416-651be6e7cfc1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:41.306008 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 15/29] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:40:41.310297 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5e69c-135d-44aa-b5ae-dbc08be6db67 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:41.371673 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365544f-bca4-4c1d-bfd1-23b78d519d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:41.372689 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365544f-bca4-4c1d-bfd1-23b78d519d63 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:41.373211 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365544f-bca4-4c1d-bfd1-23b78d519d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:41.373728 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365544f-bca4-4c1d-bfd1-23b78d519d63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:41.446433 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365544f-bca4-4c1d-bfd1-23b78d519d63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:40:41.474905 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0365544f-bca4-4c1d-bfd1-23b78d519d63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:40:41.474905 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:40:41.474905 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:40:41.474905 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:40:41.474905 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:40:41.474905 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:40:41.474905 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:40:41.474905 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:40:41.474905 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:40:41.474905 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:40:41.474905 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:40:41.474905 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:40:41.474905 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:40:41.474905 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:40:41.474905 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:40:41.474905 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:40:41.475846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:40:41.475846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:40:41.475846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:40:41.475846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:40:41.475846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:40:41.475846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:40:41.475846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:40:41.475846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:40:41.475846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:40:41.475846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:40:41.475846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:40:41.475846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:40:41.475846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:40:41.475846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:40:41.475846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:40:41.475846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:40:41.476709 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:40:41.476709 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:40:41.476709 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:40:41.476709 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:40:41.476709 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:40:41.476709 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:40:41.476709 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:40:41.476709 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:40:41.476709 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:40:41.476709 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:40:41.476709 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:40:41.476709 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:40:41.476709 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 15/30] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:40:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 456 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:40:41.487688 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365544f-bca4-4c1d-bfd1-23b78d519d63 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:41.623548 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5e69c-135d-44aa-b5ae-dbc08be6db67 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:41.706502 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365544f-bca4-4c1d-bfd1-23b78d519d63 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:41.710629 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb44190-931c-4db9-ae86-f735cd4a0000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:41.711296 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb44190-931c-4db9-ae86-f735cd4a0000 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:41.711579 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb44190-931c-4db9-ae86-f735cd4a0000 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:41.711856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb44190-931c-4db9-ae86-f735cd4a0000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:41.715065 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:41.721986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:41.727737 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb44190-931c-4db9-ae86-f735cd4a0000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:41.729284 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb44190-931c-4db9-ae86-f735cd4a0000 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:41.746377 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-8eb44190-931c-4db9-ae86-f735cd4a0000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:40:41.746377 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:40:41.746377 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:40:41.746377 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:40:41.746377 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:40:41.746377 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:40:41.746377 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:40:41.746377 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:40:41.746377 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:40:41.746377 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:40:41.746377 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:40:41.746377 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:40:41.746377 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:40:41.746377 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:40:41.746377 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:40:41.746377 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:40:41.747492 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:40:41.747492 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:40:41.747492 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:40:41.747492 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:40:41.747492 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:40:41.747492 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:40:41.747492 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:40:41.747492 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:40:41.747492 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:40:41.747492 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:40:41.747492 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:40:41.747492 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:40:41.747492 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:40:41.747492 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:40:41.747492 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:40:41.747492 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:40:41.747492 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:40:41.748526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:40:41.748526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:40:41.748526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:40:41.750566 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 16/31] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:40:41.751669 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb44190-931c-4db9-ae86-f735cd4a0000 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:41.770262 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0808ba1-0b9e-4eee-99f1-6887b4f4c3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:41.770958 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0808ba1-0b9e-4eee-99f1-6887b4f4c3bb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:41.771440 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0808ba1-0b9e-4eee-99f1-6887b4f4c3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:41.771891 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0808ba1-0b9e-4eee-99f1-6887b4f4c3bb None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:41.772747 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0808ba1-0b9e-4eee-99f1-6887b4f4c3bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:40:41.773266 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0808ba1-0b9e-4eee-99f1-6887b4f4c3bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:41.775038 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0808ba1-0b9e-4eee-99f1-6887b4f4c3bb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:41.791110 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 16/32] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:40:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:41.793196 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0808ba1-0b9e-4eee-99f1-6887b4f4c3bb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:41.901790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb44190-931c-4db9-ae86-f735cd4a0000 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:41.915357 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0808ba1-0b9e-4eee-99f1-6887b4f4c3bb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:41.955382 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee13fd8-0d28-4b2f-ad59-d13f3b8517f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:41.956049 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee13fd8-0d28-4b2f-ad59-d13f3b8517f3 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:41.956323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee13fd8-0d28-4b2f-ad59-d13f3b8517f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:41.956595 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee13fd8-0d28-4b2f-ad59-d13f3b8517f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:41.957309 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee13fd8-0d28-4b2f-ad59-d13f3b8517f3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:41.958699 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee13fd8-0d28-4b2f-ad59-d13f3b8517f3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:41.962239 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40750d-4331-436d-87c0-cc46e4070281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:41.962928 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40750d-4331-436d-87c0-cc46e4070281 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:41.963224 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40750d-4331-436d-87c0-cc46e4070281 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:41.963456 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40750d-4331-436d-87c0-cc46e4070281 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:41.964145 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40750d-4331-436d-87c0-cc46e4070281 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:41.965576 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40750d-4331-436d-87c0-cc46e4070281 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:42.089582 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 17/33] 10.222.0.26 () {60 vars in 1131 bytes} [Sun Oct 2 00:40:41 2022] POST /identity/v3/roles => generated 225 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:40:42.089582 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee13fd8-0d28-4b2f-ad59-d13f3b8517f3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:42.092572 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 17/34] 10.222.0.26 () {60 vars in 1131 bytes} [Sun Oct 2 00:40:41 2022] POST /identity/v3/roles => generated 219 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:40:42.094135 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40750d-4331-436d-87c0-cc46e4070281 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:42.130561 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:42.226910 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:42.235497 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee13fd8-0d28-4b2f-ad59-d13f3b8517f3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:42.281351 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce2031-d010-4c5f-9bb3-e15da21d60a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:42.282750 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce2031-d010-4c5f-9bb3-e15da21d60a4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:42.283204 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce2031-d010-4c5f-9bb3-e15da21d60a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:42.283702 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce2031-d010-4c5f-9bb3-e15da21d60a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:42.284564 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce2031-d010-4c5f-9bb3-e15da21d60a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:40:42.284876 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce2031-d010-4c5f-9bb3-e15da21d60a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:42.286664 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce2031-d010-4c5f-9bb3-e15da21d60a4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:42.304918 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 18/35] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:42.306473 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c800d-8906-4f76-8d95-da87437d247b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:42.306768 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c800d-8906-4f76-8d95-da87437d247b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:42.307055 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c800d-8906-4f76-8d95-da87437d247b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:42.308979 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:40:42.311234 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70d780-0413-41a9-a2c8-806d40f032b0 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:42.311529 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70d780-0413-41a9-a2c8-806d40f032b0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:42.311813 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70d780-0413-41a9-a2c8-806d40f032b0 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:42.314181 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 20/37] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:40:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:40:42.316545 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fdab3-f992-432a-8f31-57b54dcdeb81 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:42.317180 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fdab3-f992-432a-8f31-57b54dcdeb81 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:42.319909 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fdab3-f992-432a-8f31-57b54dcdeb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:42.346034 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5d3fdab3-f992-432a-8f31-57b54dcdeb81 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:40:42.349314 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5d3fdab3-f992-432a-8f31-57b54dcdeb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:40:42.353635 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40750d-4331-436d-87c0-cc46e4070281 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:42.423279 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd101d6-8963-4a1a-b08e-ddd2ce2d2d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:42.424128 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd101d6-8963-4a1a-b08e-ddd2ce2d2d4b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:42.424517 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd101d6-8963-4a1a-b08e-ddd2ce2d2d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:42.424698 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd101d6-8963-4a1a-b08e-ddd2ce2d2d4b None admin] PATH_INFO: `/v3/users/1ae9e9d2d4e74a049733205286b14514` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:42.426254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd101d6-8963-4a1a-b08e-ddd2ce2d2d4b None admin] RBAC: Authorizing `identity:get_user(user_id=1ae9e9d2d4e74a049733205286b14514)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:42.427933 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd101d6-8963-4a1a-b08e-ddd2ce2d2d4b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:42.430240 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 18/38] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:40:42 2022] GET /identity/v3/users/1ae9e9d2d4e74a049733205286b14514 => generated 247 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:42.431123 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd101d6-8963-4a1a-b08e-ddd2ce2d2d4b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:42.488540 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 21/39] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:40:42.491214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc72b09-f145-441f-80ce-cfe5a84504c1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:42.491664 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc72b09-f145-441f-80ce-cfe5a84504c1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:42.492102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc72b09-f145-441f-80ce-cfe5a84504c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:42.514393 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1cc72b09-f145-441f-80ce-cfe5a84504c1 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:40:42.517204 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1cc72b09-f145-441f-80ce-cfe5a84504c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:40:42.535644 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:42.603730 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd101d6-8963-4a1a-b08e-ddd2ce2d2d4b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:42.631246 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:42.638547 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 22/40] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:40:42.640237 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc72b09-f145-441f-80ce-cfe5a84504c1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:42.678478 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c122c-0bb2-4225-a35c-514322597f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:42.679524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c122c-0bb2-4225-a35c-514322597f1d None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:42.680026 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c122c-0bb2-4225-a35c-514322597f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:42.680643 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c122c-0bb2-4225-a35c-514322597f1d None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:42.681814 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c122c-0bb2-4225-a35c-514322597f1d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:42.684554 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c122c-0bb2-4225-a35c-514322597f1d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:42.846252 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc72b09-f145-441f-80ce-cfe5a84504c1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:42.894297 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1749f7-3265-449b-9b98-f37cedbc225e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:42.895339 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1749f7-3265-449b-9b98-f37cedbc225e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:42.895809 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1749f7-3265-449b-9b98-f37cedbc225e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:42.896349 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1749f7-3265-449b-9b98-f37cedbc225e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:42.905182 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 19/41] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Oct 2 00:40:42 2022] POST /identity/v3/projects => generated 301 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:40:42.905416 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1749f7-3265-449b-9b98-f37cedbc225e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:42.905539 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c122c-0bb2-4225-a35c-514322597f1d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:42.905650 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1749f7-3265-449b-9b98-f37cedbc225e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:42.905650 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 23/42] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:40:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:42.914505 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1749f7-3265-449b-9b98-f37cedbc225e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:42.951529 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:43.089032 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c122c-0bb2-4225-a35c-514322597f1d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:43.114894 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1749f7-3265-449b-9b98-f37cedbc225e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:43.154764 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630423e1-7055-4719-8149-62d3dfaf3fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:43.156063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630423e1-7055-4719-8149-62d3dfaf3fae None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:43.156535 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630423e1-7055-4719-8149-62d3dfaf3fae None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:43.157044 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630423e1-7055-4719-8149-62d3dfaf3fae None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:43.158262 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630423e1-7055-4719-8149-62d3dfaf3fae None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:43.160917 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630423e1-7055-4719-8149-62d3dfaf3fae None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:43.172715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4821cb-c715-4b15-b5e6-6d82babdb66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:43.173442 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4821cb-c715-4b15-b5e6-6d82babdb66e None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:43.174414 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4821cb-c715-4b15-b5e6-6d82babdb66e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:43.174704 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4821cb-c715-4b15-b5e6-6d82babdb66e None admin] PATH_INFO: `/v3/domains/default/users/1ae9e9d2d4e74a049733205286b14514/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:43.177779 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4821cb-c715-4b15-b5e6-6d82babdb66e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1ae9e9d2d4e74a049733205286b14514, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:43.179301 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4821cb-c715-4b15-b5e6-6d82babdb66e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:43.186487 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 20/43] 10.222.0.26 () {60 vars in 1131 bytes} [Sun Oct 2 00:40:42 2022] POST /identity/v3/roles => generated 223 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:40:43.188746 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630423e1-7055-4719-8149-62d3dfaf3fae None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:43.199051 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 24/44] 10.222.0.26 () {58 vars in 1361 bytes} [Sun Oct 2 00:40:42 2022] PUT /identity/v3/domains/default/users/1ae9e9d2d4e74a049733205286b14514/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:40:43.252586 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:43.423099 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630423e1-7055-4719-8149-62d3dfaf3fae None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:43.489727 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acb396-bc88-4652-988e-af841970cab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:43.490548 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acb396-bc88-4652-988e-af841970cab4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:43.490969 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acb396-bc88-4652-988e-af841970cab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:43.491369 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acb396-bc88-4652-988e-af841970cab4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:43.493231 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acb396-bc88-4652-988e-af841970cab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:43.495021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acb396-bc88-4652-988e-af841970cab4 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:43.496763 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 21/45] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:40:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:43.503917 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4821cb-c715-4b15-b5e6-6d82babdb66e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:43.599171 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:43.629440 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4821cb-c715-4b15-b5e6-6d82babdb66e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:43.670744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb49da-f896-4a86-885e-6ec705a3e2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:43.671361 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb49da-f896-4a86-885e-6ec705a3e2d2 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:43.672292 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb49da-f896-4a86-885e-6ec705a3e2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:43.672761 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb49da-f896-4a86-885e-6ec705a3e2d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:43.673740 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb49da-f896-4a86-885e-6ec705a3e2d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:43.675675 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb49da-f896-4a86-885e-6ec705a3e2d2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:43.713859 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 25/46] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Oct 2 00:40:43 2022] POST /identity/v3/projects => generated 312 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:40:45.517566 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf5eee-8e16-4b0b-8445-e8df1541dcfb None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:45.518157 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf5eee-8e16-4b0b-8445-e8df1541dcfb None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:45.518157 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf5eee-8e16-4b0b-8445-e8df1541dcfb None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:45.519485 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 22/47] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:40:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:40:45.526097 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56638065-e540-4b3d-9447-5f6a8b7173d6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:45.526876 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56638065-e540-4b3d-9447-5f6a8b7173d6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:45.527036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56638065-e540-4b3d-9447-5f6a8b7173d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:45.658251 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-56638065-e540-4b3d-9447-5f6a8b7173d6 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:40:45.659685 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-56638065-e540-4b3d-9447-5f6a8b7173d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:40:45.749479 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 26/48] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:40:46.027398 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf5eee-8e16-4b0b-8445-e8df1541dcfb None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:46.212176 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:46.227151 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf5eee-8e16-4b0b-8445-e8df1541dcfb None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:46.290605 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d9943-f55c-45f5-8b54-d04d519dc6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:46.291593 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d9943-f55c-45f5-8b54-d04d519dc6be None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:46.292209 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d9943-f55c-45f5-8b54-d04d519dc6be None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:46.292563 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d9943-f55c-45f5-8b54-d04d519dc6be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:46.312246 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d9943-f55c-45f5-8b54-d04d519dc6be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:40:46.322444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-da6d9943-f55c-45f5-8b54-d04d519dc6be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:40:46.322444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:40:46.322444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:40:46.322444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:40:46.322444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:40:46.322444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:40:46.322444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:40:46.322444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:40:46.322444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:40:46.322444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:40:46.322444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:40:46.322444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:40:46.322444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:40:46.322444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:40:46.322444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:40:46.322444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:40:46.323512 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:40:46.323512 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:40:46.323512 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:40:46.323512 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:40:46.323512 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:40:46.323512 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:40:46.323512 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:40:46.323512 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:40:46.323512 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:40:46.323512 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:40:46.323512 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:40:46.323512 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:40:46.323512 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:40:46.323512 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:40:46.323512 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:40:46.323512 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:40:46.324292 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:40:46.324292 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:40:46.324292 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:40:46.324292 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:40:46.324292 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:40:46.324292 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:40:46.324292 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:40:46.324292 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:40:46.324292 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:40:46.324292 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:40:46.324292 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:40:46.324292 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:40:46.326064 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 23/49] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:40:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:40:46.331909 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56638065-e540-4b3d-9447-5f6a8b7173d6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:46.401059 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:46.459726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56638065-e540-4b3d-9447-5f6a8b7173d6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:46.498731 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b4230-045d-4ff6-9063-c356a3708e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:46.499349 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b4230-045d-4ff6-9063-c356a3708e5d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:46.499781 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b4230-045d-4ff6-9063-c356a3708e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:46.499989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b4230-045d-4ff6-9063-c356a3708e5d None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:46.500832 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b4230-045d-4ff6-9063-c356a3708e5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:40:46.501264 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b4230-045d-4ff6-9063-c356a3708e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:46.502698 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b4230-045d-4ff6-9063-c356a3708e5d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:46.512105 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 27/50] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:40:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:46.519083 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d9943-f55c-45f5-8b54-d04d519dc6be None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:46.635954 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d9943-f55c-45f5-8b54-d04d519dc6be None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:46.680272 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df351d-e863-404f-b6ae-67d125377a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:46.680961 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df351d-e863-404f-b6ae-67d125377a27 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:46.681255 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df351d-e863-404f-b6ae-67d125377a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:46.681535 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df351d-e863-404f-b6ae-67d125377a27 None admin] PATH_INFO: `/v3/users/1ae9e9d2d4e74a049733205286b14514` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:46.682892 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df351d-e863-404f-b6ae-67d125377a27 None admin] RBAC: Authorizing `identity:get_user(user_id=1ae9e9d2d4e74a049733205286b14514)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:46.684462 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df351d-e863-404f-b6ae-67d125377a27 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:46.686574 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 24/51] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:40:46 2022] GET /identity/v3/users/1ae9e9d2d4e74a049733205286b14514 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:40:46.693346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b4230-045d-4ff6-9063-c356a3708e5d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:46.746597 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60163b09-ee93-4873-8ab8-d8cad10d358c None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:46.747241 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60163b09-ee93-4873-8ab8-d8cad10d358c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:46.747695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60163b09-ee93-4873-8ab8-d8cad10d358c None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:46.750495 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 25/52] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:40:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:40:46.757454 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aa79f-15f2-4846-a03f-51796723c8fe None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:46.757895 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aa79f-15f2-4846-a03f-51796723c8fe None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:46.758350 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aa79f-15f2-4846-a03f-51796723c8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:46.785159 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8c3aa79f-15f2-4846-a03f-51796723c8fe None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:40:46.787733 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8c3aa79f-15f2-4846-a03f-51796723c8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:40:46.817964 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:46.841374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b4230-045d-4ff6-9063-c356a3708e5d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:46.865881 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:46.883088 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b1ed7-b21d-4efb-b781-4371981aeee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:46.883745 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b1ed7-b21d-4efb-b781-4371981aeee7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:46.884030 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b1ed7-b21d-4efb-b781-4371981aeee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:46.884307 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b1ed7-b21d-4efb-b781-4371981aeee7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:46.885563 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b1ed7-b21d-4efb-b781-4371981aeee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:46.887275 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b1ed7-b21d-4efb-b781-4371981aeee7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:46.888817 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 28/53] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:40:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:46.892625 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 26/54] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:40:46.895264 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b1ed7-b21d-4efb-b781-4371981aeee7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:47.032903 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b1ed7-b21d-4efb-b781-4371981aeee7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:47.090003 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb90642-6833-452e-b838-0f0133f14126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:47.090622 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb90642-6833-452e-b838-0f0133f14126 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:47.090901 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb90642-6833-452e-b838-0f0133f14126 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:47.091178 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb90642-6833-452e-b838-0f0133f14126 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:47.091916 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb90642-6833-452e-b838-0f0133f14126 None admin] RBAC: Adding query filter params (role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.domain.id=default, user.id=1ae9e9d2d4e74a049733205286b14514) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:40:47.092221 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb90642-6833-452e-b838-0f0133f14126 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:47.094176 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb90642-6833-452e-b838-0f0133f14126 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:47.103603 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 29/55] 10.222.0.26 () {56 vars in 1322 bytes} [Sun Oct 2 00:40:46 2022] GET /identity/v3/role_assignments?user.id=1ae9e9d2d4e74a049733205286b14514&scope.domain.id=default&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 530 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:47.174412 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3aa79f-15f2-4846-a03f-51796723c8fe None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:47.356601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3aa79f-15f2-4846-a03f-51796723c8fe None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:47.402164 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb77af-4f5b-409b-872d-6f1d7ae7532c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:47.402822 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb77af-4f5b-409b-872d-6f1d7ae7532c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:47.403103 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb77af-4f5b-409b-872d-6f1d7ae7532c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:47.403379 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb77af-4f5b-409b-872d-6f1d7ae7532c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:47.404693 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb77af-4f5b-409b-872d-6f1d7ae7532c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:47.407043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb77af-4f5b-409b-872d-6f1d7ae7532c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:47.409135 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 27/56] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:40:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:47.414990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb90642-6833-452e-b838-0f0133f14126 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:47.478064 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:47.531625 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb90642-6833-452e-b838-0f0133f14126 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:47.568438 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662a60d-2f22-428a-9ec8-589ab3cc1408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:47.569088 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662a60d-2f22-428a-9ec8-589ab3cc1408 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:47.569368 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662a60d-2f22-428a-9ec8-589ab3cc1408 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:47.569641 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662a60d-2f22-428a-9ec8-589ab3cc1408 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:47.570310 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662a60d-2f22-428a-9ec8-589ab3cc1408 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:47.571780 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662a60d-2f22-428a-9ec8-589ab3cc1408 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:47.607345 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 30/57] 10.222.0.26 () {60 vars in 1140 bytes} [Sun Oct 2 00:40:47 2022] POST /identity/v3/projects => generated 298 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:40:49.856794 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f434eec-d6db-4a68-a006-7f0c5e26c69c None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:49.857334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f434eec-d6db-4a68-a006-7f0c5e26c69c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:49.857334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f434eec-d6db-4a68-a006-7f0c5e26c69c None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:49.858662 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 28/58] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:40:49.864099 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d7cd-f473-44c8-9f93-30d12f7ed9ca None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:49.864517 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d7cd-f473-44c8-9f93-30d12f7ed9ca None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:49.864660 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d7cd-f473-44c8-9f93-30d12f7ed9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:49.883541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8a74d7cd-f473-44c8-9f93-30d12f7ed9ca None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:40:49.884756 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8a74d7cd-f473-44c8-9f93-30d12f7ed9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:40:49.951836 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 31/59] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:40:50.230604 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f434eec-d6db-4a68-a006-7f0c5e26c69c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:50.254717 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:50.342548 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f434eec-d6db-4a68-a006-7f0c5e26c69c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:50.377315 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9751c11-9509-4d66-82bf-1754fa201297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:50.377946 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9751c11-9509-4d66-82bf-1754fa201297 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:50.378229 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9751c11-9509-4d66-82bf-1754fa201297 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:50.378506 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9751c11-9509-4d66-82bf-1754fa201297 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:50.379625 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9751c11-9509-4d66-82bf-1754fa201297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:50.381147 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9751c11-9509-4d66-82bf-1754fa201297 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:50.382718 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 29/60] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:40:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:50.388252 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74d7cd-f473-44c8-9f93-30d12f7ed9ca None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:50.422877 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:50.490357 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74d7cd-f473-44c8-9f93-30d12f7ed9ca None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:50.524119 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5544d-3713-41d9-833e-ae87023e55a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:50.524727 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5544d-3713-41d9-833e-ae87023e55a7 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:50.525045 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5544d-3713-41d9-833e-ae87023e55a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:50.525325 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5544d-3713-41d9-833e-ae87023e55a7 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:50.525973 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5544d-3713-41d9-833e-ae87023e55a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:50.527439 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5544d-3713-41d9-833e-ae87023e55a7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:50.554114 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 32/61] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Oct 2 00:40:50 2022] POST /identity/v3/users => generated 275 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:40:54.012790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2af10-7285-449d-94b0-92b37d73c228 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:54.013872 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2af10-7285-449d-94b0-92b37d73c228 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:54.014755 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2af10-7285-449d-94b0-92b37d73c228 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:54.016529 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 30/62] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:40:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:40:54.022676 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244607a-88ce-4192-b810-2981cb97eeea None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:54.023174 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244607a-88ce-4192-b810-2981cb97eeea None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:54.023285 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244607a-88ce-4192-b810-2981cb97eeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:54.050236 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e244607a-88ce-4192-b810-2981cb97eeea None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:40:54.051501 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e244607a-88ce-4192-b810-2981cb97eeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:40:54.158760 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 33/63] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:40:54.231159 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0b409-3863-4379-a3f3-f54c08cc692b None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:54.231159 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0b409-3863-4379-a3f3-f54c08cc692b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:54.231159 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0b409-3863-4379-a3f3-f54c08cc692b None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:54.232479 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 31/64] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:40:54.240524 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288509bd-0854-4dcf-89f1-4bda1a30a8b8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:54.240812 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288509bd-0854-4dcf-89f1-4bda1a30a8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:54.241115 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288509bd-0854-4dcf-89f1-4bda1a30a8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:54.270120 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-288509bd-0854-4dcf-89f1-4bda1a30a8b8 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:40:54.271255 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-288509bd-0854-4dcf-89f1-4bda1a30a8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:40:54.291806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0201fe-271f-4930-bd09-750777f8c98b None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:54.292419 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0201fe-271f-4930-bd09-750777f8c98b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:54.292929 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0201fe-271f-4930-bd09-750777f8c98b None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:54.294586 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:54.294899 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 32/65] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:40:54.301126 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb9c50-153e-4aa8-b159-bf1b1d4ae1a8 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:54.301806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb9c50-153e-4aa8-b159-bf1b1d4ae1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:54.302378 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb9c50-153e-4aa8-b159-bf1b1d4ae1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:54.329996 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-f2eb9c50-153e-4aa8-b159-bf1b1d4ae1a8 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:40:54.331951 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f2eb9c50-153e-4aa8-b159-bf1b1d4ae1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:40:54.382826 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 34/66] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:40:54.465026 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 33/67] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:40:54.479893 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288509bd-0854-4dcf-89f1-4bda1a30a8b8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:54.643852 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288509bd-0854-4dcf-89f1-4bda1a30a8b8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:54.697543 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc7c18-4f36-40b6-b678-951ae4691130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:54.698222 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc7c18-4f36-40b6-b678-951ae4691130 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:54.698513 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc7c18-4f36-40b6-b678-951ae4691130 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:54.698785 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc7c18-4f36-40b6-b678-951ae4691130 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:54.722224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc7c18-4f36-40b6-b678-951ae4691130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:40:54.727525 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4afc7c18-4f36-40b6-b678-951ae4691130 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:40:54.727525 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:40:54.727525 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:40:54.727525 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:40:54.727525 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:40:54.727525 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:40:54.727525 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:40:54.727525 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:40:54.727525 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:40:54.727525 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:40:54.727525 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:40:54.727525 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:40:54.727525 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:40:54.727525 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:40:54.727525 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:40:54.727525 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:40:54.728477 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:40:54.728477 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:40:54.728477 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:40:54.728477 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:40:54.728477 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:40:54.728477 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:40:54.728477 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:40:54.728477 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:40:54.728477 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:40:54.728477 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:40:54.728477 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:40:54.728477 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:40:54.728477 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:40:54.728477 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:40:54.728477 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:40:54.728477 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:40:54.729299 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:40:54.729299 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:40:54.729299 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:40:54.729299 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:40:54.729299 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:40:54.729299 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:40:54.729299 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:40:54.729299 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:40:54.729299 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:40:54.729299 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:40:54.729299 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:40:54.729299 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:40:54.729299 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 35/68] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:40:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:40:54.736096 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb9c50-153e-4aa8-b159-bf1b1d4ae1a8 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:54.768154 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:54.826214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc7c18-4f36-40b6-b678-951ae4691130 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:54.841337 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:54.888586 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb9c50-153e-4aa8-b159-bf1b1d4ae1a8 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:54.931403 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe43e6d-6dc2-4420-a493-54d6761b2293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:54.932024 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe43e6d-6dc2-4420-a493-54d6761b2293 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:54.932303 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe43e6d-6dc2-4420-a493-54d6761b2293 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:54.932583 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe43e6d-6dc2-4420-a493-54d6761b2293 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:54.933291 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe43e6d-6dc2-4420-a493-54d6761b2293 None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:40:54.933599 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe43e6d-6dc2-4420-a493-54d6761b2293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:54.935023 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe43e6d-6dc2-4420-a493-54d6761b2293 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:54.940512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc7c18-4f36-40b6-b678-951ae4691130 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:54.944421 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:40:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:54.949086 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe43e6d-6dc2-4420-a493-54d6761b2293 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:54.987170 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907514d-3adb-4ad2-9eba-570f52978a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:54.987170 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907514d-3adb-4ad2-9eba-570f52978a2a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:54.987170 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907514d-3adb-4ad2-9eba-570f52978a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:54.987588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907514d-3adb-4ad2-9eba-570f52978a2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:54.998522 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907514d-3adb-4ad2-9eba-570f52978a2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:40:55.004128 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4907514d-3adb-4ad2-9eba-570f52978a2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:40:55.004128 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:40:55.004128 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:40:55.004128 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:40:55.004128 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:40:55.004128 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:40:55.004128 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:40:55.004128 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:40:55.004128 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:40:55.004128 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:40:55.004128 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:40:55.004128 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:40:55.004128 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:40:55.004128 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:40:55.004128 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:40:55.004128 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:40:55.005050 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:40:55.005050 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:40:55.005050 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:40:55.005050 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:40:55.005050 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:40:55.005050 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:40:55.005050 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:40:55.005050 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:40:55.005050 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:40:55.005050 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:40:55.005050 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:40:55.005050 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:40:55.005050 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:40:55.005050 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:40:55.005050 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:40:55.005050 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:40:55.010847 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:40:55.010847 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:40:55.010847 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:40:55.010847 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:40:55.010847 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:40:55.010847 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:40:55.010847 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:40:55.010847 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:40:55.010847 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:40:55.010847 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:40:55.010847 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:40:55.010847 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:40:55.010847 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 36/70] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:40:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:40:55.010847 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af6685-a620-4608-a1d3-9ccc304fbbc5 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:55.013197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af6685-a620-4608-a1d3-9ccc304fbbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:55.013197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af6685-a620-4608-a1d3-9ccc304fbbc5 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:55.013197 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 37/71] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:40:55.013197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eea302-23fd-4cda-a49a-f565c46d821c None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:55.013197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eea302-23fd-4cda-a49a-f565c46d821c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:55.013197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eea302-23fd-4cda-a49a-f565c46d821c None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:55.013197 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 38/72] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:40:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:40:55.013726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eea302-23fd-4cda-a49a-f565c46d821c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:55.050735 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:55.071757 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe43e6d-6dc2-4420-a493-54d6761b2293 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:55.090075 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:55.113010 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce531a7f-81ed-499f-8c7f-13ad52339e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:55.113670 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce531a7f-81ed-499f-8c7f-13ad52339e1f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:55.113939 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce531a7f-81ed-499f-8c7f-13ad52339e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:55.114215 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce531a7f-81ed-499f-8c7f-13ad52339e1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:55.125010 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce531a7f-81ed-499f-8c7f-13ad52339e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:40:55.125486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eea302-23fd-4cda-a49a-f565c46d821c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:55.130526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-ce531a7f-81ed-499f-8c7f-13ad52339e1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:40:55.130526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:40:55.130526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:40:55.130526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:40:55.130526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:40:55.130526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:40:55.130526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:40:55.130526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:40:55.130526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:40:55.130526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:40:55.130526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:40:55.130526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:40:55.130526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:40:55.130526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:40:55.130526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:40:55.130526 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:40:55.131437 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:40:55.131437 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:40:55.131437 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:40:55.131437 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:40:55.131437 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:40:55.131437 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:40:55.131437 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:40:55.131437 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:40:55.131437 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:40:55.131437 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:40:55.131437 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:40:55.131437 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:40:55.131437 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:40:55.131437 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:40:55.131437 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:40:55.131437 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:40:55.132216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:40:55.132216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:40:55.132216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:40:55.132216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:40:55.132216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:40:55.132216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:40:55.132216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:40:55.132216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:40:55.132216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:40:55.132216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:40:55.132216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:40:55.132216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:40:55.132216 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 35/73] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:40:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:40:55.132867 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce531a7f-81ed-499f-8c7f-13ad52339e1f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:55.167971 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ffffb-0bd7-49c1-aa07-6bad939d51a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:55.168633 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ffffb-0bd7-49c1-aa07-6bad939d51a3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:55.168913 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ffffb-0bd7-49c1-aa07-6bad939d51a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:55.169214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ffffb-0bd7-49c1-aa07-6bad939d51a3 None admin] PATH_INFO: `/v3/users/69f4406ff16447f8af2cb9634cbd3cc6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:55.187408 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ffffb-0bd7-49c1-aa07-6bad939d51a3 None admin] RBAC: Authorizing `identity:get_user(user_id=69f4406ff16447f8af2cb9634cbd3cc6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:55.188982 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ffffb-0bd7-49c1-aa07-6bad939d51a3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:55.190708 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 39/74] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:40:55 2022] GET /identity/v3/users/69f4406ff16447f8af2cb9634cbd3cc6 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:55.196694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e1d57-1c80-4132-8ef3-af1457131ac4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:55.196694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e1d57-1c80-4132-8ef3-af1457131ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:55.196694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e1d57-1c80-4132-8ef3-af1457131ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:55.213063 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ff5e1d57-1c80-4132-8ef3-af1457131ac4 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:40:55.214326 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ff5e1d57-1c80-4132-8ef3-af1457131ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:40:55.243050 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce531a7f-81ed-499f-8c7f-13ad52339e1f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:55.283899 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a00bd-99b8-470f-ad23-ee2c0ae45c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:55.284630 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a00bd-99b8-470f-ad23-ee2c0ae45c7e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:55.285012 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a00bd-99b8-470f-ad23-ee2c0ae45c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:55.285453 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a00bd-99b8-470f-ad23-ee2c0ae45c7e None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:55.286239 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a00bd-99b8-470f-ad23-ee2c0ae45c7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:40:55.286665 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a00bd-99b8-470f-ad23-ee2c0ae45c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:55.288375 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a00bd-99b8-470f-ad23-ee2c0ae45c7e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:55.299003 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 36/75] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:40:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:55.301087 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf72172-8a50-42bd-b656-ebd1f4085870 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:55.301533 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf72172-8a50-42bd-b656-ebd1f4085870 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:55.301965 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf72172-8a50-42bd-b656-ebd1f4085870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:55.307406 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 40/76] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:40:55.308370 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e1d57-1c80-4132-8ef3-af1457131ac4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:55.322180 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:55.339971 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-baf72172-8a50-42bd-b656-ebd1f4085870 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:40:55.341227 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-baf72172-8a50-42bd-b656-ebd1f4085870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:40:55.400037 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:55.456770 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e1d57-1c80-4132-8ef3-af1457131ac4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:55.481595 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 37/77] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:40:55.483181 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf72172-8a50-42bd-b656-ebd1f4085870 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:55.517151 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3184d31-d3e0-4cc1-9109-4f638faddfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:55.518316 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3184d31-d3e0-4cc1-9109-4f638faddfb8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:55.518812 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3184d31-d3e0-4cc1-9109-4f638faddfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:55.519291 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3184d31-d3e0-4cc1-9109-4f638faddfb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:55.520532 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3184d31-d3e0-4cc1-9109-4f638faddfb8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:40:55.521101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3184d31-d3e0-4cc1-9109-4f638faddfb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:55.523854 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3184d31-d3e0-4cc1-9109-4f638faddfb8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:55.540274 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 41/78] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:40:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:55.542167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3184d31-d3e0-4cc1-9109-4f638faddfb8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:55.673361 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf72172-8a50-42bd-b656-ebd1f4085870 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:55.715263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:55.721975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ddf32-e750-4f7b-9ef9-b3dd000feae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:55.722749 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ddf32-e750-4f7b-9ef9-b3dd000feae8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:55.723035 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ddf32-e750-4f7b-9ef9-b3dd000feae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:55.723307 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ddf32-e750-4f7b-9ef9-b3dd000feae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:55.734535 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3184d31-d3e0-4cc1-9109-4f638faddfb8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:55.768985 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:55.787635 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47b030-5146-4d2b-8e00-65908814404c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:55.788902 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47b030-5146-4d2b-8e00-65908814404c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:55.789306 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47b030-5146-4d2b-8e00-65908814404c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:55.789902 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47b030-5146-4d2b-8e00-65908814404c None admin] PATH_INFO: `/v3/users/1ae9e9d2d4e74a049733205286b14514` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:55.791881 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47b030-5146-4d2b-8e00-65908814404c None admin] RBAC: Authorizing `identity:get_user(user_id=1ae9e9d2d4e74a049733205286b14514)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:55.794361 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47b030-5146-4d2b-8e00-65908814404c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:55.802639 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 42/79] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:40:55 2022] GET /identity/v3/users/1ae9e9d2d4e74a049733205286b14514 => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:55.802639 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47b030-5146-4d2b-8e00-65908814404c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:55.812107 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ddf32-e750-4f7b-9ef9-b3dd000feae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:55.813819 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ddf32-e750-4f7b-9ef9-b3dd000feae8 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:55.911536 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47b030-5146-4d2b-8e00-65908814404c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:55.933619 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 38/80] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:40:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:40:55.933619 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ddf32-e750-4f7b-9ef9-b3dd000feae8 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:55.955636 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47b474-7684-44c5-8459-84dbc67ce382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:55.956285 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47b474-7684-44c5-8459-84dbc67ce382 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:55.956571 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47b474-7684-44c5-8459-84dbc67ce382 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:55.956848 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47b474-7684-44c5-8459-84dbc67ce382 None admin] PATH_INFO: `/v3/users/69f4406ff16447f8af2cb9634cbd3cc6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:55.958079 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47b474-7684-44c5-8459-84dbc67ce382 None admin] RBAC: Authorizing `identity:get_user(user_id=69f4406ff16447f8af2cb9634cbd3cc6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:55.959556 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47b474-7684-44c5-8459-84dbc67ce382 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:55.961233 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 43/81] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:40:55 2022] GET /identity/v3/users/69f4406ff16447f8af2cb9634cbd3cc6 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:55.962206 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47b474-7684-44c5-8459-84dbc67ce382 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:55.970127 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:56.026399 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:56.046216 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ddf32-e750-4f7b-9ef9-b3dd000feae8 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:56.079729 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47b474-7684-44c5-8459-84dbc67ce382 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:56.085337 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f6bcd-6b49-48de-b7bb-309e03fba9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:56.085987 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6bcd-6b49-48de-b7bb-309e03fba9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:56.086270 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6bcd-6b49-48de-b7bb-309e03fba9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:56.086546 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6bcd-6b49-48de-b7bb-309e03fba9f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:56.087721 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f6bcd-6b49-48de-b7bb-309e03fba9f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:56.089246 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f6bcd-6b49-48de-b7bb-309e03fba9f2 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:56.090863 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 39/82] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:40:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:56.091668 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f6bcd-6b49-48de-b7bb-309e03fba9f2 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:56.121487 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0d5d1-05e2-478f-8e87-bca82f969104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:56.122203 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0d5d1-05e2-478f-8e87-bca82f969104 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:56.122425 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0d5d1-05e2-478f-8e87-bca82f969104 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:56.122668 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0d5d1-05e2-478f-8e87-bca82f969104 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:56.134685 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0d5d1-05e2-478f-8e87-bca82f969104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:40:56.140999 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-48f0d5d1-05e2-478f-8e87-bca82f969104 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:40:56.140999 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:40:56.140999 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:40:56.140999 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:40:56.140999 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:40:56.140999 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:40:56.140999 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:40:56.140999 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:40:56.140999 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:40:56.140999 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:40:56.140999 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:40:56.140999 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:40:56.140999 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:40:56.140999 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:40:56.140999 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:40:56.140999 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:40:56.142630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:40:56.142630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:40:56.142630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:40:56.142630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:40:56.142630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:40:56.142630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:40:56.142630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:40:56.142630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:40:56.142630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:40:56.142630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:40:56.142630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:40:56.142630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:40:56.142630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:40:56.142630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:40:56.142630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:40:56.142630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:40:56.143987 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:40:56.143987 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:40:56.143987 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:40:56.143987 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:40:56.143987 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:40:56.143987 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:40:56.143987 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:40:56.143987 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:40:56.143987 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:40:56.143987 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:40:56.143987 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:40:56.143987 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:40:56.143987 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 44/83] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:40:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:40:56.146410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0d5d1-05e2-478f-8e87-bca82f969104 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:56.204181 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:56.207746 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f6bcd-6b49-48de-b7bb-309e03fba9f2 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:56.244262 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaff74f-dc7f-4892-a855-b87e8ee21d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:56.244796 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaff74f-dc7f-4892-a855-b87e8ee21d93 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:56.245114 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaff74f-dc7f-4892-a855-b87e8ee21d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:56.245398 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaff74f-dc7f-4892-a855-b87e8ee21d93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:56.256871 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0d5d1-05e2-478f-8e87-bca82f969104 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:56.274685 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:56.293607 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeff482-7ca9-405a-8222-7c134d0b685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:56.294269 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeff482-7ca9-405a-8222-7c134d0b685a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:56.294559 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeff482-7ca9-405a-8222-7c134d0b685a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:56.294834 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeff482-7ca9-405a-8222-7c134d0b685a None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:56.296042 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeff482-7ca9-405a-8222-7c134d0b685a None admin] RBAC: Authorizing `identity:get_project(project_id=141aed90ccfe453283d0e7fd34fb461d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:56.298364 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeff482-7ca9-405a-8222-7c134d0b685a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:56.300072 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 45/84] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:40:56 2022] GET /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:56.306134 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeff482-7ca9-405a-8222-7c134d0b685a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:56.322876 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaff74f-dc7f-4892-a855-b87e8ee21d93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:56.324523 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaff74f-dc7f-4892-a855-b87e8ee21d93 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:56.418737 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeff482-7ca9-405a-8222-7c134d0b685a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:56.438539 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:56.442891 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 40/85] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:40:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:40:56.444120 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaff74f-dc7f-4892-a855-b87e8ee21d93 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:56.459709 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877c834-02b7-4693-9fae-6e3754d01227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:56.460323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877c834-02b7-4693-9fae-6e3754d01227 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:56.460786 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877c834-02b7-4693-9fae-6e3754d01227 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:56.461092 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877c834-02b7-4693-9fae-6e3754d01227 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:56.520208 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:56.536640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877c834-02b7-4693-9fae-6e3754d01227 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:56.538175 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877c834-02b7-4693-9fae-6e3754d01227 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:56.554492 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaff74f-dc7f-4892-a855-b87e8ee21d93 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:56.589626 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365d237-a39d-44ed-a1b5-9b5d2a24bb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:56.590367 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365d237-a39d-44ed-a1b5-9b5d2a24bb13 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:56.590840 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365d237-a39d-44ed-a1b5-9b5d2a24bb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:56.591265 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365d237-a39d-44ed-a1b5-9b5d2a24bb13 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:56.592033 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365d237-a39d-44ed-a1b5-9b5d2a24bb13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:56.594464 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365d237-a39d-44ed-a1b5-9b5d2a24bb13 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:56.628269 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 41/86] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Oct 2 00:40:56 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:40:56.629694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365d237-a39d-44ed-a1b5-9b5d2a24bb13 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:56.653662 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 46/87] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:40:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:40:56.654661 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877c834-02b7-4693-9fae-6e3754d01227 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:56.716902 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:56.793887 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365d237-a39d-44ed-a1b5-9b5d2a24bb13 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:56.799140 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:56.823105 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877c834-02b7-4693-9fae-6e3754d01227 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:56.854252 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58eda0e-73a4-40ea-ae40-8f0f31422e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:56.855011 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eda0e-73a4-40ea-ae40-8f0f31422e68 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:56.855453 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eda0e-73a4-40ea-ae40-8f0f31422e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:56.855924 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eda0e-73a4-40ea-ae40-8f0f31422e68 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:56.860473 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58eda0e-73a4-40ea-ae40-8f0f31422e68 None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:40:56.860473 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58eda0e-73a4-40ea-ae40-8f0f31422e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:56.860473 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58eda0e-73a4-40ea-ae40-8f0f31422e68 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:56.871753 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 42/88] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:40:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:56.871946 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30b97b-9ee4-47d9-a787-b1f010ee0790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:56.872531 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58eda0e-73a4-40ea-ae40-8f0f31422e68 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:56.872973 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30b97b-9ee4-47d9-a787-b1f010ee0790 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:56.873368 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30b97b-9ee4-47d9-a787-b1f010ee0790 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:56.873781 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30b97b-9ee4-47d9-a787-b1f010ee0790 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:56.875616 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30b97b-9ee4-47d9-a787-b1f010ee0790 None admin] RBAC: Adding query filter params (role.id=424fdbf5034b4445bf8a3022b9fb8b4c, scope.project.id=141aed90ccfe453283d0e7fd34fb461d, user.id=69f4406ff16447f8af2cb9634cbd3cc6) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:40:56.876130 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30b97b-9ee4-47d9-a787-b1f010ee0790 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:56.882150 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30b97b-9ee4-47d9-a787-b1f010ee0790 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:56.891537 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 47/89] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:40:56 2022] GET /identity/v3/role_assignments?user.id=69f4406ff16447f8af2cb9634cbd3cc6&scope.project.id=141aed90ccfe453283d0e7fd34fb461d&role.id=424fdbf5034b4445bf8a3022b9fb8b4c => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:56.893168 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30b97b-9ee4-47d9-a787-b1f010ee0790 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:57.012337 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58eda0e-73a4-40ea-ae40-8f0f31422e68 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:57.036494 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:57.058611 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b61827-2101-49b2-aab0-1d70d24d9acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:57.059419 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b61827-2101-49b2-aab0-1d70d24d9acc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:57.059711 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b61827-2101-49b2-aab0-1d70d24d9acc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:57.059987 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b61827-2101-49b2-aab0-1d70d24d9acc None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:57.061205 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b61827-2101-49b2-aab0-1d70d24d9acc None admin] RBAC: Authorizing `identity:get_project(project_id=141aed90ccfe453283d0e7fd34fb461d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:57.062786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b61827-2101-49b2-aab0-1d70d24d9acc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:57.064880 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 43/90] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:40:56 2022] GET /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:57.065764 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b61827-2101-49b2-aab0-1d70d24d9acc None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:57.071362 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30b97b-9ee4-47d9-a787-b1f010ee0790 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:57.128694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7227f-1475-4e68-9d1e-fc93e8ae2080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:57.128694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7227f-1475-4e68-9d1e-fc93e8ae2080 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:57.128694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7227f-1475-4e68-9d1e-fc93e8ae2080 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:57.128694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7227f-1475-4e68-9d1e-fc93e8ae2080 None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:57.130036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7227f-1475-4e68-9d1e-fc93e8ae2080 None admin] RBAC: Authorizing `identity:get_project(project_id=141aed90ccfe453283d0e7fd34fb461d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:57.130036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7227f-1475-4e68-9d1e-fc93e8ae2080 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:57.130036 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 48/91] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:40:56 2022] GET /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:57.130036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7227f-1475-4e68-9d1e-fc93e8ae2080 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:57.173513 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:57.305356 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7227f-1475-4e68-9d1e-fc93e8ae2080 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:57.316311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b61827-2101-49b2-aab0-1d70d24d9acc None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:57.363423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218a796-692e-4136-acf1-4e98b43035f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:57.366850 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218a796-692e-4136-acf1-4e98b43035f0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:57.370131 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218a796-692e-4136-acf1-4e98b43035f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:57.370917 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218a796-692e-4136-acf1-4e98b43035f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:57.372618 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218a796-692e-4136-acf1-4e98b43035f0 None admin] RBAC: Adding query filter params (role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.project.id=141aed90ccfe453283d0e7fd34fb461d, user.id=1ae9e9d2d4e74a049733205286b14514) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:40:57.375512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218a796-692e-4136-acf1-4e98b43035f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:57.378573 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218a796-692e-4136-acf1-4e98b43035f0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:57.406593 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 49/92] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:40:57 2022] GET /identity/v3/role_assignments?user.id=1ae9e9d2d4e74a049733205286b14514&scope.project.id=141aed90ccfe453283d0e7fd34fb461d&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:57.408648 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218a796-692e-4136-acf1-4e98b43035f0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:57.430108 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e2117-30bf-4925-84c8-86ed45a9663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:57.431213 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e2117-30bf-4925-84c8-86ed45a9663c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:57.431726 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e2117-30bf-4925-84c8-86ed45a9663c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:57.432224 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e2117-30bf-4925-84c8-86ed45a9663c None admin] PATH_INFO: `/v3/users/69f4406ff16447f8af2cb9634cbd3cc6` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:57.434370 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e2117-30bf-4925-84c8-86ed45a9663c None admin] RBAC: Authorizing `identity:get_user(user_id=69f4406ff16447f8af2cb9634cbd3cc6)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:57.445166 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e2117-30bf-4925-84c8-86ed45a9663c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:57.449501 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 44/93] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:40:57 2022] GET /identity/v3/users/69f4406ff16447f8af2cb9634cbd3cc6 => generated 275 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:57.460188 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e2117-30bf-4925-84c8-86ed45a9663c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:57.617649 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:57.637718 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:57.699068 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218a796-692e-4136-acf1-4e98b43035f0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:57.734678 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e2117-30bf-4925-84c8-86ed45a9663c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:57.786719 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45d32c-4c4d-4871-ac9e-427786b3edfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:57.787721 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45d32c-4c4d-4871-ac9e-427786b3edfa None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:57.788196 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45d32c-4c4d-4871-ac9e-427786b3edfa None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:57.788657 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45d32c-4c4d-4871-ac9e-427786b3edfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:57.789634 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45d32c-4c4d-4871-ac9e-427786b3edfa None admin] RBAC: Adding query filter params (role.id=030fcd169fb44f759772ef3101c07012, scope.project.id=141aed90ccfe453283d0e7fd34fb461d, user.id=69f4406ff16447f8af2cb9634cbd3cc6) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:40:57.790160 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45d32c-4c4d-4871-ac9e-427786b3edfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:57.792108 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45d32c-4c4d-4871-ac9e-427786b3edfa None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:57.805148 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 50/94] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:40:57 2022] GET /identity/v3/role_assignments?user.id=69f4406ff16447f8af2cb9634cbd3cc6&scope.project.id=141aed90ccfe453283d0e7fd34fb461d&role.id=030fcd169fb44f759772ef3101c07012 => generated 259 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:40:57.813497 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e28595-3846-4b74-ad1a-312711a9524a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:57.814540 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e28595-3846-4b74-ad1a-312711a9524a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:57.815028 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e28595-3846-4b74-ad1a-312711a9524a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:57.815523 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e28595-3846-4b74-ad1a-312711a9524a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:57.929533 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e28595-3846-4b74-ad1a-312711a9524a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:57.931495 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e28595-3846-4b74-ad1a-312711a9524a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:58.015665 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:40:58.084487 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 45/95] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:40:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:40:58.093762 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45d32c-4c4d-4871-ac9e-427786b3edfa None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:58.236146 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45d32c-4c4d-4871-ac9e-427786b3edfa None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:58.282393 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bfd53-f129-40f9-a494-0dcac65b13b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:58.283046 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bfd53-f129-40f9-a494-0dcac65b13b6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:58.283326 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bfd53-f129-40f9-a494-0dcac65b13b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:58.283608 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bfd53-f129-40f9-a494-0dcac65b13b6 None admin] PATH_INFO: `/v3/projects/740d73709b4a456eaab8690820d13676` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:58.286079 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bfd53-f129-40f9-a494-0dcac65b13b6 None admin] RBAC: Authorizing `identity:get_project(project_id=740d73709b4a456eaab8690820d13676)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:58.287561 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bfd53-f129-40f9-a494-0dcac65b13b6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:58.289303 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 51/96] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:40:58 2022] GET /identity/v3/projects/740d73709b4a456eaab8690820d13676 => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:40:58.298930 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e28595-3846-4b74-ad1a-312711a9524a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:40:58.448914 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e28595-3846-4b74-ad1a-312711a9524a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:40:58.502279 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6df07-1d98-4e28-9459-8b532004e833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:40:58.503183 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6df07-1d98-4e28-9459-8b532004e833 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:40:58.503668 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6df07-1d98-4e28-9459-8b532004e833 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:40:58.504134 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6df07-1d98-4e28-9459-8b532004e833 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:40:58.505504 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6df07-1d98-4e28-9459-8b532004e833 None admin] RBAC: Adding query filter params (role.id=424fdbf5034b4445bf8a3022b9fb8b4c, scope.project.id=740d73709b4a456eaab8690820d13676, user.id=69f4406ff16447f8af2cb9634cbd3cc6) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:40:58.506042 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6df07-1d98-4e28-9459-8b532004e833 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:40:58.508859 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6df07-1d98-4e28-9459-8b532004e833 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:40:58.520631 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 46/97] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:40:58 2022] GET /identity/v3/role_assignments?user.id=69f4406ff16447f8af2cb9634cbd3cc6&scope.project.id=740d73709b4a456eaab8690820d13676&role.id=424fdbf5034b4445bf8a3022b9fb8b4c => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:00.539558 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d00b7-3b96-4424-bb39-f8ca20ae9cf4 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:00.540086 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d00b7-3b96-4424-bb39-f8ca20ae9cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:00.540465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d00b7-3b96-4424-bb39-f8ca20ae9cf4 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:00.543246 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 52/98] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:00.550210 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb105f9-215d-4a0e-b72f-cf1f2bf1a79d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:00.550729 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb105f9-215d-4a0e-b72f-cf1f2bf1a79d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:00.551157 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb105f9-215d-4a0e-b72f-cf1f2bf1a79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:00.592411 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-fcb105f9-215d-4a0e-b72f-cf1f2bf1a79d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:00.596097 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fcb105f9-215d-4a0e-b72f-cf1f2bf1a79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:00.626265 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:00.675475 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caee8c6-42e4-460c-bd6e-4acddd0b8183 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:00.675855 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caee8c6-42e4-460c-bd6e-4acddd0b8183 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:00.676332 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caee8c6-42e4-460c-bd6e-4acddd0b8183 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:00.679095 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 53/99] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:00.688615 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249abe4b-d572-4125-b877-b525125b0c79 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:00.689133 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249abe4b-d572-4125-b877-b525125b0c79 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:00.689612 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249abe4b-d572-4125-b877-b525125b0c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:00.726129 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-249abe4b-d572-4125-b877-b525125b0c79 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:00.729351 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-249abe4b-d572-4125-b877-b525125b0c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:00.745872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:00.752719 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 47/100] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:00.857968 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 54/101] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:41:00.877263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dbe66-2182-4e6e-9c6f-c6562a299196 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:00.878068 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dbe66-2182-4e6e-9c6f-c6562a299196 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:00.878824 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dbe66-2182-4e6e-9c6f-c6562a299196 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:00.881601 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 48/102] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:00.888523 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8aee17-d36c-4ac8-96b6-1a3f00499867 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:00.889730 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8aee17-d36c-4ac8-96b6-1a3f00499867 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:00.891029 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8aee17-d36c-4ac8-96b6-1a3f00499867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:00.932332 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-fa8aee17-d36c-4ac8-96b6-1a3f00499867 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:00.934805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fa8aee17-d36c-4ac8-96b6-1a3f00499867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:01.023451 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 55/103] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:01.133980 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dbe66-2182-4e6e-9c6f-c6562a299196 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:01.146462 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a164e95-6c96-45d1-9040-93fb0940838e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:01.151592 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a164e95-6c96-45d1-9040-93fb0940838e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:01.151592 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a164e95-6c96-45d1-9040-93fb0940838e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:01.151592 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 56/104] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:01.158483 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad3f69-4ced-4c99-9f34-551de6b32c1d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:01.158768 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad3f69-4ced-4c99-9f34-551de6b32c1d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:01.159127 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad3f69-4ced-4c99-9f34-551de6b32c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:01.192913 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e4ad3f69-4ced-4c99-9f34-551de6b32c1d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:01.192913 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e4ad3f69-4ced-4c99-9f34-551de6b32c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:01.361131 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 57/105] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:41:01.362236 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad3f69-4ced-4c99-9f34-551de6b32c1d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:01.372153 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:01.377170 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dbe66-2182-4e6e-9c6f-c6562a299196 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:01.462207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c04348-749d-49cb-81ec-3155da51ee82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:01.463299 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c04348-749d-49cb-81ec-3155da51ee82 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:01.463861 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c04348-749d-49cb-81ec-3155da51ee82 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:01.464463 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c04348-749d-49cb-81ec-3155da51ee82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:01.467191 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c04348-749d-49cb-81ec-3155da51ee82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:01.469687 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c04348-749d-49cb-81ec-3155da51ee82 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:01.472661 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 49/106] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:41:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:01.474150 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c04348-749d-49cb-81ec-3155da51ee82 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:01.506861 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:01.710321 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad3f69-4ced-4c99-9f34-551de6b32c1d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:01.751437 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c04348-749d-49cb-81ec-3155da51ee82 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:01.803994 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52a731-6f25-4c6e-8817-ffce0e29ba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:01.803994 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52a731-6f25-4c6e-8817-ffce0e29ba68 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:01.803994 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52a731-6f25-4c6e-8817-ffce0e29ba68 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:01.803994 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52a731-6f25-4c6e-8817-ffce0e29ba68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:01.815648 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4aeaf-fcce-4879-b730-4a177b5cce1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:01.817420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4aeaf-fcce-4879-b730-4a177b5cce1c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:01.818059 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4aeaf-fcce-4879-b730-4a177b5cce1c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:01.818659 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4aeaf-fcce-4879-b730-4a177b5cce1c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:01.826065 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52a731-6f25-4c6e-8817-ffce0e29ba68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:01.839519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-fc52a731-6f25-4c6e-8817-ffce0e29ba68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:01.839519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:01.839519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:01.839519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:01.839519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:01.839519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:01.839519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:01.839519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:01.839519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:01.839519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:01.839519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:01.839519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:01.839519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:01.839519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:01.839519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:01.839519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:01.841530 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:01.841530 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:01.841530 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:01.841530 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:01.841530 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:01.841530 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:01.841530 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:01.841530 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:01.841530 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:01.841530 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:01.841530 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:01.841530 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:01.841530 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:01.841530 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:01.841530 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:01.841530 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:01.844033 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:01.844033 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:01.844033 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:01.844033 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:01.844033 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:01.844033 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:01.844033 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:01.844033 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:01.844033 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:01.844033 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:01.844033 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:01.844033 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:01.849031 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 50/107] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:01.850769 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52a731-6f25-4c6e-8817-ffce0e29ba68 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:01.855479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4aeaf-fcce-4879-b730-4a177b5cce1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:01.876302 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a3c4aeaf-fcce-4879-b730-4a177b5cce1c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:41:01.876302 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:01.876302 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:01.876302 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:01.876302 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:01.876302 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:01.876302 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:01.876302 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:01.876302 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:01.876302 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:01.876302 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:01.876302 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:01.876302 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:01.876302 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:01.876302 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:01.876302 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:01.878664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:01.878664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:01.878664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:01.878664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:01.878664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:01.878664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:01.878664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:01.878664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:01.878664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:01.878664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:01.878664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:01.878664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:01.878664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:01.878664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:01.878664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:01.878664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:01.889560 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:01.889560 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:01.889560 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:01.889560 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:01.889560 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:01.889560 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:01.889560 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:01.889560 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:01.889560 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:01.889560 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:01.889560 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:41:01.889560 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:01.889560 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 58/108] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 517 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:01.889560 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4aeaf-fcce-4879-b730-4a177b5cce1c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:02.017769 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:02.037722 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:02.058321 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52a731-6f25-4c6e-8817-ffce0e29ba68 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:02.119333 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4aeaf-fcce-4879-b730-4a177b5cce1c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:02.122139 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f788c-9a74-44a7-9a85-ce2253224900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:02.123524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f788c-9a74-44a7-9a85-ce2253224900 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:02.124127 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f788c-9a74-44a7-9a85-ce2253224900 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:02.125702 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f788c-9a74-44a7-9a85-ce2253224900 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:02.127416 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f788c-9a74-44a7-9a85-ce2253224900 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:02.130512 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f788c-9a74-44a7-9a85-ce2253224900 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:02.169631 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6d8f1-7339-433c-83f8-8994c3c3a702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:02.170674 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6d8f1-7339-433c-83f8-8994c3c3a702 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:02.171183 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6d8f1-7339-433c-83f8-8994c3c3a702 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:02.171678 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6d8f1-7339-433c-83f8-8994c3c3a702 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:02.190082 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6d8f1-7339-433c-83f8-8994c3c3a702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:02.191393 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 51/109] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Oct 2 00:41:01 2022] POST /identity/v3/projects => generated 302 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:41:02.193267 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f788c-9a74-44a7-9a85-ce2253224900 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:02.196512 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-eac6d8f1-7339-433c-83f8-8994c3c3a702 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:41:02.196512 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:02.196512 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:02.196512 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:02.196512 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:02.196512 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:02.196512 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:02.196512 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:02.196512 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:02.196512 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:02.196512 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:02.196512 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:02.196512 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:02.196512 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:02.196512 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:02.196512 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:02.197506 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:02.197506 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:02.197506 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:02.197506 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:02.197506 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:02.197506 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:02.197506 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:02.197506 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:02.197506 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:02.197506 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:02.197506 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:02.197506 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:02.197506 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:02.197506 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:02.197506 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:02.197506 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:02.198383 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:02.198383 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:02.198383 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:02.198383 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:02.198383 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:02.198383 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:02.198383 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:02.198383 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:02.198383 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:02.198383 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:02.198383 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:41:02.198383 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:02.201468 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 59/110] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:41:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:02.203581 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6d8f1-7339-433c-83f8-8994c3c3a702 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:02.381830 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6d8f1-7339-433c-83f8-8994c3c3a702 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:02.442125 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:02.447145 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f788c-9a74-44a7-9a85-ce2253224900 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:02.482258 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41ccc7-f269-4e6c-bda0-ec35dfc79f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:02.482922 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41ccc7-f269-4e6c-bda0-ec35dfc79f24 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:02.483355 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41ccc7-f269-4e6c-bda0-ec35dfc79f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:02.484423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41ccc7-f269-4e6c-bda0-ec35dfc79f24 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:02.485757 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41ccc7-f269-4e6c-bda0-ec35dfc79f24 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:02.486244 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41ccc7-f269-4e6c-bda0-ec35dfc79f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:02.488144 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41ccc7-f269-4e6c-bda0-ec35dfc79f24 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:02.512297 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:02.513461 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 60/111] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:02.516119 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41ccc7-f269-4e6c-bda0-ec35dfc79f24 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:02.535109 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd196c47-22d6-4c96-b5ba-dd4f78d71563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:02.536643 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd196c47-22d6-4c96-b5ba-dd4f78d71563 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:02.537455 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd196c47-22d6-4c96-b5ba-dd4f78d71563 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:02.538217 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd196c47-22d6-4c96-b5ba-dd4f78d71563 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:02.539763 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd196c47-22d6-4c96-b5ba-dd4f78d71563 None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:02.540675 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd196c47-22d6-4c96-b5ba-dd4f78d71563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:02.543791 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd196c47-22d6-4c96-b5ba-dd4f78d71563 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:02.562098 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 52/112] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:02.564384 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd196c47-22d6-4c96-b5ba-dd4f78d71563 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:02.767651 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41ccc7-f269-4e6c-bda0-ec35dfc79f24 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:02.789735 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd196c47-22d6-4c96-b5ba-dd4f78d71563 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:02.838491 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399993de-6c74-48bd-bb45-3c62c6e7d785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:02.838766 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399993de-6c74-48bd-bb45-3c62c6e7d785 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:02.840649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399993de-6c74-48bd-bb45-3c62c6e7d785 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:02.840649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399993de-6c74-48bd-bb45-3c62c6e7d785 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:02.840649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399993de-6c74-48bd-bb45-3c62c6e7d785 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:02.840649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399993de-6c74-48bd-bb45-3c62c6e7d785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:02.842042 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399993de-6c74-48bd-bb45-3c62c6e7d785 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:02.860110 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 61/113] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:02.861425 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399993de-6c74-48bd-bb45-3c62c6e7d785 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:02.881781 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009ec83-c03d-4166-9a3c-160c008e6956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:02.882905 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009ec83-c03d-4166-9a3c-160c008e6956 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:02.883416 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009ec83-c03d-4166-9a3c-160c008e6956 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:02.883919 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009ec83-c03d-4166-9a3c-160c008e6956 None admin] PATH_INFO: `/v3/users/e013388eae9240d8862d41588da80d94` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:02.918684 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009ec83-c03d-4166-9a3c-160c008e6956 None admin] RBAC: Authorizing `identity:get_user(user_id=e013388eae9240d8862d41588da80d94)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:02.922849 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009ec83-c03d-4166-9a3c-160c008e6956 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:02.927231 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 53/114] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:02 2022] GET /identity/v3/users/e013388eae9240d8862d41588da80d94 => generated 289 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:02.930695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea742bdd-42b8-45c7-bde6-7b891e4020da None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:02.931507 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea742bdd-42b8-45c7-bde6-7b891e4020da None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:02.932234 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea742bdd-42b8-45c7-bde6-7b891e4020da None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:02.935314 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 54/115] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:02.937812 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea742bdd-42b8-45c7-bde6-7b891e4020da None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:02.985458 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:03.050642 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:03.085100 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399993de-6c74-48bd-bb45-3c62c6e7d785 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:03.147006 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef518f-f11f-412e-ae1b-090938877b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:03.148074 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef518f-f11f-412e-ae1b-090938877b30 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:03.148556 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef518f-f11f-412e-ae1b-090938877b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:03.149072 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef518f-f11f-412e-ae1b-090938877b30 None admin] PATH_INFO: `/v3/users/69f4406ff16447f8af2cb9634cbd3cc6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:03.149829 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea742bdd-42b8-45c7-bde6-7b891e4020da None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:03.151037 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef518f-f11f-412e-ae1b-090938877b30 None admin] RBAC: Authorizing `identity:get_user(user_id=69f4406ff16447f8af2cb9634cbd3cc6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:03.153822 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef518f-f11f-412e-ae1b-090938877b30 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:03.165123 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 62/116] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:02 2022] GET /identity/v3/users/69f4406ff16447f8af2cb9634cbd3cc6 => generated 275 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:03.167476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b54f79-12d3-47cb-a2c6-b69c83e9f324 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:03.167969 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b54f79-12d3-47cb-a2c6-b69c83e9f324 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:03.168440 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b54f79-12d3-47cb-a2c6-b69c83e9f324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:03.199900 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-42b54f79-12d3-47cb-a2c6-b69c83e9f324 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:03.201670 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-42b54f79-12d3-47cb-a2c6-b69c83e9f324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:03.231384 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82171bf2-9163-426a-94e0-d0d5bdfa1fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:03.232653 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82171bf2-9163-426a-94e0-d0d5bdfa1fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:03.233201 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82171bf2-9163-426a-94e0-d0d5bdfa1fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:03.234250 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82171bf2-9163-426a-94e0-d0d5bdfa1fb3 None admin] PATH_INFO: `/v3/users/1ae9e9d2d4e74a049733205286b14514` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:03.236374 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82171bf2-9163-426a-94e0-d0d5bdfa1fb3 None admin] RBAC: Authorizing `identity:get_user(user_id=1ae9e9d2d4e74a049733205286b14514)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:03.239452 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82171bf2-9163-426a-94e0-d0d5bdfa1fb3 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:03.243062 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 55/117] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:02 2022] GET /identity/v3/users/1ae9e9d2d4e74a049733205286b14514 => generated 247 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:03.244144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82171bf2-9163-426a-94e0-d0d5bdfa1fb3 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:03.311135 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 63/118] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:03.329161 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10127ccb-3069-4900-873c-8cb27e409d96 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:03.329161 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10127ccb-3069-4900-873c-8cb27e409d96 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:03.329161 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10127ccb-3069-4900-873c-8cb27e409d96 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:03.329161 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 64/119] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:03 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:03.329161 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10127ccb-3069-4900-873c-8cb27e409d96 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:03.388321 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:03.453030 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82171bf2-9163-426a-94e0-d0d5bdfa1fb3 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:03.474488 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:03.496490 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d83e81-5d86-42c0-89c2-30c90706f5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:03.497392 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d83e81-5d86-42c0-89c2-30c90706f5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:03.497919 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10127ccb-3069-4900-873c-8cb27e409d96 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:03.498037 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d83e81-5d86-42c0-89c2-30c90706f5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:03.498436 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d83e81-5d86-42c0-89c2-30c90706f5e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:03.564105 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6e8dd-e7f2-4532-8904-35aa98ea656f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:03.565206 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6e8dd-e7f2-4532-8904-35aa98ea656f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:03.565697 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6e8dd-e7f2-4532-8904-35aa98ea656f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:03.566179 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6e8dd-e7f2-4532-8904-35aa98ea656f None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:03.568237 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6e8dd-e7f2-4532-8904-35aa98ea656f None admin] RBAC: Authorizing `identity:get_project(project_id=141aed90ccfe453283d0e7fd34fb461d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:03.571227 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6e8dd-e7f2-4532-8904-35aa98ea656f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:03.574407 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 65/120] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:03 2022] GET /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:03.581380 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6e8dd-e7f2-4532-8904-35aa98ea656f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:03.584852 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d83e81-5d86-42c0-89c2-30c90706f5e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:03.586563 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d83e81-5d86-42c0-89c2-30c90706f5e0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:03.713405 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 56/121] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:41:03.716015 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03193b00-a67f-4e76-82cb-eef4ceab9b6b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:03.716527 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03193b00-a67f-4e76-82cb-eef4ceab9b6b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:03.717058 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03193b00-a67f-4e76-82cb-eef4ceab9b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:03.735830 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6e8dd-e7f2-4532-8904-35aa98ea656f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:03.742706 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-03193b00-a67f-4e76-82cb-eef4ceab9b6b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:03.744200 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-03193b00-a67f-4e76-82cb-eef4ceab9b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:03.752011 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:03.757803 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:03.784460 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4632d-74a9-4853-9b71-8994f5802d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:03.785505 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4632d-74a9-4853-9b71-8994f5802d5d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:03.785955 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4632d-74a9-4853-9b71-8994f5802d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:03.786349 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4632d-74a9-4853-9b71-8994f5802d5d None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:03.787793 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4632d-74a9-4853-9b71-8994f5802d5d None admin] RBAC: Authorizing `identity:get_project(project_id=141aed90ccfe453283d0e7fd34fb461d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:03.790003 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4632d-74a9-4853-9b71-8994f5802d5d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:03.797162 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 66/122] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:03 2022] GET /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:03.797162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4632d-74a9-4853-9b71-8994f5802d5d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:03.839331 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 57/123] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:03.846043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03193b00-a67f-4e76-82cb-eef4ceab9b6b None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:03.944612 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4632d-74a9-4853-9b71-8994f5802d5d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:03.988924 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e8926-5a3d-4178-bdea-d586c0974d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:03.989915 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e8926-5a3d-4178-bdea-d586c0974d3a None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:03.990378 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e8926-5a3d-4178-bdea-d586c0974d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:03.990858 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e8926-5a3d-4178-bdea-d586c0974d3a None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d/users/69f4406ff16447f8af2cb9634cbd3cc6/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:03.993726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e8926-5a3d-4178-bdea-d586c0974d3a None admin] RBAC: Authorizing `identity:create_grant(project_id=141aed90ccfe453283d0e7fd34fb461d, user_id=69f4406ff16447f8af2cb9634cbd3cc6, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:03.995410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e8926-5a3d-4178-bdea-d586c0974d3a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:04.018005 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 67/124] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:41:03 2022] PUT /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d/users/69f4406ff16447f8af2cb9634cbd3cc6/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:41:04.024706 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e8926-5a3d-4178-bdea-d586c0974d3a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:04.063341 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03193b00-a67f-4e76-82cb-eef4ceab9b6b None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:04.094777 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:04.181903 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e8926-5a3d-4178-bdea-d586c0974d3a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:04.215097 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c4d2e-927c-4578-ae7c-a128c87e7979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:04.216211 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c4d2e-927c-4578-ae7c-a128c87e7979 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:04.216712 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c4d2e-927c-4578-ae7c-a128c87e7979 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:04.217336 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c4d2e-927c-4578-ae7c-a128c87e7979 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:04.231208 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39305b2-ea05-4102-be1f-0973cc190ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:04.232211 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39305b2-ea05-4102-be1f-0973cc190ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:04.232680 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39305b2-ea05-4102-be1f-0973cc190ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:04.233192 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39305b2-ea05-4102-be1f-0973cc190ad6 None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:04.236201 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39305b2-ea05-4102-be1f-0973cc190ad6 None admin] RBAC: Authorizing `identity:get_project(project_id=141aed90ccfe453283d0e7fd34fb461d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:04.237988 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39305b2-ea05-4102-be1f-0973cc190ad6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:04.240259 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 68/125] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:04 2022] GET /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:04.241298 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39305b2-ea05-4102-be1f-0973cc190ad6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:04.269947 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c4d2e-927c-4578-ae7c-a128c87e7979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:04.283638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-c53c4d2e-927c-4578-ae7c-a128c87e7979 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:04.283638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:04.283638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:04.283638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:04.283638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:04.283638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:04.283638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:04.283638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:04.283638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:04.283638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:04.283638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:04.283638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:04.283638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:04.283638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:04.283638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:04.283638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:04.284569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:04.284569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:04.284569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:04.284569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:04.284569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:04.284569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:04.284569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:04.284569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:04.284569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:04.284569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:04.284569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:04.284569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:04.284569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:04.284569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:04.284569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:04.284569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:04.285375 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:04.285375 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:04.285375 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:04.285375 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:04.285375 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:04.285375 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:04.285375 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:04.285375 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:04.285375 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:04.285375 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:04.285375 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:04.285375 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:04.285953 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 58/126] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:41:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:04.287696 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c4d2e-927c-4578-ae7c-a128c87e7979 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:04.304399 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:04.404276 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39305b2-ea05-4102-be1f-0973cc190ad6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:04.427721 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:04.469690 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c4d2e-927c-4578-ae7c-a128c87e7979 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:04.477036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2912de-8b44-4098-9726-f00eee5b5759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:04.478031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2912de-8b44-4098-9726-f00eee5b5759 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:04.478522 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2912de-8b44-4098-9726-f00eee5b5759 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:04.479000 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2912de-8b44-4098-9726-f00eee5b5759 None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d/users/1ae9e9d2d4e74a049733205286b14514/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:04.481232 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2912de-8b44-4098-9726-f00eee5b5759 None admin] RBAC: Authorizing `identity:create_grant(project_id=141aed90ccfe453283d0e7fd34fb461d, user_id=1ae9e9d2d4e74a049733205286b14514, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:04.482931 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2912de-8b44-4098-9726-f00eee5b5759 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:04.502644 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 69/127] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:41:04 2022] PUT /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d/users/1ae9e9d2d4e74a049733205286b14514/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:41:04.504046 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2912de-8b44-4098-9726-f00eee5b5759 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:04.558327 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6292d-3dd5-4508-b412-7ec9fd96e9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:04.559333 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6292d-3dd5-4508-b412-7ec9fd96e9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:04.563167 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6292d-3dd5-4508-b412-7ec9fd96e9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:04.563780 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6292d-3dd5-4508-b412-7ec9fd96e9d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:04.564790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6292d-3dd5-4508-b412-7ec9fd96e9d1 None admin] RBAC: Adding query filter params (role.id=f3bcf4f4f01e4fe98ec388ccb5daf537, scope.project.id=141aed90ccfe453283d0e7fd34fb461d, user.id=e013388eae9240d8862d41588da80d94) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:04.565515 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6292d-3dd5-4508-b412-7ec9fd96e9d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:04.567302 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6292d-3dd5-4508-b412-7ec9fd96e9d1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:04.582775 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 59/128] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:41:04 2022] GET /identity/v3/role_assignments?user.id=e013388eae9240d8862d41588da80d94&scope.project.id=141aed90ccfe453283d0e7fd34fb461d&role.id=f3bcf4f4f01e4fe98ec388ccb5daf537 => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:04.584818 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6292d-3dd5-4508-b412-7ec9fd96e9d1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:04.771416 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2912de-8b44-4098-9726-f00eee5b5759 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:04.795139 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:04.848017 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa66021-4951-4371-bcfc-ce47235035d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:04.849917 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa66021-4951-4371-bcfc-ce47235035d1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:04.850468 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa66021-4951-4371-bcfc-ce47235035d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:04.850951 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa66021-4951-4371-bcfc-ce47235035d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:04.852565 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa66021-4951-4371-bcfc-ce47235035d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:04.853247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa66021-4951-4371-bcfc-ce47235035d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:04.855787 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa66021-4951-4371-bcfc-ce47235035d1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:04.863055 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6292d-3dd5-4508-b412-7ec9fd96e9d1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:04.876971 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 70/129] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:41:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:04.880584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa66021-4951-4371-bcfc-ce47235035d1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:04.935980 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90fbbf-a0ea-4ab4-9136-01bca14ca258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:04.937674 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90fbbf-a0ea-4ab4-9136-01bca14ca258 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:04.938178 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90fbbf-a0ea-4ab4-9136-01bca14ca258 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:04.938679 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90fbbf-a0ea-4ab4-9136-01bca14ca258 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:04.947505 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:04.967022 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90fbbf-a0ea-4ab4-9136-01bca14ca258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:04.976967 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-fa90fbbf-a0ea-4ab4-9136-01bca14ca258 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:04.976967 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:04.976967 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:04.976967 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:04.976967 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:04.976967 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:04.976967 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:04.976967 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:04.976967 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:04.976967 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:04.976967 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:04.976967 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:04.976967 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:04.976967 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:04.976967 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:04.976967 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:04.977943 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:04.977943 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:04.977943 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:04.977943 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:04.977943 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:04.977943 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:04.977943 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:04.977943 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:04.977943 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:04.977943 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:04.977943 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:04.977943 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:04.977943 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:04.977943 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:04.977943 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:04.977943 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:04.978736 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:04.978736 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:04.978736 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:04.978736 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:04.978736 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:04.978736 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:04.978736 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:04.978736 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:04.978736 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:04.978736 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:04.978736 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:04.978736 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:04.981513 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 60/130] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:04.990348 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90fbbf-a0ea-4ab4-9136-01bca14ca258 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:05.139541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa66021-4951-4371-bcfc-ce47235035d1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:05.242733 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3508ba-0568-460f-bf35-1e16c7ca417f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:05.243771 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3508ba-0568-460f-bf35-1e16c7ca417f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:05.244283 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3508ba-0568-460f-bf35-1e16c7ca417f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:05.244774 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3508ba-0568-460f-bf35-1e16c7ca417f None admin] PATH_INFO: `/v3/users/69f4406ff16447f8af2cb9634cbd3cc6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:05.249806 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3508ba-0568-460f-bf35-1e16c7ca417f None admin] RBAC: Authorizing `identity:get_user(user_id=69f4406ff16447f8af2cb9634cbd3cc6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:05.251614 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3508ba-0568-460f-bf35-1e16c7ca417f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:05.253593 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 71/131] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:04 2022] GET /identity/v3/users/69f4406ff16447f8af2cb9634cbd3cc6 => generated 275 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:05.257343 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90fbbf-a0ea-4ab4-9136-01bca14ca258 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:05.262412 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3508ba-0568-460f-bf35-1e16c7ca417f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:05.329465 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:05.337895 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecfb43-0362-46fc-a9c9-1fc85cb70377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:05.339032 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecfb43-0362-46fc-a9c9-1fc85cb70377 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:05.339621 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecfb43-0362-46fc-a9c9-1fc85cb70377 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:05.340109 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecfb43-0362-46fc-a9c9-1fc85cb70377 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:05.346456 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecfb43-0362-46fc-a9c9-1fc85cb70377 None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:05.347003 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecfb43-0362-46fc-a9c9-1fc85cb70377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:05.349741 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecfb43-0362-46fc-a9c9-1fc85cb70377 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:05.365903 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 61/132] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:05.376457 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecfb43-0362-46fc-a9c9-1fc85cb70377 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:05.635467 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:05.657248 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3508ba-0568-460f-bf35-1e16c7ca417f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:05.667636 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecfb43-0362-46fc-a9c9-1fc85cb70377 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:05.746888 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a7ebc-d277-4580-a033-c747703f0ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:05.748406 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a7ebc-d277-4580-a033-c747703f0ebc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:05.748961 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a7ebc-d277-4580-a033-c747703f0ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:05.750073 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a7ebc-d277-4580-a033-c747703f0ebc None admin] PATH_INFO: `/v3/users/69f4406ff16447f8af2cb9634cbd3cc6` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:05.752296 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a7ebc-d277-4580-a033-c747703f0ebc None admin] RBAC: Authorizing `identity:get_user(user_id=69f4406ff16447f8af2cb9634cbd3cc6)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:05.756188 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a7ebc-d277-4580-a033-c747703f0ebc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:05.759313 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 62/133] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:05 2022] GET /identity/v3/users/69f4406ff16447f8af2cb9634cbd3cc6 => generated 275 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:05.768441 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a7ebc-d277-4580-a033-c747703f0ebc None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:05.811397 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a965cc-c3a3-40c1-b23f-2c550f2d6a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:05.812968 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a965cc-c3a3-40c1-b23f-2c550f2d6a83 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:05.821759 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a965cc-c3a3-40c1-b23f-2c550f2d6a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:05.822231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a965cc-c3a3-40c1-b23f-2c550f2d6a83 None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:05.824332 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a965cc-c3a3-40c1-b23f-2c550f2d6a83 None admin] RBAC: Authorizing `identity:get_project(project_id=141aed90ccfe453283d0e7fd34fb461d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:05.827004 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a965cc-c3a3-40c1-b23f-2c550f2d6a83 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:05.830517 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 72/134] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:05 2022] GET /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d => generated 298 bytes in 568 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:05.850290 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a965cc-c3a3-40c1-b23f-2c550f2d6a83 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:05.925355 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:06.008239 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a7ebc-d277-4580-a033-c747703f0ebc None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:06.131946 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf4651-17cb-4008-8e4b-0769d74d55f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:06.133009 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf4651-17cb-4008-8e4b-0769d74d55f4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:06.133503 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf4651-17cb-4008-8e4b-0769d74d55f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:06.135538 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf4651-17cb-4008-8e4b-0769d74d55f4 None admin] PATH_INFO: `/v3/projects/740d73709b4a456eaab8690820d13676` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:06.137691 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf4651-17cb-4008-8e4b-0769d74d55f4 None admin] RBAC: Authorizing `identity:get_project(project_id=740d73709b4a456eaab8690820d13676)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:06.142396 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf4651-17cb-4008-8e4b-0769d74d55f4 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:06.148981 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 63/135] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:05 2022] GET /identity/v3/projects/740d73709b4a456eaab8690820d13676 => generated 312 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:06.154768 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3944678-ce8a-47df-a2dc-e109f8f337b0 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:06.155311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3944678-ce8a-47df-a2dc-e109f8f337b0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:06.156053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3944678-ce8a-47df-a2dc-e109f8f337b0 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:06.159135 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 64/136] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:06.160506 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3944678-ce8a-47df-a2dc-e109f8f337b0 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:06.201075 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a965cc-c3a3-40c1-b23f-2c550f2d6a83 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:06.275651 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f6452-0c7f-40af-ae33-db9fa5ba9552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:06.276806 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f6452-0c7f-40af-ae33-db9fa5ba9552 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:06.277348 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f6452-0c7f-40af-ae33-db9fa5ba9552 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:06.277830 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f6452-0c7f-40af-ae33-db9fa5ba9552 None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d/users/69f4406ff16447f8af2cb9634cbd3cc6/roles/030fcd169fb44f759772ef3101c07012` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:06.282924 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f6452-0c7f-40af-ae33-db9fa5ba9552 None admin] RBAC: Authorizing `identity:create_grant(project_id=141aed90ccfe453283d0e7fd34fb461d, user_id=69f4406ff16447f8af2cb9634cbd3cc6, role_id=030fcd169fb44f759772ef3101c07012)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:06.285898 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f6452-0c7f-40af-ae33-db9fa5ba9552 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:06.319948 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 73/137] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:41:05 2022] PUT /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d/users/69f4406ff16447f8af2cb9634cbd3cc6/roles/030fcd169fb44f759772ef3101c07012 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:41:06.322702 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101e823-76d9-4443-a411-8d3b7bd12bd9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:06.323205 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101e823-76d9-4443-a411-8d3b7bd12bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:06.323655 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101e823-76d9-4443-a411-8d3b7bd12bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:06.384008 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c101e823-76d9-4443-a411-8d3b7bd12bd9 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:06.385400 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c101e823-76d9-4443-a411-8d3b7bd12bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:06.412785 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:06.458203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3944678-ce8a-47df-a2dc-e109f8f337b0 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:06.477153 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 74/138] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:06.513614 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:06.541015 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cdfd2-16f0-4cbd-91f8-d8eb6e149ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:06.542661 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cdfd2-16f0-4cbd-91f8-d8eb6e149ee5 None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:06.543444 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cdfd2-16f0-4cbd-91f8-d8eb6e149ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:06.544244 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cdfd2-16f0-4cbd-91f8-d8eb6e149ee5 None admin] PATH_INFO: `/v3/projects/740d73709b4a456eaab8690820d13676/users/69f4406ff16447f8af2cb9634cbd3cc6/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:06.553145 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cdfd2-16f0-4cbd-91f8-d8eb6e149ee5 None admin] RBAC: Authorizing `identity:create_grant(project_id=740d73709b4a456eaab8690820d13676, user_id=69f4406ff16447f8af2cb9634cbd3cc6, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:06.556352 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cdfd2-16f0-4cbd-91f8-d8eb6e149ee5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:06.593395 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 65/139] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:41:06 2022] PUT /identity/v3/projects/740d73709b4a456eaab8690820d13676/users/69f4406ff16447f8af2cb9634cbd3cc6/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:41:07.128413 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101e823-76d9-4443-a411-8d3b7bd12bd9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:07.333949 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101e823-76d9-4443-a411-8d3b7bd12bd9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:07.401934 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169ac35-589c-48c6-9d56-925d5986b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:07.403527 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169ac35-589c-48c6-9d56-925d5986b34b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:07.404250 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169ac35-589c-48c6-9d56-925d5986b34b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:07.404901 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169ac35-589c-48c6-9d56-925d5986b34b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:07.407939 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169ac35-589c-48c6-9d56-925d5986b34b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:07.410838 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169ac35-589c-48c6-9d56-925d5986b34b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:07.414305 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 75/140] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:41:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:07.427306 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cdfd2-16f0-4cbd-91f8-d8eb6e149ee5 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:07.627551 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cdfd2-16f0-4cbd-91f8-d8eb6e149ee5 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:07.677839 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3add74-7e19-4ba2-9b3d-bbff9a5ceb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:07.678375 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3add74-7e19-4ba2-9b3d-bbff9a5ceb44 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:07.678665 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3add74-7e19-4ba2-9b3d-bbff9a5ceb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:07.678943 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3add74-7e19-4ba2-9b3d-bbff9a5ceb44 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:07.679637 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3add74-7e19-4ba2-9b3d-bbff9a5ceb44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:07.681260 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3add74-7e19-4ba2-9b3d-bbff9a5ceb44 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:07.724305 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 66/141] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Oct 2 00:41:07 2022] POST /identity/v3/users => generated 283 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:41:08.039790 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50b597-8ba2-4e14-b7a5-65f0bccf665c None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:08.040188 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50b597-8ba2-4e14-b7a5-65f0bccf665c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:08.040659 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50b597-8ba2-4e14-b7a5-65f0bccf665c None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:08.043496 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 76/142] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:08.053110 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929b7f2-83f2-4178-90f2-a4d5d53bf0e6 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:08.054079 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929b7f2-83f2-4178-90f2-a4d5d53bf0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:08.054972 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929b7f2-83f2-4178-90f2-a4d5d53bf0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:08.098454 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-9929b7f2-83f2-4178-90f2-a4d5d53bf0e6 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:08.101323 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9929b7f2-83f2-4178-90f2-a4d5d53bf0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:08.203814 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:08.267376 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 67/143] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:08.485453 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750959d-6c58-42a9-a6d4-84c2afc58bb8 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:08.486973 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750959d-6c58-42a9-a6d4-84c2afc58bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:08.487731 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750959d-6c58-42a9-a6d4-84c2afc58bb8 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:08.490568 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 77/144] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:08.496461 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4e56b-05cb-4a9e-8c1a-882a15f99bea None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:08.497268 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4e56b-05cb-4a9e-8c1a-882a15f99bea None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:08.497268 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4e56b-05cb-4a9e-8c1a-882a15f99bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:08.522791 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ade4e56b-05cb-4a9e-8c1a-882a15f99bea None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:08.524018 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ade4e56b-05cb-4a9e-8c1a-882a15f99bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:08.617053 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 68/145] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:41:08.685540 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe58f36-a985-4311-8e44-e19f7c30ec24 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:08.687020 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe58f36-a985-4311-8e44-e19f7c30ec24 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:08.687782 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe58f36-a985-4311-8e44-e19f7c30ec24 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:08.690686 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 78/146] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:08.703201 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301536eb-3330-4adc-85b4-67f5a6f2b1ae None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:08.704148 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301536eb-3330-4adc-85b4-67f5a6f2b1ae None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:08.704887 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301536eb-3330-4adc-85b4-67f5a6f2b1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:08.741756 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-301536eb-3330-4adc-85b4-67f5a6f2b1ae None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:08.744392 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-301536eb-3330-4adc-85b4-67f5a6f2b1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:08.893672 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 69/147] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:08.935209 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe58f36-a985-4311-8e44-e19f7c30ec24 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:08.994852 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:09.116468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301536eb-3330-4adc-85b4-67f5a6f2b1ae None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:09.179748 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe58f36-a985-4311-8e44-e19f7c30ec24 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:09.232433 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:09.306546 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaddbd2-e5df-4694-9a23-30a04dff7815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:09.307529 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaddbd2-e5df-4694-9a23-30a04dff7815 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:09.308213 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaddbd2-e5df-4694-9a23-30a04dff7815 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:09.308709 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaddbd2-e5df-4694-9a23-30a04dff7815 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:09.339268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaddbd2-e5df-4694-9a23-30a04dff7815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:09.356649 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ccaddbd2-e5df-4694-9a23-30a04dff7815 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:41:09.356649 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:09.356649 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:09.356649 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:09.356649 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:09.356649 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:09.356649 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:09.356649 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:09.356649 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:09.356649 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:09.356649 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:09.356649 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:09.356649 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:09.356649 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:09.356649 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:09.356649 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:09.358200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:09.358200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:09.358200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:09.358200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:09.358200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:09.358200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:09.358200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:09.358200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:09.358200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:09.358200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:09.358200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:09.358200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:09.358200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:09.358200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:09.358200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:09.358200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:09.359435 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:09.359435 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:09.359435 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:09.359435 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:09.359435 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:09.359435 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:09.359435 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:09.359435 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:09.359435 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:09.359435 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:09.359435 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:41:09.359435 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:09.359435 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 79/148] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:41:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:09.367167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaddbd2-e5df-4694-9a23-30a04dff7815 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:09.426990 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301536eb-3330-4adc-85b4-67f5a6f2b1ae None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:09.526349 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af716f-edeb-4da5-8019-55305f0e8218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:09.527326 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af716f-edeb-4da5-8019-55305f0e8218 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:09.527326 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af716f-edeb-4da5-8019-55305f0e8218 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:09.527606 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af716f-edeb-4da5-8019-55305f0e8218 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:09.569769 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af716f-edeb-4da5-8019-55305f0e8218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:09.574804 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-49af716f-edeb-4da5-8019-55305f0e8218 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:41:09.574804 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:09.574804 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:09.574804 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:09.574804 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:09.574804 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:09.574804 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:09.574804 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:09.574804 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:09.574804 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:09.574804 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:09.574804 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:09.574804 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:09.574804 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:09.574804 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:09.574804 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:09.576461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:09.576461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:09.576461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:09.576461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:09.576461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:09.576461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:09.576461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:09.576461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:09.576461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:09.576461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:09.576461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:09.576461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:09.576461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:09.576461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:09.576461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:09.576461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:09.579606 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:09.579606 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:09.579606 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:09.579606 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:09.579606 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:09.579606 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:09.579606 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:09.579606 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:09.579606 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:09.579606 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:09.579606 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:41:09.579606 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:09.579606 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 70/149] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 461 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:09.586379 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af716f-edeb-4da5-8019-55305f0e8218 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:09.606784 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:09.638341 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaddbd2-e5df-4694-9a23-30a04dff7815 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:09.730893 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afd59d-58c0-4a96-be7b-7f2fb39244c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:09.731909 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afd59d-58c0-4a96-be7b-7f2fb39244c4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:09.732419 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afd59d-58c0-4a96-be7b-7f2fb39244c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:09.732911 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afd59d-58c0-4a96-be7b-7f2fb39244c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:09.734848 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afd59d-58c0-4a96-be7b-7f2fb39244c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:09.735482 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afd59d-58c0-4a96-be7b-7f2fb39244c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:09.738253 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afd59d-58c0-4a96-be7b-7f2fb39244c4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:09.760913 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 80/150] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:09.778270 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afd59d-58c0-4a96-be7b-7f2fb39244c4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:09.805355 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:09.811003 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af716f-edeb-4da5-8019-55305f0e8218 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:09.872428 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d8c90-49e0-4dd6-9f11-53261af32fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:09.873001 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d8c90-49e0-4dd6-9f11-53261af32fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:09.873436 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d8c90-49e0-4dd6-9f11-53261af32fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:09.873662 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d8c90-49e0-4dd6-9f11-53261af32fc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:09.874842 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d8c90-49e0-4dd6-9f11-53261af32fc2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:09.875144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d8c90-49e0-4dd6-9f11-53261af32fc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:09.876648 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d8c90-49e0-4dd6-9f11-53261af32fc2 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:09.893266 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 71/151] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:09.899080 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d8c90-49e0-4dd6-9f11-53261af32fc2 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:10.018716 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afd59d-58c0-4a96-be7b-7f2fb39244c4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:10.086946 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68508d5-cbe5-4041-90d6-079701946ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:10.088126 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68508d5-cbe5-4041-90d6-079701946ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:10.088639 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68508d5-cbe5-4041-90d6-079701946ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:10.089145 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68508d5-cbe5-4041-90d6-079701946ed8 None admin] PATH_INFO: `/v3/users/1ae9e9d2d4e74a049733205286b14514` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:10.091306 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68508d5-cbe5-4041-90d6-079701946ed8 None admin] RBAC: Authorizing `identity:get_user(user_id=1ae9e9d2d4e74a049733205286b14514)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:10.094548 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68508d5-cbe5-4041-90d6-079701946ed8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:10.098009 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 81/152] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:09 2022] GET /identity/v3/users/1ae9e9d2d4e74a049733205286b14514 => generated 247 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:10.099578 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68508d5-cbe5-4041-90d6-079701946ed8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:10.157716 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:10.211081 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d8c90-49e0-4dd6-9f11-53261af32fc2 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:10.300774 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68508d5-cbe5-4041-90d6-079701946ed8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:10.333739 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f4f62-7d62-46c0-b82a-84668fa119c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:10.334415 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f4f62-7d62-46c0-b82a-84668fa119c1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:10.334700 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f4f62-7d62-46c0-b82a-84668fa119c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:10.334979 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f4f62-7d62-46c0-b82a-84668fa119c1 None admin] PATH_INFO: `/v3/users/e013388eae9240d8862d41588da80d94` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:10.341844 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f4f62-7d62-46c0-b82a-84668fa119c1 None admin] RBAC: Authorizing `identity:get_user(user_id=e013388eae9240d8862d41588da80d94)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:10.344088 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f4f62-7d62-46c0-b82a-84668fa119c1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:10.346247 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 72/153] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:09 2022] GET /identity/v3/users/e013388eae9240d8862d41588da80d94 => generated 289 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:10.347081 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f4f62-7d62-46c0-b82a-84668fa119c1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:10.414375 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:10.419570 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc876e-308d-4eae-a5ea-8c9687878eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:10.420255 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc876e-308d-4eae-a5ea-8c9687878eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:10.420554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc876e-308d-4eae-a5ea-8c9687878eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:10.420873 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc876e-308d-4eae-a5ea-8c9687878eb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:10.444194 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc876e-308d-4eae-a5ea-8c9687878eb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:10.449408 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4ddc876e-308d-4eae-a5ea-8c9687878eb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:10.449408 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:10.449408 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:10.449408 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:10.449408 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:10.449408 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:10.449408 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:10.449408 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:10.449408 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:10.449408 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:10.449408 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:10.449408 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:10.449408 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:10.449408 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:10.449408 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:10.449408 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:10.451014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:10.451014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:10.451014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:10.451014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:10.451014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:10.451014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:10.451014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:10.451014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:10.451014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:10.451014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:10.451014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:10.451014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:10.451014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:10.451014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:10.451014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:10.451014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:10.452753 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:10.452753 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:10.452753 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:10.452753 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:10.452753 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:10.452753 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:10.452753 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:10.452753 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:10.452753 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:10.452753 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:10.452753 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:10.452753 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:10.457497 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 82/154] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:10.458665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc876e-308d-4eae-a5ea-8c9687878eb1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:10.552173 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f4f62-7d62-46c0-b82a-84668fa119c1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:10.595408 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157eb873-f400-4192-aa25-5e7bb5f628ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:10.596049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eb873-f400-4192-aa25-5e7bb5f628ad None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:10.596341 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eb873-f400-4192-aa25-5e7bb5f628ad None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:10.596604 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eb873-f400-4192-aa25-5e7bb5f628ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:10.669075 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:10.680474 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157eb873-f400-4192-aa25-5e7bb5f628ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:10.682024 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157eb873-f400-4192-aa25-5e7bb5f628ad None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:10.710520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc876e-308d-4eae-a5ea-8c9687878eb1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:10.710799 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:10.766601 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88358cab-543d-412d-8fa4-f5b8330f75f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:10.766601 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88358cab-543d-412d-8fa4-f5b8330f75f8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:10.767091 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88358cab-543d-412d-8fa4-f5b8330f75f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:10.767214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88358cab-543d-412d-8fa4-f5b8330f75f8 None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:10.768343 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88358cab-543d-412d-8fa4-f5b8330f75f8 None admin] RBAC: Authorizing `identity:get_project(project_id=141aed90ccfe453283d0e7fd34fb461d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:10.769878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88358cab-543d-412d-8fa4-f5b8330f75f8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:10.771914 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 83/155] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:10 2022] GET /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:10.772756 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88358cab-543d-412d-8fa4-f5b8330f75f8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:10.800765 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 73/156] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:41:10.801751 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157eb873-f400-4192-aa25-5e7bb5f628ad None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:10.919584 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157eb873-f400-4192-aa25-5e7bb5f628ad None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:10.948172 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:10.963924 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac8104-88f3-4f08-b766-c93e3035cd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:10.964854 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac8104-88f3-4f08-b766-c93e3035cd20 None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:10.965313 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac8104-88f3-4f08-b766-c93e3035cd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:10.965737 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac8104-88f3-4f08-b766-c93e3035cd20 None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d/users/e013388eae9240d8862d41588da80d94/roles/f3bcf4f4f01e4fe98ec388ccb5daf537` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:10.968778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac8104-88f3-4f08-b766-c93e3035cd20 None admin] RBAC: Authorizing `identity:create_grant(project_id=141aed90ccfe453283d0e7fd34fb461d, user_id=e013388eae9240d8862d41588da80d94, role_id=f3bcf4f4f01e4fe98ec388ccb5daf537)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:10.970521 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac8104-88f3-4f08-b766-c93e3035cd20 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:10.987744 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 74/157] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:41:10 2022] PUT /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d/users/e013388eae9240d8862d41588da80d94/roles/f3bcf4f4f01e4fe98ec388ccb5daf537 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:41:10.989124 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac8104-88f3-4f08-b766-c93e3035cd20 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:11.096645 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88358cab-543d-412d-8fa4-f5b8330f75f8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:11.134197 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac8104-88f3-4f08-b766-c93e3035cd20 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:11.197926 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0ddd5-ea4a-4759-a806-40eb49fb63a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:11.198509 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0ddd5-ea4a-4759-a806-40eb49fb63a0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:11.198797 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0ddd5-ea4a-4759-a806-40eb49fb63a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:11.199077 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0ddd5-ea4a-4759-a806-40eb49fb63a0 None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:11.205913 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0ddd5-ea4a-4759-a806-40eb49fb63a0 None admin] RBAC: Authorizing `identity:get_project(project_id=141aed90ccfe453283d0e7fd34fb461d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:11.207440 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0ddd5-ea4a-4759-a806-40eb49fb63a0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:11.209640 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 75/158] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:10 2022] GET /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:11.210977 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9e7c3-d557-46bf-9ec9-fc3f11859cdf None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:11.211266 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9e7c3-d557-46bf-9ec9-fc3f11859cdf None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:11.211612 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9e7c3-d557-46bf-9ec9-fc3f11859cdf None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:11.217771 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 76/159] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:11.219279 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912cae1-62af-418b-b507-ce0051e4fe08 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:11.219573 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912cae1-62af-418b-b507-ce0051e4fe08 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:11.219966 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912cae1-62af-418b-b507-ce0051e4fe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:11.246203 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779097bb-b3e2-4c3a-bb28-56a88ff94adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:11.247208 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779097bb-b3e2-4c3a-bb28-56a88ff94adf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:11.247656 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779097bb-b3e2-4c3a-bb28-56a88ff94adf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:11.248097 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779097bb-b3e2-4c3a-bb28-56a88ff94adf None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:11.249386 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779097bb-b3e2-4c3a-bb28-56a88ff94adf None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:11.249883 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779097bb-b3e2-4c3a-bb28-56a88ff94adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:11.252330 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779097bb-b3e2-4c3a-bb28-56a88ff94adf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:11.258228 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b912cae1-62af-418b-b507-ce0051e4fe08 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:11.259553 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b912cae1-62af-418b-b507-ce0051e4fe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:11.285305 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 84/160] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:11.286948 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779097bb-b3e2-4c3a-bb28-56a88ff94adf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:11.306471 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:11.398526 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:11.481441 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 77/161] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:11.482302 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912cae1-62af-418b-b507-ce0051e4fe08 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:11.681401 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779097bb-b3e2-4c3a-bb28-56a88ff94adf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:11.721837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912cae1-62af-418b-b507-ce0051e4fe08 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:11.750313 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a06878-7fa7-4352-98f5-3ad03fac8abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:11.751641 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a06878-7fa7-4352-98f5-3ad03fac8abc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:11.752372 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a06878-7fa7-4352-98f5-3ad03fac8abc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:11.753107 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a06878-7fa7-4352-98f5-3ad03fac8abc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:11.754799 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a06878-7fa7-4352-98f5-3ad03fac8abc None admin] RBAC: Adding query filter params (role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.project.id=141aed90ccfe453283d0e7fd34fb461d, user.id=1ae9e9d2d4e74a049733205286b14514) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:11.755613 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a06878-7fa7-4352-98f5-3ad03fac8abc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:11.758735 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a06878-7fa7-4352-98f5-3ad03fac8abc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:11.770902 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 85/162] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:41:11 2022] GET /identity/v3/role_assignments?user.id=1ae9e9d2d4e74a049733205286b14514&scope.project.id=141aed90ccfe453283d0e7fd34fb461d&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 608 bytes in 485 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:11.777720 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11df5a4-7027-4320-8720-217a5ff37554 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:11.778601 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11df5a4-7027-4320-8720-217a5ff37554 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:11.779343 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11df5a4-7027-4320-8720-217a5ff37554 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:11.783709 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 86/163] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:11 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:11.790465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29990c-0de7-46c6-b249-950d38a36764 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:11.791391 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29990c-0de7-46c6-b249-950d38a36764 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:11.792113 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29990c-0de7-46c6-b249-950d38a36764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:11.794000 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a207b1c-761b-4dc1-9693-260bd67bb7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:11.794781 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a207b1c-761b-4dc1-9693-260bd67bb7cc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:11.795071 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a207b1c-761b-4dc1-9693-260bd67bb7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:11.795349 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a207b1c-761b-4dc1-9693-260bd67bb7cc None admin] PATH_INFO: `/v3/users/69f4406ff16447f8af2cb9634cbd3cc6` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:11.796763 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a207b1c-761b-4dc1-9693-260bd67bb7cc None admin] RBAC: Authorizing `identity:get_user(user_id=69f4406ff16447f8af2cb9634cbd3cc6)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:11.798302 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a207b1c-761b-4dc1-9693-260bd67bb7cc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:11.800981 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 78/164] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:11 2022] GET /identity/v3/users/69f4406ff16447f8af2cb9634cbd3cc6 => generated 275 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:11.806165 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a207b1c-761b-4dc1-9693-260bd67bb7cc None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:11.841692 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9c29990c-0de7-46c6-b249-950d38a36764 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:11.844767 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9c29990c-0de7-46c6-b249-950d38a36764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:11.989257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:12.032345 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:12.051441 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 87/165] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:12.085533 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a207b1c-761b-4dc1-9693-260bd67bb7cc None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:12.130463 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2d22e-c3f8-45de-9a64-c42e1b355aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:12.131096 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2d22e-c3f8-45de-9a64-c42e1b355aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:12.131379 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2d22e-c3f8-45de-9a64-c42e1b355aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:12.131643 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2d22e-c3f8-45de-9a64-c42e1b355aa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:12.136455 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29990c-0de7-46c6-b249-950d38a36764 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:12.258647 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2d22e-c3f8-45de-9a64-c42e1b355aa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:12.260233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2d22e-c3f8-45de-9a64-c42e1b355aa7 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:12.379474 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29990c-0de7-46c6-b249-950d38a36764 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:12.444807 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:12.457738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae719882-8afd-451a-b1ec-52c97c3c5e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:12.458410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae719882-8afd-451a-b1ec-52c97c3c5e5c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:12.458705 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae719882-8afd-451a-b1ec-52c97c3c5e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:12.459198 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae719882-8afd-451a-b1ec-52c97c3c5e5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:12.479897 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae719882-8afd-451a-b1ec-52c97c3c5e5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:12.485464 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ae719882-8afd-451a-b1ec-52c97c3c5e5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:12.485464 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:12.485464 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:12.485464 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:12.485464 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:12.485464 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:12.485464 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:12.485464 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:12.485464 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:12.485464 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:12.485464 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:12.485464 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:12.485464 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:12.485464 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:12.485464 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:12.485464 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:12.487196 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:12.487196 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:12.487196 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:12.487196 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:12.487196 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:12.487196 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:12.487196 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:12.487196 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:12.487196 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:12.487196 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:12.487196 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:12.487196 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:12.487196 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:12.487196 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:12.487196 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:12.487196 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:12.490312 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:12.490312 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:12.490312 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:12.490312 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:12.490312 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:12.490312 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:12.490312 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:12.490312 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:12.490312 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:12.490312 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:12.490312 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:12.490312 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:12.490312 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 88/166] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:41:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:12.503755 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae719882-8afd-451a-b1ec-52c97c3c5e5c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:12.613474 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:12.670029 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 79/167] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 864 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 02 00:41:12.671606 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae719882-8afd-451a-b1ec-52c97c3c5e5c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:12.679443 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2d22e-c3f8-45de-9a64-c42e1b355aa7 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:12.755079 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938dcd0-8443-49c8-a237-910eac58426c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:12.757241 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938dcd0-8443-49c8-a237-910eac58426c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:12.758080 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938dcd0-8443-49c8-a237-910eac58426c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:12.758837 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938dcd0-8443-49c8-a237-910eac58426c None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:12.760337 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938dcd0-8443-49c8-a237-910eac58426c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:12.765565 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938dcd0-8443-49c8-a237-910eac58426c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:12.768714 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938dcd0-8443-49c8-a237-910eac58426c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:12.787270 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 89/168] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:41:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:12.797321 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938dcd0-8443-49c8-a237-910eac58426c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:12.987144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2d22e-c3f8-45de-9a64-c42e1b355aa7 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:13.077029 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0591f-a112-41b9-a5c5-bab919b04bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:13.078078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0591f-a112-41b9-a5c5-bab919b04bbe None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:13.078558 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0591f-a112-41b9-a5c5-bab919b04bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:13.079049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0591f-a112-41b9-a5c5-bab919b04bbe None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:13.081885 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0591f-a112-41b9-a5c5-bab919b04bbe None admin] RBAC: Authorizing `identity:get_project(project_id=141aed90ccfe453283d0e7fd34fb461d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:13.085143 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0591f-a112-41b9-a5c5-bab919b04bbe None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:13.089670 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 80/169] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:12 2022] GET /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d => generated 298 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:13.092249 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0591f-a112-41b9-a5c5-bab919b04bbe None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:13.109725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938dcd0-8443-49c8-a237-910eac58426c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:13.133522 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:13.156201 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:13.189918 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40042b90-36b0-4a46-8f7d-4c76878dbb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:13.190623 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042b90-36b0-4a46-8f7d-4c76878dbb8e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:13.191582 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042b90-36b0-4a46-8f7d-4c76878dbb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:13.191865 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042b90-36b0-4a46-8f7d-4c76878dbb8e None admin] PATH_INFO: `/v3/users/69f4406ff16447f8af2cb9634cbd3cc6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:13.194401 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40042b90-36b0-4a46-8f7d-4c76878dbb8e None admin] RBAC: Authorizing `identity:get_user(user_id=69f4406ff16447f8af2cb9634cbd3cc6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:13.195892 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40042b90-36b0-4a46-8f7d-4c76878dbb8e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:13.197582 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 90/170] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:12 2022] GET /identity/v3/users/69f4406ff16447f8af2cb9634cbd3cc6 => generated 275 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:13.198389 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40042b90-36b0-4a46-8f7d-4c76878dbb8e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:13.318577 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0591f-a112-41b9-a5c5-bab919b04bbe None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:13.391750 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aaf007-5a52-499d-a7d8-64f31f72cf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:13.392409 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaf007-5a52-499d-a7d8-64f31f72cf15 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:13.393576 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaf007-5a52-499d-a7d8-64f31f72cf15 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:13.393875 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaf007-5a52-499d-a7d8-64f31f72cf15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:13.435254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aaf007-5a52-499d-a7d8-64f31f72cf15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:13.436013 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40042b90-36b0-4a46-8f7d-4c76878dbb8e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:13.446342 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e0aaf007-5a52-499d-a7d8-64f31f72cf15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:13.446342 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:13.446342 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:13.446342 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:13.446342 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:13.446342 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:13.446342 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:13.446342 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:13.446342 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:13.446342 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:13.446342 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:13.446342 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:13.446342 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:13.446342 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:13.446342 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:13.446342 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:13.447986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:13.447986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:13.447986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:13.447986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:13.447986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:13.447986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:13.447986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:13.447986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:13.447986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:13.447986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:13.447986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:13.447986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:13.447986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:13.447986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:13.447986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:13.447986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:13.449963 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:13.449963 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:13.449963 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:13.449963 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:13.449963 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:13.449963 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:13.449963 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:13.449963 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:13.449963 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:13.449963 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:13.449963 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:13.449963 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:13.449963 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 81/171] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:13.449963 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aaf007-5a52-499d-a7d8-64f31f72cf15 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:13.491263 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84022fda-6e28-45a6-9873-134fd50f7c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:13.492249 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84022fda-6e28-45a6-9873-134fd50f7c5d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:13.492745 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84022fda-6e28-45a6-9873-134fd50f7c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:13.493035 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84022fda-6e28-45a6-9873-134fd50f7c5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:13.493586 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84022fda-6e28-45a6-9873-134fd50f7c5d None admin] RBAC: Adding query filter params (role.id=424fdbf5034b4445bf8a3022b9fb8b4c, scope.project.id=141aed90ccfe453283d0e7fd34fb461d, user.id=69f4406ff16447f8af2cb9634cbd3cc6) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:13.493895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84022fda-6e28-45a6-9873-134fd50f7c5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:13.495597 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84022fda-6e28-45a6-9873-134fd50f7c5d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:13.509436 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 91/172] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:41:13 2022] GET /identity/v3/role_assignments?user.id=69f4406ff16447f8af2cb9634cbd3cc6&scope.project.id=141aed90ccfe453283d0e7fd34fb461d&role.id=424fdbf5034b4445bf8a3022b9fb8b4c => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:13.510475 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84022fda-6e28-45a6-9873-134fd50f7c5d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:13.654229 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:13.685468 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:13.731416 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aaf007-5a52-499d-a7d8-64f31f72cf15 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:13.797913 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8ceca-b31d-483f-a56a-6ed12399d184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:13.798708 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8ceca-b31d-483f-a56a-6ed12399d184 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:13.798996 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8ceca-b31d-483f-a56a-6ed12399d184 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:13.799274 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8ceca-b31d-483f-a56a-6ed12399d184 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:13.845275 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84022fda-6e28-45a6-9873-134fd50f7c5d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:13.885293 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8ceca-b31d-483f-a56a-6ed12399d184 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:13.886906 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8ceca-b31d-483f-a56a-6ed12399d184 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:13.964986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8599b-25f5-4365-a9c2-db171be3482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:13.965878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8599b-25f5-4365-a9c2-db171be3482b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:13.966356 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8599b-25f5-4365-a9c2-db171be3482b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:13.966824 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8599b-25f5-4365-a9c2-db171be3482b None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:13.969069 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8599b-25f5-4365-a9c2-db171be3482b None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:13.969740 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8599b-25f5-4365-a9c2-db171be3482b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:13.972393 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8599b-25f5-4365-a9c2-db171be3482b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:13.989976 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:14.001247 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 92/173] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 491 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:14.012903 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8599b-25f5-4365-a9c2-db171be3482b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:14.052844 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 82/174] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:41:14.064752 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8ceca-b31d-483f-a56a-6ed12399d184 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:14.264320 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8599b-25f5-4365-a9c2-db171be3482b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:14.293501 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:14.341167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd5ec0-2daa-4fc3-9dd0-94c5457b0d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:14.342016 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd5ec0-2daa-4fc3-9dd0-94c5457b0d06 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:14.342447 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd5ec0-2daa-4fc3-9dd0-94c5457b0d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:14.342948 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd5ec0-2daa-4fc3-9dd0-94c5457b0d06 None admin] PATH_INFO: `/v3/users/69f4406ff16447f8af2cb9634cbd3cc6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:14.345270 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd5ec0-2daa-4fc3-9dd0-94c5457b0d06 None admin] RBAC: Authorizing `identity:get_user(user_id=69f4406ff16447f8af2cb9634cbd3cc6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:14.348027 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd5ec0-2daa-4fc3-9dd0-94c5457b0d06 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:14.352118 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 93/175] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:14 2022] GET /identity/v3/users/69f4406ff16447f8af2cb9634cbd3cc6 => generated 275 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:14.355445 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a43378-a187-47da-b176-29c94d85c4eb None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:14.355907 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a43378-a187-47da-b176-29c94d85c4eb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:14.356609 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a43378-a187-47da-b176-29c94d85c4eb None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:14.364388 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 94/176] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:14 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:14.365747 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a43378-a187-47da-b176-29c94d85c4eb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:14.375793 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8ceca-b31d-483f-a56a-6ed12399d184 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:14.514981 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce9130-4dab-4896-90c1-c5ad95ddf8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:14.515569 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce9130-4dab-4896-90c1-c5ad95ddf8cc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:14.515879 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce9130-4dab-4896-90c1-c5ad95ddf8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:14.516204 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce9130-4dab-4896-90c1-c5ad95ddf8cc None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:14.521869 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce9130-4dab-4896-90c1-c5ad95ddf8cc None admin] RBAC: Authorizing `identity:get_project(project_id=141aed90ccfe453283d0e7fd34fb461d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:14.523441 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce9130-4dab-4896-90c1-c5ad95ddf8cc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:14.525506 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 83/177] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:14 2022] GET /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d => generated 298 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:14.526780 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa223512-c5e3-47fe-90b5-8e07807ac4f6 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:14.527062 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa223512-c5e3-47fe-90b5-8e07807ac4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:14.527339 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa223512-c5e3-47fe-90b5-8e07807ac4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:14.573272 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-aa223512-c5e3-47fe-90b5-8e07807ac4f6 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:14.574514 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-aa223512-c5e3-47fe-90b5-8e07807ac4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:14.608727 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a43378-a187-47da-b176-29c94d85c4eb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:14.681726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272534c-5195-4551-9cbd-6872533396bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:14.683588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272534c-5195-4551-9cbd-6872533396bf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:14.684346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272534c-5195-4551-9cbd-6872533396bf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:14.685108 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272534c-5195-4551-9cbd-6872533396bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:14.707790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:14.757708 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:14.777360 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272534c-5195-4551-9cbd-6872533396bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:14.779367 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272534c-5195-4551-9cbd-6872533396bf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:14.802435 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 84/178] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:14.803370 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa223512-c5e3-47fe-90b5-8e07807ac4f6 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:14.919424 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 95/179] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:41:14.928435 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272534c-5195-4551-9cbd-6872533396bf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:15.006222 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa223512-c5e3-47fe-90b5-8e07807ac4f6 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:15.050946 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ed6b8-021f-4d3b-9d93-6581c0f704be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:15.051496 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ed6b8-021f-4d3b-9d93-6581c0f704be None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:15.051777 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ed6b8-021f-4d3b-9d93-6581c0f704be None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:15.052050 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ed6b8-021f-4d3b-9d93-6581c0f704be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:15.055043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ed6b8-021f-4d3b-9d93-6581c0f704be None admin] RBAC: Adding query filter params (role.id=030fcd169fb44f759772ef3101c07012, scope.project.id=141aed90ccfe453283d0e7fd34fb461d, user.id=69f4406ff16447f8af2cb9634cbd3cc6) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:15.055043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ed6b8-021f-4d3b-9d93-6581c0f704be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:15.055043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ed6b8-021f-4d3b-9d93-6581c0f704be None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:15.061513 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 85/180] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:41:14 2022] GET /identity/v3/role_assignments?user.id=69f4406ff16447f8af2cb9634cbd3cc6&scope.project.id=141aed90ccfe453283d0e7fd34fb461d&role.id=030fcd169fb44f759772ef3101c07012 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:15.080642 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f8419-4d99-4274-824d-da0874147310 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:15.081139 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f8419-4d99-4274-824d-da0874147310 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:15.081517 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f8419-4d99-4274-824d-da0874147310 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:15.083321 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 86/181] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:41:15.089171 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73ad6b-a3e4-4cf6-8bc2-464fc1823748 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:15.089580 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73ad6b-a3e4-4cf6-8bc2-464fc1823748 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:15.089983 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73ad6b-a3e4-4cf6-8bc2-464fc1823748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:15.101291 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:15.110697 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-0f73ad6b-a3e4-4cf6-8bc2-464fc1823748 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:15.112132 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0f73ad6b-a3e4-4cf6-8bc2-464fc1823748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:15.139296 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272534c-5195-4551-9cbd-6872533396bf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:15.160484 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:15.193308 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 87/182] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:41:15.227375 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f2e63-3d01-4214-bbdf-5415c5dd48d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:15.228058 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f2e63-3d01-4214-bbdf-5415c5dd48d5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:15.228346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f2e63-3d01-4214-bbdf-5415c5dd48d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:15.228628 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f2e63-3d01-4214-bbdf-5415c5dd48d5 None admin] PATH_INFO: `/v3/projects/740d73709b4a456eaab8690820d13676` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:15.232531 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f2e63-3d01-4214-bbdf-5415c5dd48d5 None admin] RBAC: Authorizing `identity:get_project(project_id=740d73709b4a456eaab8690820d13676)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:15.234699 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f2e63-3d01-4214-bbdf-5415c5dd48d5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:15.236384 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 96/183] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:14 2022] GET /identity/v3/projects/740d73709b4a456eaab8690820d13676 => generated 312 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:15.245249 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73ad6b-a3e4-4cf6-8bc2-464fc1823748 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:15.379877 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73ad6b-a3e4-4cf6-8bc2-464fc1823748 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:15.420061 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864c979-c200-4212-8b65-efe0a2b77db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:15.420061 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864c979-c200-4212-8b65-efe0a2b77db5 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:15.420459 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864c979-c200-4212-8b65-efe0a2b77db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:15.420616 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864c979-c200-4212-8b65-efe0a2b77db5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:15.421488 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864c979-c200-4212-8b65-efe0a2b77db5 None admin] RBAC: Adding query filter params (role.id=424fdbf5034b4445bf8a3022b9fb8b4c, scope.project.id=740d73709b4a456eaab8690820d13676, user.id=69f4406ff16447f8af2cb9634cbd3cc6) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:15.421797 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864c979-c200-4212-8b65-efe0a2b77db5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:15.423347 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864c979-c200-4212-8b65-efe0a2b77db5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:15.431116 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 88/184] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:41:15 2022] GET /identity/v3/role_assignments?user.id=69f4406ff16447f8af2cb9634cbd3cc6&scope.project.id=740d73709b4a456eaab8690820d13676&role.id=424fdbf5034b4445bf8a3022b9fb8b4c => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:15.467396 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1da6e-290d-449d-b00c-57c43ab2c498 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:15.468307 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1da6e-290d-449d-b00c-57c43ab2c498 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:15.468479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1da6e-290d-449d-b00c-57c43ab2c498 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:15.469972 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 97/185] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:15.476402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b5dac-9c4a-4154-999a-33a0e194e7fd None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:15.476717 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b5dac-9c4a-4154-999a-33a0e194e7fd None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:15.476999 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b5dac-9c4a-4154-999a-33a0e194e7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:15.498188 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-024b5dac-9c4a-4154-999a-33a0e194e7fd None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:15.500022 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-024b5dac-9c4a-4154-999a-33a0e194e7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:15.534204 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:15.583553 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 89/186] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:41:15.594428 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1da6e-290d-449d-b00c-57c43ab2c498 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:15.625234 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b5dac-9c4a-4154-999a-33a0e194e7fd None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:15.785001 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b5dac-9c4a-4154-999a-33a0e194e7fd None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:15.824656 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3c891-1ab4-4b5c-a34c-9436b6e6a990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:15.824858 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1da6e-290d-449d-b00c-57c43ab2c498 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:15.825349 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3c891-1ab4-4b5c-a34c-9436b6e6a990 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:15.825632 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3c891-1ab4-4b5c-a34c-9436b6e6a990 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:15.825903 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3c891-1ab4-4b5c-a34c-9436b6e6a990 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:15.827675 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3c891-1ab4-4b5c-a34c-9436b6e6a990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:15.829477 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3c891-1ab4-4b5c-a34c-9436b6e6a990 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:15.831434 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 90/187] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:41:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:15.838358 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3c891-1ab4-4b5c-a34c-9436b6e6a990 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:15.876144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:15.899024 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93bd2d-67a6-4bc2-a0ff-1bb3659a9cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:15.900174 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93bd2d-67a6-4bc2-a0ff-1bb3659a9cac None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:15.900613 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93bd2d-67a6-4bc2-a0ff-1bb3659a9cac None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:15.901229 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93bd2d-67a6-4bc2-a0ff-1bb3659a9cac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:15.924148 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93bd2d-67a6-4bc2-a0ff-1bb3659a9cac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:15.935073 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-9d93bd2d-67a6-4bc2-a0ff-1bb3659a9cac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:41:15.935073 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:15.935073 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:15.935073 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:15.935073 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:15.935073 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:15.935073 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:15.935073 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:15.935073 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:15.935073 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:15.935073 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:15.935073 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:15.935073 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:15.935073 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:15.935073 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:15.935073 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:15.936019 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:15.936019 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:15.936019 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:15.936019 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:15.936019 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:15.936019 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:15.936019 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:15.936019 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:15.936019 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:15.936019 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:15.936019 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:15.936019 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:15.936019 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:15.936019 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:15.936019 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:15.936019 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:15.938187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:15.938187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:15.938187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:15.938187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:15.938187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:15.938187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:15.938187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:15.938187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:15.938187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:15.938187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:15.938187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:41:15.938187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:15.938187 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 98/188] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:41:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:15.940030 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93bd2d-67a6-4bc2-a0ff-1bb3659a9cac None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:15.960469 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3c891-1ab4-4b5c-a34c-9436b6e6a990 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:15.965634 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:15.999931 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec01528-f9ab-451f-a003-075ea71f7ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:16.000565 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec01528-f9ab-451f-a003-075ea71f7ef1 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:16.000847 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec01528-f9ab-451f-a003-075ea71f7ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:16.001151 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec01528-f9ab-451f-a003-075ea71f7ef1 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:16.001833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec01528-f9ab-451f-a003-075ea71f7ef1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:16.003411 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec01528-f9ab-451f-a003-075ea71f7ef1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:16.032503 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 91/189] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Oct 2 00:41:15 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:41:16.033467 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec01528-f9ab-451f-a003-075ea71f7ef1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:16.147664 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93bd2d-67a6-4bc2-a0ff-1bb3659a9cac None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:16.154545 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:16.177726 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec01528-f9ab-451f-a003-075ea71f7ef1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:16.214170 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f50dce-13c5-4a53-8977-629e8b829062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:16.215430 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f50dce-13c5-4a53-8977-629e8b829062 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:16.216167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f50dce-13c5-4a53-8977-629e8b829062 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:16.217013 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f50dce-13c5-4a53-8977-629e8b829062 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:16.223369 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6c96c-a855-45c6-b8a4-3e57b15b9b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:16.224167 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6c96c-a855-45c6-b8a4-3e57b15b9b76 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:16.224601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6c96c-a855-45c6-b8a4-3e57b15b9b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:16.225018 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6c96c-a855-45c6-b8a4-3e57b15b9b76 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:16.225833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6c96c-a855-45c6-b8a4-3e57b15b9b76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:16.226245 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6c96c-a855-45c6-b8a4-3e57b15b9b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:16.227940 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6c96c-a855-45c6-b8a4-3e57b15b9b76 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:16.238599 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 92/190] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:16.240065 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f50dce-13c5-4a53-8977-629e8b829062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:16.245212 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6c96c-a855-45c6-b8a4-3e57b15b9b76 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:16.250851 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-89f50dce-13c5-4a53-8977-629e8b829062 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:16.250851 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:16.250851 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:16.250851 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:16.250851 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:16.250851 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:16.250851 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:16.250851 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:16.250851 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:16.250851 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:16.250851 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:16.250851 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:16.250851 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:16.250851 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:16.250851 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:16.250851 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:16.252676 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:16.252676 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:16.252676 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:16.252676 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:16.252676 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:16.252676 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:16.252676 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:16.252676 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:16.252676 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:16.252676 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:16.252676 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:16.252676 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:16.252676 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:16.252676 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:16.252676 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:16.252676 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:16.254420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:16.254420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:16.254420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:16.254420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:16.254420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:16.254420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:16.254420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:16.254420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:16.254420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:16.254420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:16.254420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:16.254420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:16.257859 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 99/191] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:41:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:16.260114 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9e7a1-1812-4f90-9041-be9fa02b8687 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:16.260825 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9e7a1-1812-4f90-9041-be9fa02b8687 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:16.261476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9e7a1-1812-4f90-9041-be9fa02b8687 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:16.265238 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 100/192] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:16.273156 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9e7a1-1812-4f90-9041-be9fa02b8687 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:16.370787 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:16.415575 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9e7a1-1812-4f90-9041-be9fa02b8687 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:16.433907 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6c96c-a855-45c6-b8a4-3e57b15b9b76 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:16.477765 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97e233-e7c7-43cb-a475-e98a7f72edd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:16.478744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97e233-e7c7-43cb-a475-e98a7f72edd2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:16.479195 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97e233-e7c7-43cb-a475-e98a7f72edd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:16.479663 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97e233-e7c7-43cb-a475-e98a7f72edd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:16.480830 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97e233-e7c7-43cb-a475-e98a7f72edd2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:16.481349 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97e233-e7c7-43cb-a475-e98a7f72edd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:16.484388 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97e233-e7c7-43cb-a475-e98a7f72edd2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:16.489240 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88d9ae-f645-44cf-9db6-6c4a3e92cd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:16.489908 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88d9ae-f645-44cf-9db6-6c4a3e92cd42 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:16.490187 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88d9ae-f645-44cf-9db6-6c4a3e92cd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:16.490459 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88d9ae-f645-44cf-9db6-6c4a3e92cd42 None admin] PATH_INFO: `/v3/users/7adbf3ac0eba4a548255343f8bb03d51` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:16.500357 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 101/193] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:41:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:16.502109 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e802de-006f-4af5-afa1-594acdcecefa None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:16.502658 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e802de-006f-4af5-afa1-594acdcecefa None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:16.503144 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e802de-006f-4af5-afa1-594acdcecefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:16.522893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88d9ae-f645-44cf-9db6-6c4a3e92cd42 None admin] RBAC: Authorizing `identity:get_user(user_id=7adbf3ac0eba4a548255343f8bb03d51)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:16.525626 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88d9ae-f645-44cf-9db6-6c4a3e92cd42 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:16.526264 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-68e802de-006f-4af5-afa1-594acdcecefa None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:16.527516 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-68e802de-006f-4af5-afa1-594acdcecefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:16.528744 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 93/194] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:16 2022] GET /identity/v3/users/7adbf3ac0eba4a548255343f8bb03d51 => generated 283 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:16.529900 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88d9ae-f645-44cf-9db6-6c4a3e92cd42 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:16.551761 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:16.627287 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 102/195] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:16.629330 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e802de-006f-4af5-afa1-594acdcecefa None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:16.729859 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88d9ae-f645-44cf-9db6-6c4a3e92cd42 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:16.747464 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:16.814740 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e81cd2-2706-47f2-9779-d937018d853b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:16.815875 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e81cd2-2706-47f2-9779-d937018d853b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:16.816361 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e81cd2-2706-47f2-9779-d937018d853b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:16.816842 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e81cd2-2706-47f2-9779-d937018d853b None admin] PATH_INFO: `/v3/users/7adbf3ac0eba4a548255343f8bb03d51` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:16.820524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e81cd2-2706-47f2-9779-d937018d853b None admin] RBAC: Authorizing `identity:get_user(user_id=7adbf3ac0eba4a548255343f8bb03d51)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:16.823244 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e81cd2-2706-47f2-9779-d937018d853b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:16.834505 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 94/196] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:16 2022] GET /identity/v3/users/7adbf3ac0eba4a548255343f8bb03d51 => generated 283 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:16.844288 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e81cd2-2706-47f2-9779-d937018d853b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:16.852206 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e802de-006f-4af5-afa1-594acdcecefa None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:16.979299 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d081f4-f378-4335-8c7d-cbfd8193792d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:16.981630 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d081f4-f378-4335-8c7d-cbfd8193792d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:16.982347 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d081f4-f378-4335-8c7d-cbfd8193792d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:16.983098 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d081f4-f378-4335-8c7d-cbfd8193792d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:17.107499 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:17.167017 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d081f4-f378-4335-8c7d-cbfd8193792d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:17.169813 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d081f4-f378-4335-8c7d-cbfd8193792d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:17.185787 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e81cd2-2706-47f2-9779-d937018d853b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:17.277763 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463b8e8-3f0d-48e0-ac34-177524191717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:17.279157 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:17.282687 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463b8e8-3f0d-48e0-ac34-177524191717 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:17.283736 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463b8e8-3f0d-48e0-ac34-177524191717 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:17.284558 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463b8e8-3f0d-48e0-ac34-177524191717 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:17.357651 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 103/197] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:41:17.358970 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d081f4-f378-4335-8c7d-cbfd8193792d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:17.428211 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463b8e8-3f0d-48e0-ac34-177524191717 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:17.429934 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463b8e8-3f0d-48e0-ac34-177524191717 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:17.522312 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:17.561081 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 95/198] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:41:17.561081 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463b8e8-3f0d-48e0-ac34-177524191717 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:17.566005 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d081f4-f378-4335-8c7d-cbfd8193792d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:17.613603 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b7bc9-5c71-4e2a-b16a-dd2eb3f18cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:17.614287 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b7bc9-5c71-4e2a-b16a-dd2eb3f18cdf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:17.614574 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b7bc9-5c71-4e2a-b16a-dd2eb3f18cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:17.614846 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b7bc9-5c71-4e2a-b16a-dd2eb3f18cdf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:17.630379 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b7bc9-5c71-4e2a-b16a-dd2eb3f18cdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:17.636490 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-687b7bc9-5c71-4e2a-b16a-dd2eb3f18cdf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:41:17.636490 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:17.636490 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:17.636490 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:17.636490 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:17.636490 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:17.636490 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:17.636490 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:17.636490 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:17.636490 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:17.636490 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:17.636490 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:17.636490 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:17.636490 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:17.636490 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:17.636490 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:17.638471 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:17.638471 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:17.638471 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:17.638471 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:17.638471 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:17.638471 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:17.638471 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:17.638471 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:17.638471 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:17.638471 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:17.638471 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:17.638471 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:17.638471 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:17.638471 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:17.638471 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:17.638471 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:17.640645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:17.640645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:17.640645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:17.640645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:17.640645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:17.640645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:17.640645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:17.640645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:17.640645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:17.640645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:17.640645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:41:17.640645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:17.640645 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 104/199] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:17.640645 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b7bc9-5c71-4e2a-b16a-dd2eb3f18cdf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:17.691735 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:17.734913 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463b8e8-3f0d-48e0-ac34-177524191717 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:17.776072 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dbf6c-d07b-440d-8485-292ca1bfb1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:17.776726 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dbf6c-d07b-440d-8485-292ca1bfb1bf None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:17.777031 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dbf6c-d07b-440d-8485-292ca1bfb1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:17.777300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dbf6c-d07b-440d-8485-292ca1bfb1bf None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:17.778529 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8dbf6c-d07b-440d-8485-292ca1bfb1bf None admin] RBAC: Authorizing `identity:get_project(project_id=4bd87b88a6204ecaa0e15f4cb612ef96)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:17.780683 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8dbf6c-d07b-440d-8485-292ca1bfb1bf None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:17.782637 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 96/200] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:17 2022] GET /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:17.783731 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dbf6c-d07b-440d-8485-292ca1bfb1bf None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:17.843383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:17.865031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b7bc9-5c71-4e2a-b16a-dd2eb3f18cdf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:17.908008 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dbf6c-d07b-440d-8485-292ca1bfb1bf None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:17.933171 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b645d-7e40-4d83-8f21-3c162838c900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:17.934709 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b645d-7e40-4d83-8f21-3c162838c900 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:17.935579 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b645d-7e40-4d83-8f21-3c162838c900 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:17.937077 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b645d-7e40-4d83-8f21-3c162838c900 None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:17.939720 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b645d-7e40-4d83-8f21-3c162838c900 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd87b88a6204ecaa0e15f4cb612ef96)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:17.943047 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b645d-7e40-4d83-8f21-3c162838c900 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:17.946780 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 105/201] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:17 2022] GET /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96 => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:17.952316 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65978c-5b2e-44a8-9630-37c323abef24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:17.954315 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65978c-5b2e-44a8-9630-37c323abef24 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:17.954315 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65978c-5b2e-44a8-9630-37c323abef24 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:17.954315 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65978c-5b2e-44a8-9630-37c323abef24 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:17.954854 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65978c-5b2e-44a8-9630-37c323abef24 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:17.955354 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65978c-5b2e-44a8-9630-37c323abef24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:17.955815 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b645d-7e40-4d83-8f21-3c162838c900 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:17.959929 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65978c-5b2e-44a8-9630-37c323abef24 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:17.968571 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 97/202] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:17.974164 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65978c-5b2e-44a8-9630-37c323abef24 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:18.095208 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65978c-5b2e-44a8-9630-37c323abef24 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:18.102569 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:18.155680 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce673fa-cb1d-4803-ad78-32767387d09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:18.157792 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce673fa-cb1d-4803-ad78-32767387d09b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:18.158529 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce673fa-cb1d-4803-ad78-32767387d09b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:18.159229 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce673fa-cb1d-4803-ad78-32767387d09b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:18.160819 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce673fa-cb1d-4803-ad78-32767387d09b None admin] RBAC: Adding query filter params (role.id=030fcd169fb44f759772ef3101c07012, scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96, user.id=7adbf3ac0eba4a548255343f8bb03d51) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:18.161607 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce673fa-cb1d-4803-ad78-32767387d09b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:18.162917 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:18.165761 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce673fa-cb1d-4803-ad78-32767387d09b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:18.177637 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 98/203] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:41:17 2022] GET /identity/v3/role_assignments?user.id=7adbf3ac0eba4a548255343f8bb03d51&scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96&role.id=030fcd169fb44f759772ef3101c07012 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:18.185255 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b645d-7e40-4d83-8f21-3c162838c900 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:18.187136 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce673fa-cb1d-4803-ad78-32767387d09b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:18.258487 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3c655-dab9-476b-a0a5-8383bf1f4710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:18.259865 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3c655-dab9-476b-a0a5-8383bf1f4710 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:18.260516 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3c655-dab9-476b-a0a5-8383bf1f4710 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:18.261221 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3c655-dab9-476b-a0a5-8383bf1f4710 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:18.262879 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3c655-dab9-476b-a0a5-8383bf1f4710 None admin] RBAC: Adding query filter params (role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96, user.id=7adbf3ac0eba4a548255343f8bb03d51) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:18.266901 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3c655-dab9-476b-a0a5-8383bf1f4710 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:18.272778 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3c655-dab9-476b-a0a5-8383bf1f4710 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:18.297461 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 106/204] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:41:17 2022] GET /identity/v3/role_assignments?user.id=7adbf3ac0eba4a548255343f8bb03d51&scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 259 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:18.444490 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce673fa-cb1d-4803-ad78-32767387d09b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:18.509471 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5494a6-06d4-4b75-a93c-77af94484c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:18.510147 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5494a6-06d4-4b75-a93c-77af94484c72 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:18.510431 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5494a6-06d4-4b75-a93c-77af94484c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:18.510711 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5494a6-06d4-4b75-a93c-77af94484c72 None admin] PATH_INFO: `/v3/users/e013388eae9240d8862d41588da80d94` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:18.511964 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5494a6-06d4-4b75-a93c-77af94484c72 None admin] RBAC: Authorizing `identity:get_user(user_id=e013388eae9240d8862d41588da80d94)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:18.513518 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5494a6-06d4-4b75-a93c-77af94484c72 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:18.515540 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 99/205] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:18 2022] GET /identity/v3/users/e013388eae9240d8862d41588da80d94 => generated 289 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:18.521697 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3c655-dab9-476b-a0a5-8383bf1f4710 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:18.732517 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3c655-dab9-476b-a0a5-8383bf1f4710 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:18.787443 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6ba85-b194-4dad-91ae-6106e34fbf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:18.788086 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6ba85-b194-4dad-91ae-6106e34fbf01 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:18.788367 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6ba85-b194-4dad-91ae-6106e34fbf01 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:18.788644 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6ba85-b194-4dad-91ae-6106e34fbf01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:18.829834 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:18.905744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6ba85-b194-4dad-91ae-6106e34fbf01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:18.907518 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6ba85-b194-4dad-91ae-6106e34fbf01 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:19.041738 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 107/206] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:41:19.048207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5494a6-06d4-4b75-a93c-77af94484c72 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:19.066052 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b470a-98be-427d-a5ad-f7a3248ed31b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:19.066440 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b470a-98be-427d-a5ad-f7a3248ed31b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:19.066660 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b470a-98be-427d-a5ad-f7a3248ed31b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:19.068131 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 108/207] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:19.079269 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb850f-368e-4cf0-803b-96b2e87bc30e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:19.079555 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb850f-368e-4cf0-803b-96b2e87bc30e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:19.079827 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb850f-368e-4cf0-803b-96b2e87bc30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:19.117619 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c0eb850f-368e-4cf0-803b-96b2e87bc30e None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:19.118889 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c0eb850f-368e-4cf0-803b-96b2e87bc30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:19.130445 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:19.215949 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5494a6-06d4-4b75-a93c-77af94484c72 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:19.259318 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756378c-1364-4d6a-a7eb-9668a19aebef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:19.259733 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756378c-1364-4d6a-a7eb-9668a19aebef None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:19.260020 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756378c-1364-4d6a-a7eb-9668a19aebef None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:19.260300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756378c-1364-4d6a-a7eb-9668a19aebef None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:19.261612 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756378c-1364-4d6a-a7eb-9668a19aebef None admin] RBAC: Authorizing `identity:get_project(project_id=141aed90ccfe453283d0e7fd34fb461d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:19.265614 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756378c-1364-4d6a-a7eb-9668a19aebef None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:19.265614 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 100/208] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:19 2022] GET /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:19.271539 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756378c-1364-4d6a-a7eb-9668a19aebef None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:19.272547 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:19.315007 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 109/209] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:19.320540 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137600b-a8c4-4dfb-91cc-44aefc4029c9 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:19.320540 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137600b-a8c4-4dfb-91cc-44aefc4029c9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:19.320540 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137600b-a8c4-4dfb-91cc-44aefc4029c9 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:19.320540 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 110/210] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:19.327753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa654d-be51-486c-8c34-026c9187f6fc None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:19.327968 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa654d-be51-486c-8c34-026c9187f6fc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:19.328188 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa654d-be51-486c-8c34-026c9187f6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:19.365174 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-48aa654d-be51-486c-8c34-026c9187f6fc None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:19.366398 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-48aa654d-be51-486c-8c34-026c9187f6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:19.487235 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756378c-1364-4d6a-a7eb-9668a19aebef None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:19.502686 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:19.526638 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 111/211] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:19.560318 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6040412-13eb-4cbf-85ac-6a4d231897b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:19.561615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6040412-13eb-4cbf-85ac-6a4d231897b0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:19.562114 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6040412-13eb-4cbf-85ac-6a4d231897b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:19.562620 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6040412-13eb-4cbf-85ac-6a4d231897b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:19.564110 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6040412-13eb-4cbf-85ac-6a4d231897b0 None admin] RBAC: Adding query filter params (role.id=f3bcf4f4f01e4fe98ec388ccb5daf537, scope.project.id=141aed90ccfe453283d0e7fd34fb461d, user.id=e013388eae9240d8862d41588da80d94) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:19.564703 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6040412-13eb-4cbf-85ac-6a4d231897b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:19.567597 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6040412-13eb-4cbf-85ac-6a4d231897b0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:19.583449 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 101/212] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:41:19 2022] GET /identity/v3/role_assignments?user.id=e013388eae9240d8862d41588da80d94&scope.project.id=141aed90ccfe453283d0e7fd34fb461d&role.id=f3bcf4f4f01e4fe98ec388ccb5daf537 => generated 608 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:19.690591 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa654d-be51-486c-8c34-026c9187f6fc None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:19.846112 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa654d-be51-486c-8c34-026c9187f6fc None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:19.867853 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:19.900344 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6040412-13eb-4cbf-85ac-6a4d231897b0 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:19.901966 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad3ca6-468f-4f25-926e-e1973abdd987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:19.906868 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad3ca6-468f-4f25-926e-e1973abdd987 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:19.907744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad3ca6-468f-4f25-926e-e1973abdd987 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:19.908228 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad3ca6-468f-4f25-926e-e1973abdd987 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:19.910726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad3ca6-468f-4f25-926e-e1973abdd987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:19.913051 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad3ca6-468f-4f25-926e-e1973abdd987 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:19.915184 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 112/213] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:41:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:19.922748 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad3ca6-468f-4f25-926e-e1973abdd987 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:20.079353 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad3ca6-468f-4f25-926e-e1973abdd987 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:20.086965 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6040412-13eb-4cbf-85ac-6a4d231897b0 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:20.121950 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa3cfd-a966-472e-979b-a7fd5bb15c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:20.122823 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa3cfd-a966-472e-979b-a7fd5bb15c5e None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:20.123250 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa3cfd-a966-472e-979b-a7fd5bb15c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:20.124275 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa3cfd-a966-472e-979b-a7fd5bb15c5e None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:20.125696 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa3cfd-a966-472e-979b-a7fd5bb15c5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:20.127470 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa3cfd-a966-472e-979b-a7fd5bb15c5e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:20.133958 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1db96-0702-477c-8946-966ea753fc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:20.135014 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1db96-0702-477c-8946-966ea753fc72 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:20.135521 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1db96-0702-477c-8946-966ea753fc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:20.136021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1db96-0702-477c-8946-966ea753fc72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:20.158880 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1db96-0702-477c-8946-966ea753fc72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:20.160849 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 113/214] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Oct 2 00:41:19 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:41:20.169756 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-79c1db96-0702-477c-8946-966ea753fc72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:20.169756 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:20.169756 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:20.169756 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:20.169756 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:20.169756 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:20.169756 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:20.169756 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:20.169756 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:20.169756 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:20.169756 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:20.169756 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:20.169756 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:20.169756 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:20.169756 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:20.169756 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:20.170866 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:20.170866 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:20.170866 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:20.170866 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:20.170866 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:20.170866 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:20.170866 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:20.170866 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:20.170866 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:20.170866 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:20.170866 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:20.170866 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:20.170866 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:20.170866 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:20.170866 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:20.170866 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:20.172043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:20.172043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:20.172043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:20.172043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:20.172043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:20.172043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:20.172043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:20.172043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:20.172043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:20.172043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:20.172043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:20.172043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:20.172043 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 102/215] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:20.181810 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa3cfd-a966-472e-979b-a7fd5bb15c5e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:20.252712 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:20.375317 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa3cfd-a966-472e-979b-a7fd5bb15c5e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:20.428838 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aa416-88de-4081-899e-11b3f70cfa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:20.429945 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aa416-88de-4081-899e-11b3f70cfa24 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:20.430443 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aa416-88de-4081-899e-11b3f70cfa24 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:20.430909 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aa416-88de-4081-899e-11b3f70cfa24 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:20.431793 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aa416-88de-4081-899e-11b3f70cfa24 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:20.432312 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aa416-88de-4081-899e-11b3f70cfa24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:20.434012 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aa416-88de-4081-899e-11b3f70cfa24 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:20.447992 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 114/216] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:20.456319 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1db96-0702-477c-8946-966ea753fc72 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:20.513891 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:20.622685 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1db96-0702-477c-8946-966ea753fc72 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:20.668034 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d0fea-1632-4f72-b625-d71310a57fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:20.668991 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d0fea-1632-4f72-b625-d71310a57fee None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:20.669451 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d0fea-1632-4f72-b625-d71310a57fee None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:20.669873 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d0fea-1632-4f72-b625-d71310a57fee None admin] PATH_INFO: `/v3/users/08ef08e124fe45e0acdbbc9aa158880f` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:20.688159 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d0fea-1632-4f72-b625-d71310a57fee None admin] RBAC: Authorizing `identity:get_user(user_id=08ef08e124fe45e0acdbbc9aa158880f)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:20.689989 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d0fea-1632-4f72-b625-d71310a57fee None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:20.692308 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 103/217] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:20 2022] GET /identity/v3/users/08ef08e124fe45e0acdbbc9aa158880f => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:20.701918 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aa416-88de-4081-899e-11b3f70cfa24 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:20.856828 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:20.861500 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aa416-88de-4081-899e-11b3f70cfa24 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:20.919880 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08df7a8-0806-4148-a7a1-808484c05f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:20.920536 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df7a8-0806-4148-a7a1-808484c05f71 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:20.920832 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df7a8-0806-4148-a7a1-808484c05f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:20.921138 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df7a8-0806-4148-a7a1-808484c05f71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:21.034478 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08df7a8-0806-4148-a7a1-808484c05f71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:21.035976 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08df7a8-0806-4148-a7a1-808484c05f71 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:21.107298 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88f5d7-fdf3-49a7-8595-3f0556357adc None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:21.108501 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88f5d7-fdf3-49a7-8595-3f0556357adc None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:21.109737 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88f5d7-fdf3-49a7-8595-3f0556357adc None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:21.111454 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 104/218] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:41:21.117294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c186f-0e71-4fe9-b03d-5d14f792941d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:21.117923 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c186f-0e71-4fe9-b03d-5d14f792941d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:21.118263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c186f-0e71-4fe9-b03d-5d14f792941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:21.159850 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-597c186f-0e71-4fe9-b03d-5d14f792941d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:21.164019 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-597c186f-0e71-4fe9-b03d-5d14f792941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:21.193932 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:21.202221 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 115/219] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:41:21.213346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08df7a8-0806-4148-a7a1-808484c05f71 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:21.328229 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 105/220] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:41:21.409064 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205356de-b4d0-4f2c-ab0a-e2c5bb963cf8 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:21.409525 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205356de-b4d0-4f2c-ab0a-e2c5bb963cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:21.409974 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205356de-b4d0-4f2c-ab0a-e2c5bb963cf8 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:21.412722 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 106/221] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:21.420880 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae116dd-69f2-486c-abf8-d34f115d83bb None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:21.421362 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae116dd-69f2-486c-abf8-d34f115d83bb None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:21.422012 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae116dd-69f2-486c-abf8-d34f115d83bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:21.422341 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08df7a8-0806-4148-a7a1-808484c05f71 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:21.471367 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf414aa3-f25c-4287-a20b-013e2c9c8e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:21.471952 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf414aa3-f25c-4287-a20b-013e2c9c8e8f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:21.472232 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf414aa3-f25c-4287-a20b-013e2c9c8e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:21.472507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf414aa3-f25c-4287-a20b-013e2c9c8e8f None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:21.477099 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf414aa3-f25c-4287-a20b-013e2c9c8e8f None admin] RBAC: Authorizing `identity:get_project(project_id=4bd87b88a6204ecaa0e15f4cb612ef96)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:21.478655 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf414aa3-f25c-4287-a20b-013e2c9c8e8f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:21.481718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-cae116dd-69f2-486c-abf8-d34f115d83bb None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:21.483041 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cae116dd-69f2-486c-abf8-d34f115d83bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:21.486771 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 116/222] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:21 2022] GET /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:21.490070 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf414aa3-f25c-4287-a20b-013e2c9c8e8f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:21.525770 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:21.701328 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 107/223] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:41:21.702402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae116dd-69f2-486c-abf8-d34f115d83bb None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:21.709117 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:21.797667 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf414aa3-f25c-4287-a20b-013e2c9c8e8f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:21.863712 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae116dd-69f2-486c-abf8-d34f115d83bb None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:21.868000 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274547d4-9c6f-4e09-a7f5-ef84c3d01717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:21.869087 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274547d4-9c6f-4e09-a7f5-ef84c3d01717 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:21.869617 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274547d4-9c6f-4e09-a7f5-ef84c3d01717 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:21.870078 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274547d4-9c6f-4e09-a7f5-ef84c3d01717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:21.871006 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274547d4-9c6f-4e09-a7f5-ef84c3d01717 None admin] RBAC: Adding query filter params (role.id=424fdbf5034b4445bf8a3022b9fb8b4c, scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96, user.id=08ef08e124fe45e0acdbbc9aa158880f) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:21.871537 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274547d4-9c6f-4e09-a7f5-ef84c3d01717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:21.873197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274547d4-9c6f-4e09-a7f5-ef84c3d01717 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:21.892350 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 117/224] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:41:21 2022] GET /identity/v3/role_assignments?user.id=08ef08e124fe45e0acdbbc9aa158880f&scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96&role.id=424fdbf5034b4445bf8a3022b9fb8b4c => generated 259 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:21.919768 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1eb7a4-1db3-4f46-b1ad-d00763de3e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:21.920985 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1eb7a4-1db3-4f46-b1ad-d00763de3e94 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:21.921286 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1eb7a4-1db3-4f46-b1ad-d00763de3e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:21.921554 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1eb7a4-1db3-4f46-b1ad-d00763de3e94 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:21.938633 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1eb7a4-1db3-4f46-b1ad-d00763de3e94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:21.943817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-7b1eb7a4-1db3-4f46-b1ad-d00763de3e94 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:21.943817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:21.943817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:21.943817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:21.943817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:21.943817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:21.943817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:21.943817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:21.943817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:21.943817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:21.943817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:21.943817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:21.943817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:21.943817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:21.943817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:21.943817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:21.944808 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:21.944808 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:21.944808 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:21.944808 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:21.944808 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:21.944808 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:21.944808 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:21.944808 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:21.944808 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:21.944808 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:21.944808 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:21.944808 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:21.944808 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:21.944808 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:21.944808 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:21.944808 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:21.946307 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:21.946307 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:21.946307 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:21.946307 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:21.946307 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:21.946307 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:21.946307 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:21.946307 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:21.946307 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:21.946307 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:21.946307 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:21.946307 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:21.946307 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 108/225] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:41:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:21.951465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274547d4-9c6f-4e09-a7f5-ef84c3d01717 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:22.007996 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1eb7a4-1db3-4f46-b1ad-d00763de3e94 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:22.023121 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:22.163193 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274547d4-9c6f-4e09-a7f5-ef84c3d01717 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:22.179348 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1eb7a4-1db3-4f46-b1ad-d00763de3e94 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:22.231874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a49a1e-58e3-4ae1-99b6-89a13e19a952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:22.232527 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a49a1e-58e3-4ae1-99b6-89a13e19a952 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:22.232805 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a49a1e-58e3-4ae1-99b6-89a13e19a952 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:22.233145 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a49a1e-58e3-4ae1-99b6-89a13e19a952 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:22.235535 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:22.248435 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150db87-6253-4f61-a442-dca1326aa2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:22.249695 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150db87-6253-4f61-a442-dca1326aa2bf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:22.249829 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150db87-6253-4f61-a442-dca1326aa2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:22.250177 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150db87-6253-4f61-a442-dca1326aa2bf None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:22.250919 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150db87-6253-4f61-a442-dca1326aa2bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:22.251070 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150db87-6253-4f61-a442-dca1326aa2bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:22.252508 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150db87-6253-4f61-a442-dca1326aa2bf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:22.262741 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a49a1e-58e3-4ae1-99b6-89a13e19a952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:22.265315 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 118/226] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:41:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:22.277664 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150db87-6253-4f61-a442-dca1326aa2bf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:22.284915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-96a49a1e-58e3-4ae1-99b6-89a13e19a952 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:41:22.284915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:22.284915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:22.284915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:22.284915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:22.284915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:22.284915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:22.284915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:22.284915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:22.284915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:22.284915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:22.284915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:22.284915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:22.284915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:22.284915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:22.284915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:22.287029 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:22.287029 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:22.287029 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:22.287029 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:22.287029 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:22.287029 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:22.287029 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:22.287029 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:22.287029 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:22.287029 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:22.287029 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:22.287029 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:22.287029 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:22.287029 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:22.287029 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:22.287029 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:22.288785 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:22.288785 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:22.288785 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:22.288785 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:22.288785 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:22.288785 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:22.288785 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:22.288785 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:22.288785 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:22.288785 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:22.288785 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:41:22.288785 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:22.293041 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 109/227] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:41:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:22.301530 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a49a1e-58e3-4ae1-99b6-89a13e19a952 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:22.499079 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:22.516448 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150db87-6253-4f61-a442-dca1326aa2bf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:22.563887 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c969f-772b-45bb-987b-d48cd5e71f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:22.564691 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c969f-772b-45bb-987b-d48cd5e71f75 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:22.565112 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c969f-772b-45bb-987b-d48cd5e71f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:22.565415 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c969f-772b-45bb-987b-d48cd5e71f75 None admin] PATH_INFO: `/v3/users/7adbf3ac0eba4a548255343f8bb03d51` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:22.566582 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c969f-772b-45bb-987b-d48cd5e71f75 None admin] RBAC: Authorizing `identity:get_user(user_id=7adbf3ac0eba4a548255343f8bb03d51)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:22.568711 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c969f-772b-45bb-987b-d48cd5e71f75 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:22.570731 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 119/228] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:22 2022] GET /identity/v3/users/7adbf3ac0eba4a548255343f8bb03d51 => generated 283 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:22.582635 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c969f-772b-45bb-987b-d48cd5e71f75 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:22.600007 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a49a1e-58e3-4ae1-99b6-89a13e19a952 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:22.662461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:22.689911 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e91ffb-6fd1-47cf-92b8-4266b80f2e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:22.690442 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e91ffb-6fd1-47cf-92b8-4266b80f2e6e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:22.690719 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e91ffb-6fd1-47cf-92b8-4266b80f2e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:22.690984 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e91ffb-6fd1-47cf-92b8-4266b80f2e6e None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:22.691668 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e91ffb-6fd1-47cf-92b8-4266b80f2e6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:22.691971 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e91ffb-6fd1-47cf-92b8-4266b80f2e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:22.696011 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e91ffb-6fd1-47cf-92b8-4266b80f2e6e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:22.715845 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 110/229] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:22.725292 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e91ffb-6fd1-47cf-92b8-4266b80f2e6e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:22.743659 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c969f-772b-45bb-987b-d48cd5e71f75 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:22.788916 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c86f91-b38e-4f5a-8fe8-edab0be53848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:22.790380 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c86f91-b38e-4f5a-8fe8-edab0be53848 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:22.791065 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c86f91-b38e-4f5a-8fe8-edab0be53848 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:22.791737 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c86f91-b38e-4f5a-8fe8-edab0be53848 None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:22.797939 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c86f91-b38e-4f5a-8fe8-edab0be53848 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd87b88a6204ecaa0e15f4cb612ef96)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:22.801453 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c86f91-b38e-4f5a-8fe8-edab0be53848 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:22.815404 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 120/230] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:22 2022] GET /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:22.821482 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c86f91-b38e-4f5a-8fe8-edab0be53848 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:22.941103 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c86f91-b38e-4f5a-8fe8-edab0be53848 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:23.014659 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111f33e-78b4-4339-b05c-eab49b24c699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:23.015520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f33e-78b4-4339-b05c-eab49b24c699 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:23.016019 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f33e-78b4-4339-b05c-eab49b24c699 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:23.016520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f33e-78b4-4339-b05c-eab49b24c699 None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96/users/7adbf3ac0eba4a548255343f8bb03d51/roles/030fcd169fb44f759772ef3101c07012` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:23.020846 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111f33e-78b4-4339-b05c-eab49b24c699 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bd87b88a6204ecaa0e15f4cb612ef96, user_id=7adbf3ac0eba4a548255343f8bb03d51, role_id=030fcd169fb44f759772ef3101c07012)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:23.023730 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111f33e-78b4-4339-b05c-eab49b24c699 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:23.033516 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:23.048249 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e91ffb-6fd1-47cf-92b8-4266b80f2e6e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:23.063372 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 121/231] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:41:22 2022] PUT /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96/users/7adbf3ac0eba4a548255343f8bb03d51/roles/030fcd169fb44f759772ef3101c07012 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:41:23.132825 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:23.152857 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4fd21-d62f-43c9-b5a8-d57a95c6b666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:23.154131 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4fd21-d62f-43c9-b5a8-d57a95c6b666 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:23.154625 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4fd21-d62f-43c9-b5a8-d57a95c6b666 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:23.156255 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4fd21-d62f-43c9-b5a8-d57a95c6b666 None admin] PATH_INFO: `/v3/users/7adbf3ac0eba4a548255343f8bb03d51` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:23.162531 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4fd21-d62f-43c9-b5a8-d57a95c6b666 None admin] RBAC: Authorizing `identity:get_user(user_id=7adbf3ac0eba4a548255343f8bb03d51)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:23.165490 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4fd21-d62f-43c9-b5a8-d57a95c6b666 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:23.169110 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 111/232] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:22 2022] GET /identity/v3/users/7adbf3ac0eba4a548255343f8bb03d51 => generated 283 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:23.175520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111f33e-78b4-4339-b05c-eab49b24c699 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:23.365090 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb8957-9aec-4e5e-93cc-1d3579fa8713 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:23.365322 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb8957-9aec-4e5e-93cc-1d3579fa8713 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:23.365592 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb8957-9aec-4e5e-93cc-1d3579fa8713 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:23.367441 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 112/233] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:41:23.372960 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f48a9-5550-4b77-bbcc-449f722e5fa9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:23.373253 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f48a9-5550-4b77-bbcc-449f722e5fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:23.373709 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f48a9-5550-4b77-bbcc-449f722e5fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:23.409680 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111f33e-78b4-4339-b05c-eab49b24c699 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:23.434698 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-899f48a9-5550-4b77-bbcc-449f722e5fa9 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:23.437306 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-899f48a9-5550-4b77-bbcc-449f722e5fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:23.480861 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414d6a6-2fc8-4193-a2bd-7a26f61b2229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:23.481978 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414d6a6-2fc8-4193-a2bd-7a26f61b2229 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:23.482474 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414d6a6-2fc8-4193-a2bd-7a26f61b2229 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:23.483472 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414d6a6-2fc8-4193-a2bd-7a26f61b2229 None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:23.485488 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414d6a6-2fc8-4193-a2bd-7a26f61b2229 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd87b88a6204ecaa0e15f4cb612ef96)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:23.488294 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414d6a6-2fc8-4193-a2bd-7a26f61b2229 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:23.491394 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 122/234] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:23 2022] GET /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96 => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:23.498502 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414d6a6-2fc8-4193-a2bd-7a26f61b2229 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:23.619603 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 113/235] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:23.643258 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:23.754674 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414d6a6-2fc8-4193-a2bd-7a26f61b2229 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:23.837573 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065906c1-04b8-4321-9262-826de749bcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:23.839271 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065906c1-04b8-4321-9262-826de749bcdb None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:23.840081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065906c1-04b8-4321-9262-826de749bcdb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:23.840809 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065906c1-04b8-4321-9262-826de749bcdb None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96/users/7adbf3ac0eba4a548255343f8bb03d51/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:23.846417 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065906c1-04b8-4321-9262-826de749bcdb None admin] RBAC: Authorizing `identity:create_grant(project_id=4bd87b88a6204ecaa0e15f4cb612ef96, user_id=7adbf3ac0eba4a548255343f8bb03d51, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:23.848032 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065906c1-04b8-4321-9262-826de749bcdb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:23.872600 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 123/236] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:41:23 2022] PUT /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96/users/7adbf3ac0eba4a548255343f8bb03d51/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:41:24.007283 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f48a9-5550-4b77-bbcc-449f722e5fa9 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:24.091397 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0bb8e-fc9b-4e95-bffa-65e4ff92ff83 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:24.091854 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0bb8e-fc9b-4e95-bffa-65e4ff92ff83 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:24.092391 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0bb8e-fc9b-4e95-bffa-65e4ff92ff83 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:24.095564 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 124/237] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:24.105034 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d611b96-901a-40ce-930a-c973f3203d42 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:24.105442 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d611b96-901a-40ce-930a-c973f3203d42 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:24.105926 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d611b96-901a-40ce-930a-c973f3203d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:24.148520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3d611b96-901a-40ce-930a-c973f3203d42 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:24.150723 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3d611b96-901a-40ce-930a-c973f3203d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:24.251402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f48a9-5550-4b77-bbcc-449f722e5fa9 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:24.294647 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:24.296189 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 125/238] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:24.314502 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78659c-c747-4b53-9569-20032cfe7020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:24.315156 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78659c-c747-4b53-9569-20032cfe7020 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:24.315443 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78659c-c747-4b53-9569-20032cfe7020 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:24.315710 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78659c-c747-4b53-9569-20032cfe7020 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:24.328611 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78659c-c747-4b53-9569-20032cfe7020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:24.333872 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-9d78659c-c747-4b53-9569-20032cfe7020 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:41:24.333872 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:24.333872 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:24.333872 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:24.333872 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:24.333872 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:24.333872 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:24.333872 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:24.333872 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:24.333872 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:24.333872 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:24.333872 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:24.333872 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:24.333872 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:24.333872 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:24.333872 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:24.335912 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:24.335912 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:24.335912 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:24.335912 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:24.335912 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:24.335912 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:24.335912 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:24.335912 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:24.335912 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:24.335912 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:24.335912 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:24.335912 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:24.335912 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:24.335912 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:24.335912 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:24.335912 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:24.337666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:24.337666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:24.337666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:24.337666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:24.337666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:24.337666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:24.337666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:24.337666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:24.337666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:24.337666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:24.337666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:41:24.337666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:24.337666 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 114/239] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:24.341293 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d611b96-901a-40ce-930a-c973f3203d42 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:24.435320 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:24.516533 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d611b96-901a-40ce-930a-c973f3203d42 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:24.571780 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8c3b1-0ebd-4605-a9c2-433f6de77cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:24.572425 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8c3b1-0ebd-4605-a9c2-433f6de77cca None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:24.572708 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8c3b1-0ebd-4605-a9c2-433f6de77cca None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:24.573009 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8c3b1-0ebd-4605-a9c2-433f6de77cca None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:24.573715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8c3b1-0ebd-4605-a9c2-433f6de77cca None admin] RBAC: Adding query filter params (name=reader) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:24.574025 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8c3b1-0ebd-4605-a9c2-433f6de77cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:24.575485 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8c3b1-0ebd-4605-a9c2-433f6de77cca None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:24.589937 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 126/240] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:24.596775 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78659c-c747-4b53-9569-20032cfe7020 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:24.794828 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8c3b1-0ebd-4605-a9c2-433f6de77cca None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:24.810348 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78659c-c747-4b53-9569-20032cfe7020 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:24.884581 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5103d-8a13-4900-a39d-89f15947f684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:24.886096 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5103d-8a13-4900-a39d-89f15947f684 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:24.887811 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5103d-8a13-4900-a39d-89f15947f684 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:24.888855 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5103d-8a13-4900-a39d-89f15947f684 None admin] PATH_INFO: `/v3/users/b77c62771c704451ab2c21560f95d12b` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:24.917826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5103d-8a13-4900-a39d-89f15947f684 None admin] RBAC: Authorizing `identity:get_user(user_id=b77c62771c704451ab2c21560f95d12b)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:24.922160 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5103d-8a13-4900-a39d-89f15947f684 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:24.926217 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 115/241] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:24 2022] GET /identity/v3/users/b77c62771c704451ab2c21560f95d12b => generated 297 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:24.936023 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5103d-8a13-4900-a39d-89f15947f684 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:25.078144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:25.111183 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8c3b1-0ebd-4605-a9c2-433f6de77cca None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:25.145504 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:25.190185 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5103d-8a13-4900-a39d-89f15947f684 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:25.231895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58291f51-7711-4e3e-b632-c87f3d63c250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:25.232554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58291f51-7711-4e3e-b632-c87f3d63c250 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:25.234146 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58291f51-7711-4e3e-b632-c87f3d63c250 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:25.234146 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58291f51-7711-4e3e-b632-c87f3d63c250 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:25.235997 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58291f51-7711-4e3e-b632-c87f3d63c250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:25.239175 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58291f51-7711-4e3e-b632-c87f3d63c250 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:25.243248 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 127/242] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:41:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:25.247165 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1542f4d-1bdf-4ebf-9b62-d9661e9b271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:25.247165 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1542f4d-1bdf-4ebf-9b62-d9661e9b271c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:25.247165 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1542f4d-1bdf-4ebf-9b62-d9661e9b271c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:25.247165 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1542f4d-1bdf-4ebf-9b62-d9661e9b271c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:25.248926 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58291f51-7711-4e3e-b632-c87f3d63c250 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:25.344818 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1542f4d-1bdf-4ebf-9b62-d9661e9b271c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:25.346281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1542f4d-1bdf-4ebf-9b62-d9661e9b271c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:25.402307 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:25.485374 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 116/243] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:41:25.491626 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f3971-ba8f-4577-bb05-86afeb6b0f32 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:25.492044 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f3971-ba8f-4577-bb05-86afeb6b0f32 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:25.492435 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f3971-ba8f-4577-bb05-86afeb6b0f32 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:25.494228 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 117/244] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:25.495220 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f3971-ba8f-4577-bb05-86afeb6b0f32 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:25.554667 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58291f51-7711-4e3e-b632-c87f3d63c250 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:25.622824 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff783f-372c-46d8-a6f7-d51a3b78a747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:25.624834 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff783f-372c-46d8-a6f7-d51a3b78a747 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:25.625583 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff783f-372c-46d8-a6f7-d51a3b78a747 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:25.626276 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff783f-372c-46d8-a6f7-d51a3b78a747 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:25.627705 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff783f-372c-46d8-a6f7-d51a3b78a747 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:25.630845 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff783f-372c-46d8-a6f7-d51a3b78a747 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:25.670893 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 128/245] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Oct 2 00:41:25 2022] POST /identity/v3/users => generated 293 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:41:25.673876 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262890ed-885c-4be2-8236-0d5e5fd65d48 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:25.674824 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262890ed-885c-4be2-8236-0d5e5fd65d48 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:25.675658 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262890ed-885c-4be2-8236-0d5e5fd65d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:25.705115 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f3971-ba8f-4577-bb05-86afeb6b0f32 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:25.711049 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-262890ed-885c-4be2-8236-0d5e5fd65d48 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:25.713677 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-262890ed-885c-4be2-8236-0d5e5fd65d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:25.778618 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:25.805126 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8e297-02f6-46b8-ac55-313295f85ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:25.806237 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8e297-02f6-46b8-ac55-313295f85ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:25.806736 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8e297-02f6-46b8-ac55-313295f85ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:25.807228 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8e297-02f6-46b8-ac55-313295f85ad2 None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:25.814607 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8e297-02f6-46b8-ac55-313295f85ad2 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd87b88a6204ecaa0e15f4cb612ef96)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:25.817334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8e297-02f6-46b8-ac55-313295f85ad2 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:25.820800 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 118/246] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:25 2022] GET /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96 => generated 302 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:25.834789 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8e297-02f6-46b8-ac55-313295f85ad2 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:25.857461 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 129/247] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:25.892926 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:26.096501 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8e297-02f6-46b8-ac55-313295f85ad2 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:26.165647 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a1fd4-0706-4126-9c68-9a2f6fb95bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:26.166273 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a1fd4-0706-4126-9c68-9a2f6fb95bbb None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:26.166549 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a1fd4-0706-4126-9c68-9a2f6fb95bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:26.166817 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a1fd4-0706-4126-9c68-9a2f6fb95bbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:26.167552 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a1fd4-0706-4126-9c68-9a2f6fb95bbb None admin] RBAC: Adding query filter params (role.id=f3bcf4f4f01e4fe98ec388ccb5daf537, scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96, user.id=b77c62771c704451ab2c21560f95d12b) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:26.167853 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a1fd4-0706-4126-9c68-9a2f6fb95bbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:26.169379 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a1fd4-0706-4126-9c68-9a2f6fb95bbb None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:26.178707 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 119/248] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:41:25 2022] GET /identity/v3/role_assignments?user.id=b77c62771c704451ab2c21560f95d12b&scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96&role.id=f3bcf4f4f01e4fe98ec388ccb5daf537 => generated 259 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:26.210511 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262890ed-885c-4be2-8236-0d5e5fd65d48 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:26.391870 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262890ed-885c-4be2-8236-0d5e5fd65d48 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:26.458854 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e03369-fcc6-4046-ace7-b97037620a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:26.459442 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e03369-fcc6-4046-ace7-b97037620a71 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:26.459728 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e03369-fcc6-4046-ace7-b97037620a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:26.460006 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e03369-fcc6-4046-ace7-b97037620a71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:26.473239 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e03369-fcc6-4046-ace7-b97037620a71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:26.478467 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c4e03369-fcc6-4046-ace7-b97037620a71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:26.478467 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:26.478467 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:26.478467 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:26.478467 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:26.478467 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:26.478467 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:26.478467 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:26.478467 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:26.478467 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:26.478467 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:26.478467 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:26.478467 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:26.478467 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:26.478467 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:26.478467 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:26.479484 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:26.479484 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:26.479484 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:26.479484 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:26.479484 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:26.479484 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:26.479484 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:26.479484 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:26.479484 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:26.479484 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:26.479484 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:26.479484 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:26.479484 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:26.479484 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:26.479484 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:26.479484 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:26.480577 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:26.480577 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:26.480577 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:26.480577 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:26.480577 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:26.480577 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:26.480577 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:26.480577 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:26.480577 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:26.480577 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:26.480577 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:26.480577 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:26.480577 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 130/249] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:26.490274 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a1fd4-0706-4126-9c68-9a2f6fb95bbb None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:26.505405 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a593f-fbac-4312-b754-3d6d2275fbc1 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:26.505746 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a593f-fbac-4312-b754-3d6d2275fbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:26.505956 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a593f-fbac-4312-b754-3d6d2275fbc1 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:26.507781 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 131/250] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:26.515817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c929df-c2ac-458e-8510-8494518773f7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:26.516193 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c929df-c2ac-458e-8510-8494518773f7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:26.516423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c929df-c2ac-458e-8510-8494518773f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:26.537264 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b2c929df-c2ac-458e-8510-8494518773f7 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:26.538508 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b2c929df-c2ac-458e-8510-8494518773f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:26.562020 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:26.624671 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 132/251] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:41:26.666273 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:26.704147 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a1fd4-0706-4126-9c68-9a2f6fb95bbb None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:26.767759 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622f561-a596-4117-84a3-2b4201d32475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:26.768595 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622f561-a596-4117-84a3-2b4201d32475 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:26.768971 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622f561-a596-4117-84a3-2b4201d32475 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:26.769446 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622f561-a596-4117-84a3-2b4201d32475 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:26.770629 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622f561-a596-4117-84a3-2b4201d32475 None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:26.771149 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622f561-a596-4117-84a3-2b4201d32475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:26.773800 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622f561-a596-4117-84a3-2b4201d32475 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:26.792787 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 120/252] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:26.798982 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c929df-c2ac-458e-8510-8494518773f7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:26.944521 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c929df-c2ac-458e-8510-8494518773f7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:26.985608 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818913cd-fcdb-40f9-bc26-9f8ac9278123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:26.986267 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818913cd-fcdb-40f9-bc26-9f8ac9278123 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:26.986551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818913cd-fcdb-40f9-bc26-9f8ac9278123 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:26.986828 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818913cd-fcdb-40f9-bc26-9f8ac9278123 None admin] PATH_INFO: `/v3/users/08ef08e124fe45e0acdbbc9aa158880f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:26.988080 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818913cd-fcdb-40f9-bc26-9f8ac9278123 None admin] RBAC: Authorizing `identity:get_user(user_id=08ef08e124fe45e0acdbbc9aa158880f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:26.989602 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818913cd-fcdb-40f9-bc26-9f8ac9278123 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:26.991629 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 133/253] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:26 2022] GET /identity/v3/users/08ef08e124fe45e0acdbbc9aa158880f => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:26.998043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622f561-a596-4117-84a3-2b4201d32475 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:27.248892 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47445b4-6fc4-4398-a51d-73b62d604de1 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:27.249351 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47445b4-6fc4-4398-a51d-73b62d604de1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:27.249590 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47445b4-6fc4-4398-a51d-73b62d604de1 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:27.252155 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 134/254] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:27.263078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622f561-a596-4117-84a3-2b4201d32475 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:27.269518 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e652771-8ab8-4b30-b94c-6d6a6652774b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:27.269819 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e652771-8ab8-4b30-b94c-6d6a6652774b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:27.270072 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e652771-8ab8-4b30-b94c-6d6a6652774b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:27.294887 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8e652771-8ab8-4b30-b94c-6d6a6652774b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:27.296798 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8e652771-8ab8-4b30-b94c-6d6a6652774b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:27.333393 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:27.352736 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cac3d-9449-4686-bc9b-8f08577b42d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:27.353435 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cac3d-9449-4686-bc9b-8f08577b42d9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:27.353717 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cac3d-9449-4686-bc9b-8f08577b42d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:27.353992 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cac3d-9449-4686-bc9b-8f08577b42d9 None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:27.358696 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cac3d-9449-4686-bc9b-8f08577b42d9 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd87b88a6204ecaa0e15f4cb612ef96)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:27.360423 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cac3d-9449-4686-bc9b-8f08577b42d9 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:27.362298 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 121/255] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:26 2022] GET /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96 => generated 302 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:27.363149 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cac3d-9449-4686-bc9b-8f08577b42d9 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:27.405661 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:27.444753 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 135/256] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:27.445757 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e652771-8ab8-4b30-b94c-6d6a6652774b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:27.570686 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cac3d-9449-4686-bc9b-8f08577b42d9 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:27.710741 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef63e9-23b9-4130-aecb-6107f73db7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:27.711835 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef63e9-23b9-4130-aecb-6107f73db7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:27.712336 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef63e9-23b9-4130-aecb-6107f73db7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:27.712826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef63e9-23b9-4130-aecb-6107f73db7d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:27.771318 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef63e9-23b9-4130-aecb-6107f73db7d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:27.798329 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e652771-8ab8-4b30-b94c-6d6a6652774b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:27.805659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-9fef63e9-23b9-4130-aecb-6107f73db7d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:27.805659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:27.805659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:27.805659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:27.805659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:27.805659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:27.805659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:27.805659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:27.805659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:27.805659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:27.805659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:27.805659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:27.805659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:27.805659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:27.805659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:27.805659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:27.806603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:27.806603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:27.806603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:27.806603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:27.806603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:27.806603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:27.806603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:27.806603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:27.806603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:27.806603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:27.806603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:27.806603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:27.806603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:27.806603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:27.806603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:27.806603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:27.807389 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:27.807389 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:27.807389 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:27.807389 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:27.807389 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:27.807389 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:27.807389 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:27.807389 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:27.807389 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:27.807389 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:27.807389 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:27.807389 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:27.811459 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 122/257] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:41:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:27.815437 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef63e9-23b9-4130-aecb-6107f73db7d0 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:27.910753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51faa0-c946-4083-9f60-df4d9d7b090f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:27.912047 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51faa0-c946-4083-9f60-df4d9d7b090f None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:27.912551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51faa0-c946-4083-9f60-df4d9d7b090f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:27.913069 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51faa0-c946-4083-9f60-df4d9d7b090f None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96/users/08ef08e124fe45e0acdbbc9aa158880f/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:27.926605 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51faa0-c946-4083-9f60-df4d9d7b090f None admin] RBAC: Authorizing `identity:create_grant(project_id=4bd87b88a6204ecaa0e15f4cb612ef96, user_id=08ef08e124fe45e0acdbbc9aa158880f, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:27.928106 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51faa0-c946-4083-9f60-df4d9d7b090f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:27.953229 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 136/258] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:41:27 2022] PUT /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96/users/08ef08e124fe45e0acdbbc9aa158880f/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:41:27.954161 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51faa0-c946-4083-9f60-df4d9d7b090f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:27.992025 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:27.997211 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:28.071104 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef63e9-23b9-4130-aecb-6107f73db7d0 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:28.127922 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51faa0-c946-4083-9f60-df4d9d7b090f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:28.133600 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b5b44-28fd-421f-b8fc-02e3dc26b20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:28.134287 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b5b44-28fd-421f-b8fc-02e3dc26b20a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:28.134568 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b5b44-28fd-421f-b8fc-02e3dc26b20a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:28.134835 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b5b44-28fd-421f-b8fc-02e3dc26b20a None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:28.135506 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b5b44-28fd-421f-b8fc-02e3dc26b20a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:28.135805 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b5b44-28fd-421f-b8fc-02e3dc26b20a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:28.137243 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b5b44-28fd-421f-b8fc-02e3dc26b20a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:28.157258 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 123/259] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:41:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:28.165924 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b5b44-28fd-421f-b8fc-02e3dc26b20a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:28.174604 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffb016-9984-4098-91a8-968c6c9857f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:28.175633 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffb016-9984-4098-91a8-968c6c9857f1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:28.176138 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffb016-9984-4098-91a8-968c6c9857f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:28.176630 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffb016-9984-4098-91a8-968c6c9857f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:28.191211 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffb016-9984-4098-91a8-968c6c9857f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:28.197486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-faffb016-9984-4098-91a8-968c6c9857f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:41:28.197486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:28.197486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:28.197486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:28.197486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:28.197486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:28.197486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:28.197486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:28.197486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:28.197486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:28.197486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:28.197486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:28.197486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:28.197486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:28.197486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:28.197486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:28.198444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:28.198444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:28.198444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:28.198444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:28.198444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:28.198444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:28.198444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:28.198444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:28.198444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:28.198444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:28.198444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:28.198444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:28.198444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:28.198444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:28.198444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:28.198444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:28.199243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:28.199243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:28.199243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:28.199243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:28.199243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:28.199243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:28.199243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:28.199243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:28.199243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:28.199243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:28.199243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:41:28.199243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:28.202260 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 137/260] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:41:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:28.209134 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffb016-9984-4098-91a8-968c6c9857f1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:28.301096 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:28.338162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffb016-9984-4098-91a8-968c6c9857f1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:28.379429 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83e8b8-ba7d-4fcc-81c9-7dcea82c928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:28.380547 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83e8b8-ba7d-4fcc-81c9-7dcea82c928f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:28.381086 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83e8b8-ba7d-4fcc-81c9-7dcea82c928f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:28.381557 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83e8b8-ba7d-4fcc-81c9-7dcea82c928f None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:28.382438 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83e8b8-ba7d-4fcc-81c9-7dcea82c928f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:28.383076 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83e8b8-ba7d-4fcc-81c9-7dcea82c928f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:28.384743 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83e8b8-ba7d-4fcc-81c9-7dcea82c928f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:28.395293 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 138/261] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:28.402479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83e8b8-ba7d-4fcc-81c9-7dcea82c928f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:28.444319 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b5b44-28fd-421f-b8fc-02e3dc26b20a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:28.494828 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:28.512256 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f5792-4422-400a-8669-dd942b5d0050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:28.513799 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f5792-4422-400a-8669-dd942b5d0050 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:28.514680 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f5792-4422-400a-8669-dd942b5d0050 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:28.515437 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f5792-4422-400a-8669-dd942b5d0050 None admin] PATH_INFO: `/v3/users/7adbf3ac0eba4a548255343f8bb03d51` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:28.517453 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f5792-4422-400a-8669-dd942b5d0050 None admin] RBAC: Authorizing `identity:get_user(user_id=7adbf3ac0eba4a548255343f8bb03d51)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:28.519884 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f5792-4422-400a-8669-dd942b5d0050 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:28.522280 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 124/262] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:28 2022] GET /identity/v3/users/7adbf3ac0eba4a548255343f8bb03d51 => generated 283 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:28.530549 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f5792-4422-400a-8669-dd942b5d0050 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:28.650089 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83e8b8-ba7d-4fcc-81c9-7dcea82c928f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:28.697093 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f5792-4422-400a-8669-dd942b5d0050 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:28.743634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83277225-046d-4778-b479-ddb51df9d7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:28.745013 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83277225-046d-4778-b479-ddb51df9d7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:28.745502 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83277225-046d-4778-b479-ddb51df9d7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:28.745972 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83277225-046d-4778-b479-ddb51df9d7d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:28.787166 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba8f5e-13c6-4a64-b6c4-49a001a3b617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:28.788239 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba8f5e-13c6-4a64-b6c4-49a001a3b617 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:28.788679 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba8f5e-13c6-4a64-b6c4-49a001a3b617 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:28.789153 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba8f5e-13c6-4a64-b6c4-49a001a3b617 None admin] PATH_INFO: `/v3/users/7adbf3ac0eba4a548255343f8bb03d51` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:28.794258 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba8f5e-13c6-4a64-b6c4-49a001a3b617 None admin] RBAC: Authorizing `identity:get_user(user_id=7adbf3ac0eba4a548255343f8bb03d51)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:28.797556 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba8f5e-13c6-4a64-b6c4-49a001a3b617 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:28.804965 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 139/263] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:28 2022] GET /identity/v3/users/7adbf3ac0eba4a548255343f8bb03d51 => generated 283 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:28.816052 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba8f5e-13c6-4a64-b6c4-49a001a3b617 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:28.825205 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:28.841365 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:28.849466 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83277225-046d-4778-b479-ddb51df9d7d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:28.851527 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83277225-046d-4778-b479-ddb51df9d7d1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:29.144045 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba8f5e-13c6-4a64-b6c4-49a001a3b617 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:29.212479 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 125/264] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:41:29.219621 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83277225-046d-4778-b479-ddb51df9d7d1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:29.274151 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adfa1d-01a6-4166-a006-e2616ecc2e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:29.275219 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adfa1d-01a6-4166-a006-e2616ecc2e21 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:29.275719 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adfa1d-01a6-4166-a006-e2616ecc2e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:29.276212 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adfa1d-01a6-4166-a006-e2616ecc2e21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:29.503926 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:29.516754 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83277225-046d-4778-b479-ddb51df9d7d1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:29.543875 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adfa1d-01a6-4166-a006-e2616ecc2e21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:29.547294 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adfa1d-01a6-4166-a006-e2616ecc2e21 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:29.553362 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:29.632700 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c897b-dd7c-484b-9f19-06fb9d48b587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:29.633784 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c897b-dd7c-484b-9f19-06fb9d48b587 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:29.634279 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c897b-dd7c-484b-9f19-06fb9d48b587 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:29.634743 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c897b-dd7c-484b-9f19-06fb9d48b587 None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:29.636736 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c897b-dd7c-484b-9f19-06fb9d48b587 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd87b88a6204ecaa0e15f4cb612ef96)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:29.640417 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c897b-dd7c-484b-9f19-06fb9d48b587 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:29.644325 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 126/265] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:29 2022] GET /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96 => generated 302 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:29.650555 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c897b-dd7c-484b-9f19-06fb9d48b587 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:29.894396 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 140/266] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1079 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:41:29.896278 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f255eb-d85b-4103-a2ab-69c63ac352c0 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:29.897064 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f255eb-d85b-4103-a2ab-69c63ac352c0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:29.897546 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f255eb-d85b-4103-a2ab-69c63ac352c0 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:29.905159 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 141/267] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:29.907061 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f255eb-d85b-4103-a2ab-69c63ac352c0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:30.004129 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c897b-dd7c-484b-9f19-06fb9d48b587 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:30.126928 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19012589-24fc-4ea4-9d3b-b422f1a097a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:30.128368 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19012589-24fc-4ea4-9d3b-b422f1a097a7 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:30.128868 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19012589-24fc-4ea4-9d3b-b422f1a097a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:30.129388 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19012589-24fc-4ea4-9d3b-b422f1a097a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:30.130769 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19012589-24fc-4ea4-9d3b-b422f1a097a7 None admin] RBAC: Adding query filter params (role.id=030fcd169fb44f759772ef3101c07012, scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96, user.id=7adbf3ac0eba4a548255343f8bb03d51) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:30.131321 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19012589-24fc-4ea4-9d3b-b422f1a097a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:30.134089 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19012589-24fc-4ea4-9d3b-b422f1a097a7 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:30.146281 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 127/268] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:41:29 2022] GET /identity/v3/role_assignments?user.id=7adbf3ac0eba4a548255343f8bb03d51&scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96&role.id=030fcd169fb44f759772ef3101c07012 => generated 608 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:30.148545 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ead6b-b3c2-444c-8bf4-28c93717ce67 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:30.149065 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ead6b-b3c2-444c-8bf4-28c93717ce67 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:30.149546 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ead6b-b3c2-444c-8bf4-28c93717ce67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:30.184703 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-215ead6b-b3c2-444c-8bf4-28c93717ce67 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:30.187350 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-215ead6b-b3c2-444c-8bf4-28c93717ce67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:30.270525 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:30.298661 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f255eb-d85b-4103-a2ab-69c63ac352c0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:30.303147 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:30.400077 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 128/269] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:30.401498 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da4f5b-7be5-4a54-9f26-4212ea420449 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:30.401795 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da4f5b-7be5-4a54-9f26-4212ea420449 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:30.402078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da4f5b-7be5-4a54-9f26-4212ea420449 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:30.403638 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 129/270] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:30.410330 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a2d97-5094-49cc-9b62-8fa0ee4d3a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:30.411446 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a2d97-5094-49cc-9b62-8fa0ee4d3a0f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:30.411925 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a2d97-5094-49cc-9b62-8fa0ee4d3a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:30.412624 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a2d97-5094-49cc-9b62-8fa0ee4d3a0f None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:30.418274 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a2d97-5094-49cc-9b62-8fa0ee4d3a0f None admin] RBAC: Authorizing `identity:get_project(project_id=4bd87b88a6204ecaa0e15f4cb612ef96)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:30.421130 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a2d97-5094-49cc-9b62-8fa0ee4d3a0f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:30.424847 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 142/271] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:29 2022] GET /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96 => generated 302 bytes in 518 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:30.433462 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddde06a-980e-4e50-a120-93b1d9c9f9fd None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:30.433755 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddde06a-980e-4e50-a120-93b1d9c9f9fd None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:30.434036 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddde06a-980e-4e50-a120-93b1d9c9f9fd None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:30.435190 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a2d97-5094-49cc-9b62-8fa0ee4d3a0f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:30.435397 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 130/272] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:41:30.442465 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f31b13-5f13-4a50-9beb-19fccc348a16 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:30.442772 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f31b13-5f13-4a50-9beb-19fccc348a16 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:30.443033 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f31b13-5f13-4a50-9beb-19fccc348a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:30.470821 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-14f31b13-5f13-4a50-9beb-19fccc348a16 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:30.473243 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-14f31b13-5f13-4a50-9beb-19fccc348a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:30.612538 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a2d97-5094-49cc-9b62-8fa0ee4d3a0f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:30.663077 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 131/273] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:30.665710 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd44682-1edc-4588-93d8-c1f65825877d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:30.666412 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd44682-1edc-4588-93d8-c1f65825877d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:30.667085 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd44682-1edc-4588-93d8-c1f65825877d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:30.671024 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24a715-4ca0-4544-bfc7-77b4e996519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:30.671777 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24a715-4ca0-4544-bfc7-77b4e996519e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:30.672278 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24a715-4ca0-4544-bfc7-77b4e996519e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:30.672780 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24a715-4ca0-4544-bfc7-77b4e996519e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:30.674220 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24a715-4ca0-4544-bfc7-77b4e996519e None admin] RBAC: Adding query filter params (role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96, user.id=7adbf3ac0eba4a548255343f8bb03d51) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:30.674718 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24a715-4ca0-4544-bfc7-77b4e996519e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:30.676211 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24a715-4ca0-4544-bfc7-77b4e996519e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:30.703931 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 143/274] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:41:30 2022] GET /identity/v3/role_assignments?user.id=7adbf3ac0eba4a548255343f8bb03d51&scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:30.712029 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-cfd44682-1edc-4588-93d8-c1f65825877d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:30.714512 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cfd44682-1edc-4588-93d8-c1f65825877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:30.742328 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24a715-4ca0-4544-bfc7-77b4e996519e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:30.809814 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:30.863144 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 132/275] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:30.974796 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24a715-4ca0-4544-bfc7-77b4e996519e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:31.030520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85103c21-ab49-41e4-909e-ed857457a10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:31.031569 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103c21-ab49-41e4-909e-ed857457a10c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:31.032078 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103c21-ab49-41e4-909e-ed857457a10c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:31.032549 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103c21-ab49-41e4-909e-ed857457a10c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:31.034026 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85103c21-ab49-41e4-909e-ed857457a10c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:31.035796 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85103c21-ab49-41e4-909e-ed857457a10c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:31.042463 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 144/276] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:41:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:31.044267 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd44682-1edc-4588-93d8-c1f65825877d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:31.071196 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:31.176490 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd44682-1edc-4588-93d8-c1f65825877d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:31.223766 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc8936-0a06-46e7-943c-ccf29f3fe6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:31.224789 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc8936-0a06-46e7-943c-ccf29f3fe6f7 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:31.225491 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc8936-0a06-46e7-943c-ccf29f3fe6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:31.225963 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc8936-0a06-46e7-943c-ccf29f3fe6f7 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:31.226833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc8936-0a06-46e7-943c-ccf29f3fe6f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:31.228571 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc8936-0a06-46e7-943c-ccf29f3fe6f7 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:31.246750 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85103c21-ab49-41e4-909e-ed857457a10c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:31.259578 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 133/277] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Oct 2 00:41:31 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:41:31.426418 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc8936-0a06-46e7-943c-ccf29f3fe6f7 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:31.464057 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85103c21-ab49-41e4-909e-ed857457a10c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:31.465975 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:31.506276 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeef62a-c7a5-4348-a9b5-71e47db9ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:31.506849 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeef62a-c7a5-4348-a9b5-71e47db9ade2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:31.507131 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeef62a-c7a5-4348-a9b5-71e47db9ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:31.507404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeef62a-c7a5-4348-a9b5-71e47db9ade2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:31.521784 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeef62a-c7a5-4348-a9b5-71e47db9ade2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:31.527038 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-bdeef62a-c7a5-4348-a9b5-71e47db9ade2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:41:31.527038 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:31.527038 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:31.527038 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:31.527038 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:31.527038 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:31.527038 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:31.527038 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:31.527038 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:31.527038 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:31.527038 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:31.527038 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:31.527038 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:31.527038 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:31.527038 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:31.527038 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:31.528107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:31.528107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:31.528107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:31.528107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:31.528107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:31.528107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:31.528107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:31.528107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:31.528107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:31.528107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:31.528107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:31.528107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:31.528107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:31.528107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:31.528107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:31.528107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:31.528926 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:31.528926 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:31.528926 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:31.528926 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:31.528926 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:31.528926 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:31.528926 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:31.528926 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:31.528926 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:31.528926 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:31.528926 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:41:31.528926 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:31.528926 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 145/278] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:41:31.541664 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeef62a-c7a5-4348-a9b5-71e47db9ade2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:31.564111 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:31.597276 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc8936-0a06-46e7-943c-ccf29f3fe6f7 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:31.673437 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522746c2-4111-4390-b917-c1bd549d1151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:31.674493 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522746c2-4111-4390-b917-c1bd549d1151 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:31.675491 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522746c2-4111-4390-b917-c1bd549d1151 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:31.675903 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522746c2-4111-4390-b917-c1bd549d1151 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:31.692209 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522746c2-4111-4390-b917-c1bd549d1151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:31.697817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-522746c2-4111-4390-b917-c1bd549d1151 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:31.697817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:31.697817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:31.697817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:31.697817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:31.697817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:31.697817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:31.697817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:31.697817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:31.697817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:31.697817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:31.697817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:31.697817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:31.697817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:31.697817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:31.697817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:31.699394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:31.699394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:31.699394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:31.699394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:31.699394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:31.699394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:31.699394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:31.699394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:31.699394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:31.699394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:31.699394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:31.699394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:31.699394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:31.699394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:31.699394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:31.699394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:31.701192 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:31.701192 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:31.701192 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:31.701192 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:31.701192 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:31.701192 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:31.701192 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:31.701192 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:31.701192 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:31.701192 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:31.701192 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:31.701192 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:31.701192 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 134/279] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:41:31.706448 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522746c2-4111-4390-b917-c1bd549d1151 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:31.714711 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeef62a-c7a5-4348-a9b5-71e47db9ade2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:31.762144 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1931d-3bac-467c-a833-11a0467d27e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:31.763614 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1931d-3bac-467c-a833-11a0467d27e5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:31.764723 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1931d-3bac-467c-a833-11a0467d27e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:31.765590 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1931d-3bac-467c-a833-11a0467d27e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:31.769234 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1931d-3bac-467c-a833-11a0467d27e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:31.769689 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1931d-3bac-467c-a833-11a0467d27e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:31.772080 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1931d-3bac-467c-a833-11a0467d27e5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:31.784792 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 146/280] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:31.790270 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1931d-3bac-467c-a833-11a0467d27e5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:31.829584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:31.888373 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522746c2-4111-4390-b917-c1bd549d1151 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:31.932464 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69be5b-474b-4b36-b743-c500a24a3595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:31.933227 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69be5b-474b-4b36-b743-c500a24a3595 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:31.933545 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69be5b-474b-4b36-b743-c500a24a3595 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:31.933888 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69be5b-474b-4b36-b743-c500a24a3595 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:31.934572 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69be5b-474b-4b36-b743-c500a24a3595 None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:31.934879 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69be5b-474b-4b36-b743-c500a24a3595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:31.937065 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69be5b-474b-4b36-b743-c500a24a3595 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:31.939781 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:31.948993 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 135/281] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:31.956523 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69be5b-474b-4b36-b743-c500a24a3595 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:31.961061 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1931d-3bac-467c-a833-11a0467d27e5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:32.015081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139559e-4768-463e-a7d0-acac2476f477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:32.015722 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139559e-4768-463e-a7d0-acac2476f477 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:32.016061 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139559e-4768-463e-a7d0-acac2476f477 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:32.016429 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139559e-4768-463e-a7d0-acac2476f477 None admin] PATH_INFO: `/v3/users/b77c62771c704451ab2c21560f95d12b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:32.017861 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139559e-4768-463e-a7d0-acac2476f477 None admin] RBAC: Authorizing `identity:get_user(user_id=b77c62771c704451ab2c21560f95d12b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:32.019504 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139559e-4768-463e-a7d0-acac2476f477 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:32.021607 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 147/282] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:31 2022] GET /identity/v3/users/b77c62771c704451ab2c21560f95d12b => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:32.028829 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139559e-4768-463e-a7d0-acac2476f477 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:32.156055 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69be5b-474b-4b36-b743-c500a24a3595 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:32.195158 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:32.207851 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139559e-4768-463e-a7d0-acac2476f477 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:32.222437 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05368678-23ca-4238-a672-63035cec7a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:32.223091 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05368678-23ca-4238-a672-63035cec7a90 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:32.223369 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05368678-23ca-4238-a672-63035cec7a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:32.223640 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05368678-23ca-4238-a672-63035cec7a90 None admin] PATH_INFO: `/v3/users/df65aa7094ed4acca30e06264274bf46` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:32.255891 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05368678-23ca-4238-a672-63035cec7a90 None admin] RBAC: Authorizing `identity:get_user(user_id=df65aa7094ed4acca30e06264274bf46)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:32.259783 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05368678-23ca-4238-a672-63035cec7a90 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:32.264176 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 136/283] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:31 2022] GET /identity/v3/users/df65aa7094ed4acca30e06264274bf46 => generated 293 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:32.266792 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f4e79-b905-4faa-81d3-ef8ff5f56676 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:32.267212 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f4e79-b905-4faa-81d3-ef8ff5f56676 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:32.267699 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f4e79-b905-4faa-81d3-ef8ff5f56676 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:32.271281 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 137/284] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:32.276620 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f4e79-b905-4faa-81d3-ef8ff5f56676 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:32.286976 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754126d-b997-457b-bab0-0eddf669a42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:32.288523 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754126d-b997-457b-bab0-0eddf669a42e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:32.289410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754126d-b997-457b-bab0-0eddf669a42e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:32.290158 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754126d-b997-457b-bab0-0eddf669a42e None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:32.293478 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754126d-b997-457b-bab0-0eddf669a42e None admin] RBAC: Authorizing `identity:get_project(project_id=4bd87b88a6204ecaa0e15f4cb612ef96)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:32.298943 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754126d-b997-457b-bab0-0eddf669a42e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:32.302974 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 148/285] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:32 2022] GET /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:32.305888 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5d9fb-1cb5-4a23-bb22-c54ffabe8f0b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:32.307059 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5d9fb-1cb5-4a23-bb22-c54ffabe8f0b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:32.308104 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5d9fb-1cb5-4a23-bb22-c54ffabe8f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:32.340976 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-17f5d9fb-1cb5-4a23-bb22-c54ffabe8f0b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:32.343331 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-17f5d9fb-1cb5-4a23-bb22-c54ffabe8f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:32.381866 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:32.423679 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 149/286] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:32.428972 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5d9fb-1cb5-4a23-bb22-c54ffabe8f0b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:32.443390 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f4e79-b905-4faa-81d3-ef8ff5f56676 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:32.496363 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e78ee8-8bd6-48c8-9c1d-48bdb41ef978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:32.497388 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e78ee8-8bd6-48c8-9c1d-48bdb41ef978 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:32.497830 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e78ee8-8bd6-48c8-9c1d-48bdb41ef978 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:32.500975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e78ee8-8bd6-48c8-9c1d-48bdb41ef978 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:32.500975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e78ee8-8bd6-48c8-9c1d-48bdb41ef978 None admin] RBAC: Adding query filter params (role.id=424fdbf5034b4445bf8a3022b9fb8b4c, user.id=df65aa7094ed4acca30e06264274bf46, scope.system=all) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:32.500975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e78ee8-8bd6-48c8-9c1d-48bdb41ef978 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:32.502879 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e78ee8-8bd6-48c8-9c1d-48bdb41ef978 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:32.512563 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 138/287] 10.222.0.26 () {56 vars in 1308 bytes} [Sun Oct 2 00:41:32 2022] GET /identity/v3/role_assignments?user.id=df65aa7094ed4acca30e06264274bf46&scope.system=all&role.id=424fdbf5034b4445bf8a3022b9fb8b4c => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:32.620891 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:32.635237 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5d9fb-1cb5-4a23-bb22-c54ffabe8f0b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:32.678969 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f88f41-ff04-4ad7-9f5c-f14b8429b3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:32.679666 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f88f41-ff04-4ad7-9f5c-f14b8429b3b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:32.679946 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f88f41-ff04-4ad7-9f5c-f14b8429b3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:32.680221 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f88f41-ff04-4ad7-9f5c-f14b8429b3b3 None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96/users/b77c62771c704451ab2c21560f95d12b/roles/f3bcf4f4f01e4fe98ec388ccb5daf537` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:32.682493 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f88f41-ff04-4ad7-9f5c-f14b8429b3b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bd87b88a6204ecaa0e15f4cb612ef96, user_id=b77c62771c704451ab2c21560f95d12b, role_id=f3bcf4f4f01e4fe98ec388ccb5daf537)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:32.684015 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f88f41-ff04-4ad7-9f5c-f14b8429b3b3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:32.711858 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 150/288] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:41:32 2022] PUT /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96/users/b77c62771c704451ab2c21560f95d12b/roles/f3bcf4f4f01e4fe98ec388ccb5daf537 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:41:32.828188 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e78ee8-8bd6-48c8-9c1d-48bdb41ef978 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:32.985823 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e78ee8-8bd6-48c8-9c1d-48bdb41ef978 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:33.012462 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:33.030959 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68096f30-5c6b-413b-b8c5-e7e24db0b323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:33.031634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68096f30-5c6b-413b-b8c5-e7e24db0b323 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:33.031913 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68096f30-5c6b-413b-b8c5-e7e24db0b323 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:33.032184 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68096f30-5c6b-413b-b8c5-e7e24db0b323 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:33.045876 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68096f30-5c6b-413b-b8c5-e7e24db0b323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:33.051447 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-68096f30-5c6b-413b-b8c5-e7e24db0b323 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:33.051447 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:33.051447 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:33.051447 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:33.051447 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:33.051447 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:33.051447 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:33.051447 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:33.051447 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:33.051447 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:33.051447 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:33.051447 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:33.051447 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:33.051447 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:33.051447 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:33.051447 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:33.053313 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:33.053313 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:33.053313 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:33.053313 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:33.053313 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:33.053313 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:33.053313 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:33.053313 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:33.053313 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:33.053313 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:33.053313 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:33.053313 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:33.053313 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:33.053313 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:33.053313 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:33.053313 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:33.054368 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:33.054368 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:33.054368 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:33.054368 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:33.054368 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:33.054368 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:33.054368 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:33.054368 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:33.054368 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:33.054368 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:33.054368 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:33.054368 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:33.054368 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 139/289] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:41:33.059355 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f88f41-ff04-4ad7-9f5c-f14b8429b3b3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:33.200653 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f88f41-ff04-4ad7-9f5c-f14b8429b3b3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:33.254525 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a86456-d899-405f-9a1e-d3eaacdf4222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:33.255610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a86456-d899-405f-9a1e-d3eaacdf4222 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:33.256032 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a86456-d899-405f-9a1e-d3eaacdf4222 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:33.256441 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a86456-d899-405f-9a1e-d3eaacdf4222 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:33.257299 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a86456-d899-405f-9a1e-d3eaacdf4222 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:33.257744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a86456-d899-405f-9a1e-d3eaacdf4222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:33.259341 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a86456-d899-405f-9a1e-d3eaacdf4222 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:33.270587 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 151/290] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:33.276610 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68096f30-5c6b-413b-b8c5-e7e24db0b323 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:33.469211 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68096f30-5c6b-413b-b8c5-e7e24db0b323 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:33.571769 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316391d-9834-4d7c-b2f8-300d9ca5ec76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:33.572780 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316391d-9834-4d7c-b2f8-300d9ca5ec76 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:33.573318 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316391d-9834-4d7c-b2f8-300d9ca5ec76 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:33.573806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316391d-9834-4d7c-b2f8-300d9ca5ec76 None admin] PATH_INFO: `/v3/users/08ef08e124fe45e0acdbbc9aa158880f` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:33.582422 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316391d-9834-4d7c-b2f8-300d9ca5ec76 None admin] RBAC: Authorizing `identity:get_user(user_id=08ef08e124fe45e0acdbbc9aa158880f)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:33.585134 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316391d-9834-4d7c-b2f8-300d9ca5ec76 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:33.588745 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 140/291] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:33 2022] GET /identity/v3/users/08ef08e124fe45e0acdbbc9aa158880f => generated 297 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:33.598330 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a86456-d899-405f-9a1e-d3eaacdf4222 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:33.628010 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:33.779517 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a86456-d899-405f-9a1e-d3eaacdf4222 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:33.830378 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8b2c9-cd63-46f3-add4-98d20b790d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:33.830928 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8b2c9-cd63-46f3-add4-98d20b790d98 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:33.831211 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8b2c9-cd63-46f3-add4-98d20b790d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:33.831483 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8b2c9-cd63-46f3-add4-98d20b790d98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:33.937734 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8b2c9-cd63-46f3-add4-98d20b790d98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:33.939614 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8b2c9-cd63-46f3-add4-98d20b790d98 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:33.964705 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:34.093163 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 152/292] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:41:34.099033 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316391d-9834-4d7c-b2f8-300d9ca5ec76 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:34.209482 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:34.278728 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316391d-9834-4d7c-b2f8-300d9ca5ec76 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:34.318569 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcffdf2-d850-4488-ae9f-d05c14f4b6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:34.319215 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcffdf2-d850-4488-ae9f-d05c14f4b6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:34.319490 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcffdf2-d850-4488-ae9f-d05c14f4b6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:34.319758 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcffdf2-d850-4488-ae9f-d05c14f4b6a5 None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:34.320975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcffdf2-d850-4488-ae9f-d05c14f4b6a5 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd87b88a6204ecaa0e15f4cb612ef96)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:34.322495 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcffdf2-d850-4488-ae9f-d05c14f4b6a5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:34.324611 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 141/293] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:34 2022] GET /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:34.331182 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8b2c9-cd63-46f3-add4-98d20b790d98 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:34.516127 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8b2c9-cd63-46f3-add4-98d20b790d98 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:34.549357 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:34.580693 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7a054-883d-4921-ac6a-24495dce134f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:34.581740 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7a054-883d-4921-ac6a-24495dce134f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:34.582217 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7a054-883d-4921-ac6a-24495dce134f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:34.582689 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7a054-883d-4921-ac6a-24495dce134f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:34.584056 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7a054-883d-4921-ac6a-24495dce134f None admin] RBAC: Adding query filter params (role.id=424fdbf5034b4445bf8a3022b9fb8b4c, scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96, user.id=08ef08e124fe45e0acdbbc9aa158880f) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:34.584578 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7a054-883d-4921-ac6a-24495dce134f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:34.587301 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7a054-883d-4921-ac6a-24495dce134f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:34.599750 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 153/294] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:41:34 2022] GET /identity/v3/role_assignments?user.id=08ef08e124fe45e0acdbbc9aa158880f&scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96&role.id=424fdbf5034b4445bf8a3022b9fb8b4c => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:34.839500 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3beb4c-af27-4751-8f2f-8a3c3f8e7f89 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:34.840487 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3beb4c-af27-4751-8f2f-8a3c3f8e7f89 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:34.841092 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3beb4c-af27-4751-8f2f-8a3c3f8e7f89 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:34.843947 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 142/295] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:34.850148 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d142e-fdb1-426b-aeb1-e49a4f179685 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:34.851146 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d142e-fdb1-426b-aeb1-e49a4f179685 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:34.851632 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d142e-fdb1-426b-aeb1-e49a4f179685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:34.882130 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-985d142e-fdb1-426b-aeb1-e49a4f179685 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:34.883757 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-985d142e-fdb1-426b-aeb1-e49a4f179685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:34.986620 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 154/296] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:35.083428 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ee90e-db31-4084-84a9-71c2208a3185 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:35.083722 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ee90e-db31-4084-84a9-71c2208a3185 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:35.083978 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ee90e-db31-4084-84a9-71c2208a3185 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:35.085414 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 143/297] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:35.091223 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d81e2-6ea5-46e1-8e50-735679ddd357 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:35.091506 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d81e2-6ea5-46e1-8e50-735679ddd357 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:35.091715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d81e2-6ea5-46e1-8e50-735679ddd357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:35.116713 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-fd6d81e2-6ea5-46e1-8e50-735679ddd357 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:35.117987 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fd6d81e2-6ea5-46e1-8e50-735679ddd357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:35.272869 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 155/298] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:35.303796 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ee90e-db31-4084-84a9-71c2208a3185 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:35.429999 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ee90e-db31-4084-84a9-71c2208a3185 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:35.453398 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:35.475219 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b15132-74e2-4e27-b0ed-3be67e1ebf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:35.475928 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b15132-74e2-4e27-b0ed-3be67e1ebf92 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:35.476205 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b15132-74e2-4e27-b0ed-3be67e1ebf92 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:35.476479 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b15132-74e2-4e27-b0ed-3be67e1ebf92 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:35.489582 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b15132-74e2-4e27-b0ed-3be67e1ebf92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:35.495019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-62b15132-74e2-4e27-b0ed-3be67e1ebf92 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:41:35.495019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:35.495019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:35.495019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:35.495019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:35.495019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:35.495019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:35.495019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:35.495019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:35.495019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:35.495019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:35.495019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:35.495019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:35.495019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:35.495019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:35.495019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:35.496789 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:35.496789 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:35.496789 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:35.496789 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:35.496789 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:35.496789 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:35.496789 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:35.496789 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:35.496789 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:35.496789 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:35.496789 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:35.496789 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:35.496789 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:35.496789 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:35.496789 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:35.496789 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:35.498468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:35.498468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:35.498468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:35.498468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:35.498468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:35.498468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:35.498468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:35.498468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:35.498468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:35.498468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:35.498468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:41:35.498468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:35.498468 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 144/299] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:35.503044 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d81e2-6ea5-46e1-8e50-735679ddd357 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:35.543090 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:35.573446 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b15132-74e2-4e27-b0ed-3be67e1ebf92 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:35.629335 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d81e2-6ea5-46e1-8e50-735679ddd357 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:35.687097 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fe7a3-155d-4783-b215-5e09f3c673b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:35.687643 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fe7a3-155d-4783-b215-5e09f3c673b7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:35.688147 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fe7a3-155d-4783-b215-5e09f3c673b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:35.688642 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fe7a3-155d-4783-b215-5e09f3c673b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:35.689976 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fe7a3-155d-4783-b215-5e09f3c673b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:35.690536 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fe7a3-155d-4783-b215-5e09f3c673b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:35.693444 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fe7a3-155d-4783-b215-5e09f3c673b7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:35.710564 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 156/300] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:35.718335 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fe7a3-155d-4783-b215-5e09f3c673b7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:35.730684 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b15132-74e2-4e27-b0ed-3be67e1ebf92 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:35.775269 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2498286-3506-48f3-a74b-43c71dc313b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:35.775901 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2498286-3506-48f3-a74b-43c71dc313b1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:35.776179 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2498286-3506-48f3-a74b-43c71dc313b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:35.776454 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2498286-3506-48f3-a74b-43c71dc313b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:35.777621 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2498286-3506-48f3-a74b-43c71dc313b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:35.780440 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2498286-3506-48f3-a74b-43c71dc313b1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:35.786270 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 145/301] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:41:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:35.787768 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2498286-3506-48f3-a74b-43c71dc313b1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:35.835498 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:35.840298 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fe7a3-155d-4783-b215-5e09f3c673b7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:35.845803 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:35.884159 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25738f-3687-426f-a7f8-bf39f8bc761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:35.885154 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25738f-3687-426f-a7f8-bf39f8bc761e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:35.885464 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25738f-3687-426f-a7f8-bf39f8bc761e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:35.885857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25738f-3687-426f-a7f8-bf39f8bc761e None admin] PATH_INFO: `/v3/users/d1c9d9d78e834de1aa8bb87c67994be0` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:35.906885 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25738f-3687-426f-a7f8-bf39f8bc761e None admin] RBAC: Authorizing `identity:get_user(user_id=d1c9d9d78e834de1aa8bb87c67994be0)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:35.908361 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25738f-3687-426f-a7f8-bf39f8bc761e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:35.910132 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 157/302] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:35 2022] GET /identity/v3/users/d1c9d9d78e834de1aa8bb87c67994be0 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:35.911252 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2498286-3506-48f3-a74b-43c71dc313b1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:35.914588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b54f1e-5068-422f-b4e2-b832a4e09622 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:35.916981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b54f1e-5068-422f-b4e2-b832a4e09622 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:35.916981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b54f1e-5068-422f-b4e2-b832a4e09622 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:35.918995 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 158/303] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:35.923857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b54f1e-5068-422f-b4e2-b832a4e09622 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:35.983487 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bc7b3-c543-4e28-b5ec-2758271c4e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:35.984831 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bc7b3-c543-4e28-b5ec-2758271c4e70 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:35.985521 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bc7b3-c543-4e28-b5ec-2758271c4e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:35.986008 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bc7b3-c543-4e28-b5ec-2758271c4e70 None admin] PATH_INFO: `/v3/groups` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:35.987219 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5bc7b3-c543-4e28-b5ec-2758271c4e70 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:35.990428 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5bc7b3-c543-4e28-b5ec-2758271c4e70 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:36.019058 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 146/304] 10.222.0.26 () {60 vars in 1134 bytes} [Sun Oct 2 00:41:35 2022] POST /identity/v3/groups => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:41:36.021420 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799f76f-a1ee-4e53-b09b-4fdf1ab5cc6e None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:36.021910 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799f76f-a1ee-4e53-b09b-4fdf1ab5cc6e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:36.022383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799f76f-a1ee-4e53-b09b-4fdf1ab5cc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:36.046896 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b54f1e-5068-422f-b4e2-b832a4e09622 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:36.056533 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8799f76f-a1ee-4e53-b09b-4fdf1ab5cc6e None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:36.058719 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8799f76f-a1ee-4e53-b09b-4fdf1ab5cc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:36.096303 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21a406-f2fc-43d6-b168-e509bde720a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:36.097521 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21a406-f2fc-43d6-b168-e509bde720a9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:36.098640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21a406-f2fc-43d6-b168-e509bde720a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:36.099191 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21a406-f2fc-43d6-b168-e509bde720a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:36.100346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21a406-f2fc-43d6-b168-e509bde720a9 None admin] RBAC: Adding query filter params (role.id=f3bcf4f4f01e4fe98ec388ccb5daf537, user.id=d1c9d9d78e834de1aa8bb87c67994be0, scope.system=all) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:36.100963 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21a406-f2fc-43d6-b168-e509bde720a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:36.102944 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21a406-f2fc-43d6-b168-e509bde720a9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:36.117656 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 159/305] 10.222.0.26 () {56 vars in 1308 bytes} [Sun Oct 2 00:41:35 2022] GET /identity/v3/role_assignments?user.id=d1c9d9d78e834de1aa8bb87c67994be0&scope.system=all&role.id=f3bcf4f4f01e4fe98ec388ccb5daf537 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:36.187397 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 147/306] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:36.296377 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baa4d1-e284-4446-8c52-2d32105709e8 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:36.296754 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baa4d1-e284-4446-8c52-2d32105709e8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:36.297262 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baa4d1-e284-4446-8c52-2d32105709e8 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:36.300170 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 160/307] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:36.309441 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c08c1e-c1ae-454b-9963-fcb36480f880 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:36.309900 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c08c1e-c1ae-454b-9963-fcb36480f880 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:36.310358 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c08c1e-c1ae-454b-9963-fcb36480f880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:36.342290 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a2c08c1e-c1ae-454b-9963-fcb36480f880 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:36.344461 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a2c08c1e-c1ae-454b-9963-fcb36480f880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:36.404745 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:36.491769 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 148/308] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:36.558030 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26baa4d1-e284-4446-8c52-2d32105709e8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:36.598594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:36.746176 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26baa4d1-e284-4446-8c52-2d32105709e8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:36.805436 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9466cb8-82bb-4515-af79-901559736192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:36.806104 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9466cb8-82bb-4515-af79-901559736192 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:36.806377 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9466cb8-82bb-4515-af79-901559736192 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:36.806645 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9466cb8-82bb-4515-af79-901559736192 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:36.820001 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9466cb8-82bb-4515-af79-901559736192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:36.825439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-b9466cb8-82bb-4515-af79-901559736192 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:41:36.825439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:36.825439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:36.825439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:36.825439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:36.825439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:36.825439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:36.825439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:36.825439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:36.825439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:36.825439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:36.825439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:36.825439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:36.825439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:36.825439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:36.825439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:36.827591 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:36.827591 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:36.827591 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:36.827591 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:36.827591 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:36.827591 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:36.827591 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:36.827591 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:36.827591 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:36.827591 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:36.827591 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:36.827591 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:36.827591 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:36.827591 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:36.827591 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:36.827591 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:36.828414 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:36.828414 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:36.828414 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:36.828414 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:36.828414 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:36.828414 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:36.828414 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:36.828414 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:36.828414 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:36.828414 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:36.828414 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:41:36.828414 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:36.828414 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 161/309] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:36.836927 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c08c1e-c1ae-454b-9963-fcb36480f880 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:37.037499 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c08c1e-c1ae-454b-9963-fcb36480f880 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:37.039581 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9466cb8-82bb-4515-af79-901559736192 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:37.106157 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908be9b7-91af-4b8f-851e-69139f50ebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:37.107130 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908be9b7-91af-4b8f-851e-69139f50ebab None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:37.108087 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908be9b7-91af-4b8f-851e-69139f50ebab None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:37.108588 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908be9b7-91af-4b8f-851e-69139f50ebab None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:37.109836 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908be9b7-91af-4b8f-851e-69139f50ebab None admin] RBAC: Adding query filter params (name=reader) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:37.110384 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908be9b7-91af-4b8f-851e-69139f50ebab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:37.113107 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908be9b7-91af-4b8f-851e-69139f50ebab None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:37.130890 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 149/310] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:37.141322 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908be9b7-91af-4b8f-851e-69139f50ebab None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:37.204851 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:37.213390 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:37.245118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9466cb8-82bb-4515-af79-901559736192 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:37.318437 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6ceaf-f841-46a0-8096-6260cc6c3f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:37.319537 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ceaf-f841-46a0-8096-6260cc6c3f50 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:37.320905 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ceaf-f841-46a0-8096-6260cc6c3f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:37.321459 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ceaf-f841-46a0-8096-6260cc6c3f50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:37.343674 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908be9b7-91af-4b8f-851e-69139f50ebab None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:37.344210 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6ceaf-f841-46a0-8096-6260cc6c3f50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:37.357357 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f9b6ceaf-f841-46a0-8096-6260cc6c3f50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:37.357357 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:37.357357 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:37.357357 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:37.357357 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:37.357357 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:37.357357 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:37.357357 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:37.357357 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:37.357357 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:37.357357 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:37.357357 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:37.357357 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:37.357357 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:37.357357 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:37.357357 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:37.359104 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:37.359104 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:37.359104 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:37.359104 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:37.359104 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:37.359104 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:37.359104 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:37.359104 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:37.359104 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:37.359104 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:37.359104 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:37.359104 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:37.359104 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:37.359104 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:37.359104 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:37.359104 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:37.360584 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:37.360584 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:37.360584 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:37.360584 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:37.360584 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:37.360584 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:37.360584 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:37.360584 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:37.360584 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:37.360584 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:37.360584 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:37.360584 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:37.365321 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 162/311] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:37.370831 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6ceaf-f841-46a0-8096-6260cc6c3f50 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:37.410331 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e291556-d200-4e85-af34-688d79ea3af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:37.411851 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e291556-d200-4e85-af34-688d79ea3af4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:37.412626 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e291556-d200-4e85-af34-688d79ea3af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:37.413447 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e291556-d200-4e85-af34-688d79ea3af4 None admin] PATH_INFO: `/v3/users/b77c62771c704451ab2c21560f95d12b` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:37.415613 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e291556-d200-4e85-af34-688d79ea3af4 None admin] RBAC: Authorizing `identity:get_user(user_id=b77c62771c704451ab2c21560f95d12b)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:37.418707 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e291556-d200-4e85-af34-688d79ea3af4 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:37.421872 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 150/312] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:37 2022] GET /identity/v3/users/b77c62771c704451ab2c21560f95d12b => generated 297 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:37.431654 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e291556-d200-4e85-af34-688d79ea3af4 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:37.597252 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6ceaf-f841-46a0-8096-6260cc6c3f50 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:37.656839 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:37.671233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e291556-d200-4e85-af34-688d79ea3af4 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:37.682531 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44423c-543b-4f1d-adf1-503fcff647fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:37.683947 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44423c-543b-4f1d-adf1-503fcff647fd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:37.684633 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44423c-543b-4f1d-adf1-503fcff647fd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:37.686289 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44423c-543b-4f1d-adf1-503fcff647fd None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:37.687754 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44423c-543b-4f1d-adf1-503fcff647fd None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:37.688372 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44423c-543b-4f1d-adf1-503fcff647fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:37.692757 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44423c-543b-4f1d-adf1-503fcff647fd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:37.712844 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 163/313] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:37.723213 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44423c-543b-4f1d-adf1-503fcff647fd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:37.727757 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:37.742584 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9815371-2b79-4c0a-9845-016842be6464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:37.743728 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9815371-2b79-4c0a-9845-016842be6464 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:37.744475 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9815371-2b79-4c0a-9845-016842be6464 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:37.745059 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9815371-2b79-4c0a-9845-016842be6464 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:37.870066 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9815371-2b79-4c0a-9845-016842be6464 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:37.872734 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9815371-2b79-4c0a-9845-016842be6464 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:37.949505 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44423c-543b-4f1d-adf1-503fcff647fd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:38.027592 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6e1b9-6823-48c1-87fb-a9bcd08a8fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:38.030495 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6e1b9-6823-48c1-87fb-a9bcd08a8fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:38.031431 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6e1b9-6823-48c1-87fb-a9bcd08a8fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:38.032102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6e1b9-6823-48c1-87fb-a9bcd08a8fd6 None admin] PATH_INFO: `/v3/users/df65aa7094ed4acca30e06264274bf46` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:38.034505 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6e1b9-6823-48c1-87fb-a9bcd08a8fd6 None admin] RBAC: Authorizing `identity:get_user(user_id=df65aa7094ed4acca30e06264274bf46)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:38.038755 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6e1b9-6823-48c1-87fb-a9bcd08a8fd6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:38.043456 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 164/314] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:37 2022] GET /identity/v3/users/df65aa7094ed4acca30e06264274bf46 => generated 293 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:38.053599 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6e1b9-6823-48c1-87fb-a9bcd08a8fd6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:38.054882 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:38.071586 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 151/315] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:41:38.079441 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9815371-2b79-4c0a-9845-016842be6464 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:38.180654 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:38.244264 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6e1b9-6823-48c1-87fb-a9bcd08a8fd6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:38.262089 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9815371-2b79-4c0a-9845-016842be6464 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:38.309500 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86d45a-4991-4216-9fc7-0258298b41fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:38.311104 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86d45a-4991-4216-9fc7-0258298b41fa None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:38.311759 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86d45a-4991-4216-9fc7-0258298b41fa None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:38.312291 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86d45a-4991-4216-9fc7-0258298b41fa None admin] PATH_INFO: `/v3/system/users/df65aa7094ed4acca30e06264274bf46/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:38.315257 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86d45a-4991-4216-9fc7-0258298b41fa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=df65aa7094ed4acca30e06264274bf46, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:38.317994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86d45a-4991-4216-9fc7-0258298b41fa None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:38.336083 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 165/316] 10.222.0.26 () {58 vars in 1334 bytes} [Sun Oct 2 00:41:38 2022] PUT /identity/v3/system/users/df65aa7094ed4acca30e06264274bf46/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:41:38.344659 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977b64c-0cd8-4176-9472-79fa477d14ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:38.345720 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977b64c-0cd8-4176-9472-79fa477d14ff None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:38.346200 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977b64c-0cd8-4176-9472-79fa477d14ff None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:38.346847 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977b64c-0cd8-4176-9472-79fa477d14ff None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:38.349398 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977b64c-0cd8-4176-9472-79fa477d14ff None admin] RBAC: Authorizing `identity:get_project(project_id=4bd87b88a6204ecaa0e15f4cb612ef96)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:38.352487 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977b64c-0cd8-4176-9472-79fa477d14ff None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:38.356901 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 152/317] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:38 2022] GET /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96 => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:38.367992 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86d45a-4991-4216-9fc7-0258298b41fa None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:38.434229 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dd0c4-1e6b-4a64-ab4d-17b90780196d None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:38.434492 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dd0c4-1e6b-4a64-ab4d-17b90780196d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:38.434659 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dd0c4-1e6b-4a64-ab4d-17b90780196d None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:38.440684 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 153/318] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:41:38.442697 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe994e88-09f3-4382-a76c-c8065410e7f7 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:38.443032 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe994e88-09f3-4382-a76c-c8065410e7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:38.443411 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe994e88-09f3-4382-a76c-c8065410e7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:38.464801 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-fe994e88-09f3-4382-a76c-c8065410e7f7 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:38.466235 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fe994e88-09f3-4382-a76c-c8065410e7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:38.565304 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:38.582578 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 154/319] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:38.604820 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86d45a-4991-4216-9fc7-0258298b41fa None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:38.671225 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd011cbc-9ac2-46cd-b3c3-fc73a436b1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:38.672338 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd011cbc-9ac2-46cd-b3c3-fc73a436b1af None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:38.672827 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd011cbc-9ac2-46cd-b3c3-fc73a436b1af None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:38.673357 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd011cbc-9ac2-46cd-b3c3-fc73a436b1af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:38.674761 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd011cbc-9ac2-46cd-b3c3-fc73a436b1af None admin] RBAC: Adding query filter params (role.id=f3bcf4f4f01e4fe98ec388ccb5daf537, scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96, user.id=b77c62771c704451ab2c21560f95d12b) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:38.675321 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd011cbc-9ac2-46cd-b3c3-fc73a436b1af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:38.678192 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd011cbc-9ac2-46cd-b3c3-fc73a436b1af None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:38.681709 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:38.691951 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 166/320] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:41:38 2022] GET /identity/v3/role_assignments?user.id=b77c62771c704451ab2c21560f95d12b&scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96&role.id=f3bcf4f4f01e4fe98ec388ccb5daf537 => generated 608 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:38.807696 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df596f-ab37-40ef-b65e-3640860c0af0 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:38.808195 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df596f-ab37-40ef-b65e-3640860c0af0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:38.808689 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df596f-ab37-40ef-b65e-3640860c0af0 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:38.813161 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 155/321] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:38.825530 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b46b7-1b0c-45b9-a9f4-6896804cf58a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:38.826203 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b46b7-1b0c-45b9-a9f4-6896804cf58a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:38.826694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b46b7-1b0c-45b9-a9f4-6896804cf58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:38.848568 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-642b46b7-1b0c-45b9-a9f4-6896804cf58a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:38.850226 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-642b46b7-1b0c-45b9-a9f4-6896804cf58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:38.865407 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df596f-ab37-40ef-b65e-3640860c0af0 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:38.954814 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 167/322] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:41:39.010018 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df596f-ab37-40ef-b65e-3640860c0af0 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:39.076766 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbc754-f64a-47bb-b9f2-9794a82955e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:39.077997 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbc754-f64a-47bb-b9f2-9794a82955e9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:39.078466 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbc754-f64a-47bb-b9f2-9794a82955e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:39.079023 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbc754-f64a-47bb-b9f2-9794a82955e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:39.081125 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbc754-f64a-47bb-b9f2-9794a82955e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:39.083814 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbc754-f64a-47bb-b9f2-9794a82955e9 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:39.087373 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 156/323] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:41:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:39.094126 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b46b7-1b0c-45b9-a9f4-6896804cf58a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:39.251159 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b46b7-1b0c-45b9-a9f4-6896804cf58a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:39.307761 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:39.324406 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d504692-8d9b-4830-8555-86d878d3bcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:39.325524 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d504692-8d9b-4830-8555-86d878d3bcfe None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:39.326122 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d504692-8d9b-4830-8555-86d878d3bcfe None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:39.326608 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d504692-8d9b-4830-8555-86d878d3bcfe None admin] PATH_INFO: `/v3/groups` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:39.327882 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d504692-8d9b-4830-8555-86d878d3bcfe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:39.330662 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d504692-8d9b-4830-8555-86d878d3bcfe None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:39.362870 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 168/324] 10.222.0.26 () {60 vars in 1134 bytes} [Sun Oct 2 00:41:39 2022] POST /identity/v3/groups => generated 226 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:41:39.363144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbc754-f64a-47bb-b9f2-9794a82955e9 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:39.490652 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:39.578463 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbc754-f64a-47bb-b9f2-9794a82955e9 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:39.634897 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c719c7-2d68-4c74-aaa5-b86f6896a1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:39.635982 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c719c7-2d68-4c74-aaa5-b86f6896a1ad None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:39.636460 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c719c7-2d68-4c74-aaa5-b86f6896a1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:39.636990 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c719c7-2d68-4c74-aaa5-b86f6896a1ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:39.657866 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c719c7-2d68-4c74-aaa5-b86f6896a1ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:39.662984 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-22c719c7-2d68-4c74-aaa5-b86f6896a1ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:41:39.662984 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:39.662984 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:39.662984 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:39.662984 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:39.662984 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:39.662984 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:39.662984 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:39.662984 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:39.662984 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:39.662984 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:39.662984 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:39.662984 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:39.662984 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:39.662984 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:39.662984 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:39.664587 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:39.664587 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:39.664587 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:39.664587 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:39.664587 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:39.664587 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:39.664587 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:39.664587 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:39.664587 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:39.664587 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:39.664587 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:39.664587 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:39.664587 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:39.664587 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:39.664587 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:39.664587 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:39.666691 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:39.666691 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:39.666691 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:39.666691 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:39.666691 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:39.666691 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:39.666691 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:39.666691 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:39.666691 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:39.666691 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:39.666691 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:41:39.666691 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:39.666691 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 157/325] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:39.671349 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d504692-8d9b-4830-8555-86d878d3bcfe None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:39.870982 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d504692-8d9b-4830-8555-86d878d3bcfe None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:39.930265 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0bc6e-0e8e-4be6-aa48-be8e7edf818e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:39.931239 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0bc6e-0e8e-4be6-aa48-be8e7edf818e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:39.931685 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0bc6e-0e8e-4be6-aa48-be8e7edf818e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:39.932115 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0bc6e-0e8e-4be6-aa48-be8e7edf818e None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:39.933306 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0bc6e-0e8e-4be6-aa48-be8e7edf818e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:39.933814 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0bc6e-0e8e-4be6-aa48-be8e7edf818e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:39.936799 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0bc6e-0e8e-4be6-aa48-be8e7edf818e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:39.951800 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 169/326] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:39.958900 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c719c7-2d68-4c74-aaa5-b86f6896a1ad None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:40.140656 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c719c7-2d68-4c74-aaa5-b86f6896a1ad None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:40.169988 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:40.191777 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda45b0f-439b-4cdf-8c56-bfb9a9928792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:40.192446 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda45b0f-439b-4cdf-8c56-bfb9a9928792 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:40.192726 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda45b0f-439b-4cdf-8c56-bfb9a9928792 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:40.193034 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda45b0f-439b-4cdf-8c56-bfb9a9928792 None admin] PATH_INFO: `/v3/users/d1c9d9d78e834de1aa8bb87c67994be0` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:40.194372 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda45b0f-439b-4cdf-8c56-bfb9a9928792 None admin] RBAC: Authorizing `identity:get_user(user_id=d1c9d9d78e834de1aa8bb87c67994be0)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:40.195893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda45b0f-439b-4cdf-8c56-bfb9a9928792 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:40.198098 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 158/327] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:39 2022] GET /identity/v3/users/d1c9d9d78e834de1aa8bb87c67994be0 => generated 293 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:40.205360 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0bc6e-0e8e-4be6-aa48-be8e7edf818e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:40.315351 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:40.424738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0bc6e-0e8e-4be6-aa48-be8e7edf818e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:40.503125 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92276092-b7a9-410a-8e07-02e641744eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:40.504382 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276092-b7a9-410a-8e07-02e641744eef None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:40.504859 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276092-b7a9-410a-8e07-02e641744eef None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:40.505482 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276092-b7a9-410a-8e07-02e641744eef None admin] PATH_INFO: `/v3/system/users/d1c9d9d78e834de1aa8bb87c67994be0/roles/f3bcf4f4f01e4fe98ec388ccb5daf537` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:40.508076 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92276092-b7a9-410a-8e07-02e641744eef None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d1c9d9d78e834de1aa8bb87c67994be0, role_id=f3bcf4f4f01e4fe98ec388ccb5daf537)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:40.510594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92276092-b7a9-410a-8e07-02e641744eef None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:40.533344 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 170/328] 10.222.0.26 () {58 vars in 1334 bytes} [Sun Oct 2 00:41:40 2022] PUT /identity/v3/system/users/d1c9d9d78e834de1aa8bb87c67994be0/roles/f3bcf4f4f01e4fe98ec388ccb5daf537 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:41:41.453631 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6da04-d202-44af-aac9-3540348a68fc None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:41.455072 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6da04-d202-44af-aac9-3540348a68fc None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:41.455760 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6da04-d202-44af-aac9-3540348a68fc None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:41.458718 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 159/329] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:41.465885 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9b896-398c-445b-a66c-ec85ba60779f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:41.467815 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9b896-398c-445b-a66c-ec85ba60779f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:41.467815 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9b896-398c-445b-a66c-ec85ba60779f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:41.508124 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-05a9b896-398c-445b-a66c-ec85ba60779f None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:41.510426 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-05a9b896-398c-445b-a66c-ec85ba60779f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:41.669130 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 171/330] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:42.083020 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6da04-d202-44af-aac9-3540348a68fc None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:42.310376 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6da04-d202-44af-aac9-3540348a68fc None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:42.394582 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93524c1-6a64-484a-af5c-845114737147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:42.395572 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93524c1-6a64-484a-af5c-845114737147 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:42.396051 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93524c1-6a64-484a-af5c-845114737147 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:42.396528 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93524c1-6a64-484a-af5c-845114737147 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:42.426765 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93524c1-6a64-484a-af5c-845114737147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:42.441347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-d93524c1-6a64-484a-af5c-845114737147 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:42.441347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:42.441347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:42.441347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:42.441347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:42.441347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:42.441347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:42.441347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:42.441347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:42.441347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:42.441347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:42.441347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:42.441347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:42.441347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:42.441347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:42.441347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:42.442327 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:42.442327 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:42.442327 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:42.442327 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:42.442327 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:42.442327 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:42.442327 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:42.442327 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:42.442327 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:42.442327 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:42.442327 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:42.442327 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:42.442327 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:42.442327 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:42.442327 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:42.442327 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:42.443142 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:42.443142 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:42.443142 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:42.443142 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:42.443142 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:42.443142 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:42.443142 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:42.443142 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:42.443142 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:42.443142 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:42.443142 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:42.443142 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:42.443757 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 160/331] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:41:42.450833 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9b896-398c-445b-a66c-ec85ba60779f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:42.576652 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:42.643473 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9b896-398c-445b-a66c-ec85ba60779f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:42.691220 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7756061-4261-45ca-886b-f65ae98a9f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:42.691842 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7756061-4261-45ca-886b-f65ae98a9f56 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:42.692118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7756061-4261-45ca-886b-f65ae98a9f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:42.692387 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7756061-4261-45ca-886b-f65ae98a9f56 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:42.693099 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7756061-4261-45ca-886b-f65ae98a9f56 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:42.693395 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7756061-4261-45ca-886b-f65ae98a9f56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:42.694786 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7756061-4261-45ca-886b-f65ae98a9f56 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:42.709066 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 172/332] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:42.715557 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93524c1-6a64-484a-af5c-845114737147 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:42.851399 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:42.939492 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93524c1-6a64-484a-af5c-845114737147 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:42.997692 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5d906-283d-4975-828e-f4a19226af65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:42.998314 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d906-283d-4975-828e-f4a19226af65 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:42.998600 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d906-283d-4975-828e-f4a19226af65 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:42.998877 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d906-283d-4975-828e-f4a19226af65 None admin] PATH_INFO: `/v3/users/df65aa7094ed4acca30e06264274bf46` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:43.000281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5d906-283d-4975-828e-f4a19226af65 None admin] RBAC: Authorizing `identity:get_user(user_id=df65aa7094ed4acca30e06264274bf46)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:43.001834 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5d906-283d-4975-828e-f4a19226af65 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:43.003906 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 161/333] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:42 2022] GET /identity/v3/users/df65aa7094ed4acca30e06264274bf46 => generated 293 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:43.010111 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7756061-4261-45ca-886b-f65ae98a9f56 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:43.158887 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7756061-4261-45ca-886b-f65ae98a9f56 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:43.166994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:43.203914 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a2ce1-9832-49c3-9b0c-08716c7df1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:43.204537 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a2ce1-9832-49c3-9b0c-08716c7df1ed None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:43.204817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a2ce1-9832-49c3-9b0c-08716c7df1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:43.205117 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a2ce1-9832-49c3-9b0c-08716c7df1ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:43.205847 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a2ce1-9832-49c3-9b0c-08716c7df1ed None admin] RBAC: Adding query filter params (role.id=424fdbf5034b4445bf8a3022b9fb8b4c, user.id=df65aa7094ed4acca30e06264274bf46, scope.system=all) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:43.206155 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a2ce1-9832-49c3-9b0c-08716c7df1ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:43.207615 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a2ce1-9832-49c3-9b0c-08716c7df1ed None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:43.215090 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f90b6-efd5-49cb-b684-97467a5b68b9 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:43.215412 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f90b6-efd5-49cb-b684-97467a5b68b9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:43.215638 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f90b6-efd5-49cb-b684-97467a5b68b9 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:43.217867 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 162/334] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:43.226234 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310ebde-3f90-4c80-a8ee-400e475cd97b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:43.226642 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310ebde-3f90-4c80-a8ee-400e475cd97b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:43.226906 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310ebde-3f90-4c80-a8ee-400e475cd97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:43.237021 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 173/335] 10.222.0.26 () {56 vars in 1308 bytes} [Sun Oct 2 00:41:43 2022] GET /identity/v3/role_assignments?user.id=df65aa7094ed4acca30e06264274bf46&scope.system=all&role.id=424fdbf5034b4445bf8a3022b9fb8b4c => generated 510 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:43.250998 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8310ebde-3f90-4c80-a8ee-400e475cd97b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:43.252182 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8310ebde-3f90-4c80-a8ee-400e475cd97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:43.367607 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 163/336] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:41:43.940339 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a2ce1-9832-49c3-9b0c-08716c7df1ed None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:44.099827 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a2ce1-9832-49c3-9b0c-08716c7df1ed None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:44.137615 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f063a-d3f5-4171-b623-a8e8003d9b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:44.138267 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f063a-d3f5-4171-b623-a8e8003d9b80 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:44.138653 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f063a-d3f5-4171-b623-a8e8003d9b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:44.139370 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f063a-d3f5-4171-b623-a8e8003d9b80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:44.152467 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f063a-d3f5-4171-b623-a8e8003d9b80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:44.158732 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a13f063a-d3f5-4171-b623-a8e8003d9b80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:44.158732 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:44.158732 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:44.158732 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:44.158732 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:44.158732 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:44.158732 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:44.158732 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:44.158732 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:44.158732 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:44.158732 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:44.158732 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:44.158732 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:44.158732 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:44.158732 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:44.158732 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:44.160358 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:44.160358 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:44.160358 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:44.160358 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:44.160358 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:44.160358 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:44.160358 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:44.160358 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:44.160358 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:44.160358 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:44.160358 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:44.160358 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:44.160358 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:44.160358 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:44.160358 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:44.160358 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:44.162401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:44.162401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:44.162401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:44.162401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:44.162401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:44.162401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:44.162401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:44.162401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:44.162401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:44.162401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:44.162401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:44.162401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:44.169274 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 174/337] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:44.171389 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310ebde-3f90-4c80-a8ee-400e475cd97b None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:44.284886 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:44.376255 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310ebde-3f90-4c80-a8ee-400e475cd97b None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:44.433799 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e9eb1-3872-4c55-bc26-28e4cab751dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:44.434452 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e9eb1-3872-4c55-bc26-28e4cab751dd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:44.434735 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e9eb1-3872-4c55-bc26-28e4cab751dd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:44.435012 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e9eb1-3872-4c55-bc26-28e4cab751dd None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:44.435798 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e9eb1-3872-4c55-bc26-28e4cab751dd None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:44.436107 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e9eb1-3872-4c55-bc26-28e4cab751dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:44.437583 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e9eb1-3872-4c55-bc26-28e4cab751dd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:44.447647 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 164/338] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:44.454119 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f063a-d3f5-4171-b623-a8e8003d9b80 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:44.501109 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:44.605257 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f063a-d3f5-4171-b623-a8e8003d9b80 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:44.648813 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f690c3c-b572-42ae-bcee-d9f6aee77216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:44.649820 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f690c3c-b572-42ae-bcee-d9f6aee77216 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:44.650323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f690c3c-b572-42ae-bcee-d9f6aee77216 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:44.650793 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f690c3c-b572-42ae-bcee-d9f6aee77216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:44.743972 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f690c3c-b572-42ae-bcee-d9f6aee77216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:44.745902 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f690c3c-b572-42ae-bcee-d9f6aee77216 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:44.787782 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:44.881432 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 175/339] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:41:44.888098 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e9eb1-3872-4c55-bc26-28e4cab751dd None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:44.963920 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081f7a8-a519-41d6-b716-147ffc470dc5 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:44.964876 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081f7a8-a519-41d6-b716-147ffc470dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:44.965394 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081f7a8-a519-41d6-b716-147ffc470dc5 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:44.967034 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 176/340] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:41:44.974651 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84e982-a00b-4e95-9c09-e47ab41d02aa None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:44.975283 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84e982-a00b-4e95-9c09-e47ab41d02aa None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:44.975751 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84e982-a00b-4e95-9c09-e47ab41d02aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:44.996909 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8b84e982-a00b-4e95-9c09-e47ab41d02aa None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:44.998626 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8b84e982-a00b-4e95-9c09-e47ab41d02aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:45.092592 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e9eb1-3872-4c55-bc26-28e4cab751dd None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:45.107720 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:45.139314 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b688370-0adb-4228-a372-1f06b895e4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:45.139889 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b688370-0adb-4228-a372-1f06b895e4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:45.140171 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b688370-0adb-4228-a372-1f06b895e4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:45.141932 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b688370-0adb-4228-a372-1f06b895e4f0 None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:45.143368 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b688370-0adb-4228-a372-1f06b895e4f0 None admin] RBAC: Authorizing `identity:get_project(project_id=141aed90ccfe453283d0e7fd34fb461d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:45.144907 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b688370-0adb-4228-a372-1f06b895e4f0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:45.147142 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 165/341] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:44 2022] GET /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:45.148467 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f23456-175a-48e1-9986-784a5798742f None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:45.148747 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f23456-175a-48e1-9986-784a5798742f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:45.149043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f23456-175a-48e1-9986-784a5798742f None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:45.150320 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 166/342] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:45.155789 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f23456-175a-48e1-9986-784a5798742f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:45.165950 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 177/343] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:41:45.168211 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96882ffb-7894-41fd-a1f2-8ab16dac49d1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:45.168676 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96882ffb-7894-41fd-a1f2-8ab16dac49d1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:45.169214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96882ffb-7894-41fd-a1f2-8ab16dac49d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:45.209040 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-96882ffb-7894-41fd-a1f2-8ab16dac49d1 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:45.210957 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-96882ffb-7894-41fd-a1f2-8ab16dac49d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:45.374972 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:45.376438 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f23456-175a-48e1-9986-784a5798742f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:45.457067 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 178/344] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:45.465777 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da9a47-ce9e-4148-8f3d-64984ee78d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:45.467030 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da9a47-ce9e-4148-8f3d-64984ee78d1f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:45.467318 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da9a47-ce9e-4148-8f3d-64984ee78d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:45.467594 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da9a47-ce9e-4148-8f3d-64984ee78d1f None admin] PATH_INFO: `/v3/groups/c5b2af962e9149ebad07610517e45519` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:45.478258 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da9a47-ce9e-4148-8f3d-64984ee78d1f None admin] RBAC: Authorizing `identity:get_group(group_id=c5b2af962e9149ebad07610517e45519)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:45.479859 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da9a47-ce9e-4148-8f3d-64984ee78d1f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:45.482761 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 167/345] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Oct 2 00:41:45 2022] GET /identity/v3/groups/c5b2af962e9149ebad07610517e45519 => generated 226 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:45.488804 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96882ffb-7894-41fd-a1f2-8ab16dac49d1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:45.661420 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3eeaa-4cdf-445e-8c73-46c88c719a78 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:45.661695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3eeaa-4cdf-445e-8c73-46c88c719a78 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:45.662064 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3eeaa-4cdf-445e-8c73-46c88c719a78 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:45.665063 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 168/346] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:45.686506 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c87b9b-7cf8-4fa0-8891-8b102d80f94d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:45.686874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c87b9b-7cf8-4fa0-8891-8b102d80f94d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:45.687126 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c87b9b-7cf8-4fa0-8891-8b102d80f94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:45.717976 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-87c87b9b-7cf8-4fa0-8891-8b102d80f94d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:45.719200 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-87c87b9b-7cf8-4fa0-8891-8b102d80f94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:45.735640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96882ffb-7894-41fd-a1f2-8ab16dac49d1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:45.849312 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:45.853344 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55601d4-a1dd-45d5-ac72-2ed1ea611761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:45.854301 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55601d4-a1dd-45d5-ac72-2ed1ea611761 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:45.854742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55601d4-a1dd-45d5-ac72-2ed1ea611761 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:45.855216 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55601d4-a1dd-45d5-ac72-2ed1ea611761 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:45.856437 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55601d4-a1dd-45d5-ac72-2ed1ea611761 None admin] RBAC: Adding query filter params (group.id=c5b2af962e9149ebad07610517e45519, role.id=424fdbf5034b4445bf8a3022b9fb8b4c, scope.project.id=141aed90ccfe453283d0e7fd34fb461d) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:45.856929 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55601d4-a1dd-45d5-ac72-2ed1ea611761 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:45.860252 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55601d4-a1dd-45d5-ac72-2ed1ea611761 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:45.870482 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 179/347] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Oct 2 00:41:45 2022] GET /identity/v3/role_assignments?group.id=c5b2af962e9149ebad07610517e45519&scope.project.id=141aed90ccfe453283d0e7fd34fb461d&role.id=424fdbf5034b4445bf8a3022b9fb8b4c => generated 260 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:45.872174 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55601d4-a1dd-45d5-ac72-2ed1ea611761 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:45.911977 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 169/348] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:41:46.028482 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:46.033275 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeddb28-46c1-40c4-bbeb-6e6ab336668f None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:46.033969 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeddb28-46c1-40c4-bbeb-6e6ab336668f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:46.036964 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeddb28-46c1-40c4-bbeb-6e6ab336668f None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:46.040751 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 170/349] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:46 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:46.054890 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5fe22-3ca5-4811-bb4d-1231eff7d5b8 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:46.055777 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5fe22-3ca5-4811-bb4d-1231eff7d5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:46.056599 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5fe22-3ca5-4811-bb4d-1231eff7d5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:46.134402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-c6e5fe22-3ca5-4811-bb4d-1231eff7d5b8 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:46.136860 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c6e5fe22-3ca5-4811-bb4d-1231eff7d5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:46.237645 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55601d4-a1dd-45d5-ac72-2ed1ea611761 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:46.296075 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 171/350] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:46.320404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4010c-1594-46d4-a1f2-5a863198f443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:46.320640 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5fe22-3ca5-4811-bb4d-1231eff7d5b8 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:46.321081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4010c-1594-46d4-a1f2-5a863198f443 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:46.321361 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4010c-1594-46d4-a1f2-5a863198f443 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:46.321644 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4010c-1594-46d4-a1f2-5a863198f443 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:46.345211 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4010c-1594-46d4-a1f2-5a863198f443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:46.356323 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-59b4010c-1594-46d4-a1f2-5a863198f443 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:46.356323 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:46.356323 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:46.356323 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:46.356323 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:46.356323 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:46.356323 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:46.356323 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:46.356323 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:46.356323 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:46.356323 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:46.356323 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:46.356323 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:46.356323 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:46.356323 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:46.356323 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:46.357589 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:46.357589 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:46.357589 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:46.357589 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:46.357589 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:46.357589 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:46.357589 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:46.357589 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:46.357589 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:46.357589 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:46.357589 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:46.357589 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:46.357589 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:46.357589 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:46.357589 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:46.357589 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:46.358544 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:46.358544 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:46.358544 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:46.358544 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:46.358544 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:46.358544 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:46.358544 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:46.358544 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:46.358544 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:46.358544 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:46.358544 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:46.358544 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:46.361853 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 180/351] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:41:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 491 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:46.374079 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4010c-1594-46d4-a1f2-5a863198f443 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:46.508633 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4010c-1594-46d4-a1f2-5a863198f443 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:46.520494 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:46.554433 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:46.558429 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5fe22-3ca5-4811-bb4d-1231eff7d5b8 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:46.563504 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e487d-794e-4215-a457-5973f47af5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:46.564139 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e487d-794e-4215-a457-5973f47af5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:46.564417 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e487d-794e-4215-a457-5973f47af5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:46.564690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e487d-794e-4215-a457-5973f47af5d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:46.567209 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e487d-794e-4215-a457-5973f47af5d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:46.567209 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e487d-794e-4215-a457-5973f47af5d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:46.567423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e487d-794e-4215-a457-5973f47af5d5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:46.582351 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 181/352] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:41:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:46.590876 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e487d-794e-4215-a457-5973f47af5d5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:46.627277 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a54b3-cbc7-4e3e-b8b6-0a3ad187c4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:46.628639 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a54b3-cbc7-4e3e-b8b6-0a3ad187c4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:46.629331 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a54b3-cbc7-4e3e-b8b6-0a3ad187c4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:46.632281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a54b3-cbc7-4e3e-b8b6-0a3ad187c4b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:46.664843 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a54b3-cbc7-4e3e-b8b6-0a3ad187c4b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:46.671097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-000a54b3-cbc7-4e3e-b8b6-0a3ad187c4b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:46.671097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:46.671097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:46.671097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:46.671097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:46.671097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:46.671097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:46.671097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:46.671097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:46.671097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:46.671097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:46.671097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:46.671097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:46.671097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:46.671097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:46.671097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:46.672832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:46.672832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:46.672832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:46.672832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:46.672832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:46.672832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:46.672832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:46.672832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:46.672832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:46.672832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:46.672832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:46.672832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:46.672832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:46.672832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:46.672832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:46.672832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:46.674658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:46.674658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:46.674658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:46.674658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:46.674658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:46.674658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:46.674658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:46.674658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:46.674658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:46.674658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:46.674658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:46.674658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:46.681012 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 172/353] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:41:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:41:46.681012 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a54b3-cbc7-4e3e-b8b6-0a3ad187c4b0 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:46.854053 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e487d-794e-4215-a457-5973f47af5d5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:46.898580 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a54b3-cbc7-4e3e-b8b6-0a3ad187c4b0 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:46.899413 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a81d6b-f22b-40ca-8f50-565258e2fca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:46.900354 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a81d6b-f22b-40ca-8f50-565258e2fca8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:46.900781 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a81d6b-f22b-40ca-8f50-565258e2fca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:46.901263 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a81d6b-f22b-40ca-8f50-565258e2fca8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:46.953175 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1200e1-a6e4-4f2c-85e6-ae1860da83e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:46.956328 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1200e1-a6e4-4f2c-85e6-ae1860da83e8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:46.956860 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1200e1-a6e4-4f2c-85e6-ae1860da83e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:46.957299 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1200e1-a6e4-4f2c-85e6-ae1860da83e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:46.973543 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1200e1-a6e4-4f2c-85e6-ae1860da83e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:46.979987 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-2e1200e1-a6e4-4f2c-85e6-ae1860da83e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:41:46.979987 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:46.979987 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:46.979987 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:46.979987 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:46.979987 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:46.979987 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:46.979987 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:46.979987 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:46.979987 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:46.979987 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:46.979987 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:46.979987 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:46.979987 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:46.979987 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:46.979987 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:46.981102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:46.981102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:46.981102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:46.981102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:46.981102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:46.981102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:46.981102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:46.981102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:46.981102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:46.981102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:46.981102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:46.981102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:46.981102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:46.981102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:46.981102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:46.981102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:46.982220 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:46.982220 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:46.982220 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:46.982220 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:46.982220 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:46.982220 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:46.982220 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:46.982220 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:46.982220 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:46.982220 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:46.982220 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:41:46.982220 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:46.983960 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:46.984551 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 173/354] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:46.986445 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1200e1-a6e4-4f2c-85e6-ae1860da83e8 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:47.017843 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:47.047585 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a81d6b-f22b-40ca-8f50-565258e2fca8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:47.050356 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a81d6b-f22b-40ca-8f50-565258e2fca8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:47.136558 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1200e1-a6e4-4f2c-85e6-ae1860da83e8 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:47.211390 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276a9a4-2598-4d3a-889e-7f42a4dd9a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:47.212413 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276a9a4-2598-4d3a-889e-7f42a4dd9a91 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:47.212902 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276a9a4-2598-4d3a-889e-7f42a4dd9a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:47.215195 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 182/355] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 02 00:41:47.216306 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a81d6b-f22b-40ca-8f50-565258e2fca8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:47.217097 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276a9a4-2598-4d3a-889e-7f42a4dd9a91 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:47.218404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276a9a4-2598-4d3a-889e-7f42a4dd9a91 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:47.219040 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276a9a4-2598-4d3a-889e-7f42a4dd9a91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:47.221601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276a9a4-2598-4d3a-889e-7f42a4dd9a91 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:47.240499 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 174/356] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:41:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:47.242200 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276a9a4-2598-4d3a-889e-7f42a4dd9a91 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:47.308031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:47.359373 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a81d6b-f22b-40ca-8f50-565258e2fca8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:47.411437 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b22c7-e2ee-4d68-9d93-d3aad183bca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:47.412747 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b22c7-e2ee-4d68-9d93-d3aad183bca2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:47.413274 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b22c7-e2ee-4d68-9d93-d3aad183bca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:47.413742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b22c7-e2ee-4d68-9d93-d3aad183bca2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:47.433232 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b22c7-e2ee-4d68-9d93-d3aad183bca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:47.439587 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-1d8b22c7-e2ee-4d68-9d93-d3aad183bca2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:47.439587 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:47.439587 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:47.439587 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:47.439587 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:47.439587 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:47.439587 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:47.439587 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:47.439587 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:47.439587 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:47.439587 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:47.439587 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:47.439587 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:47.439587 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:47.439587 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:47.439587 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:47.440569 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:47.440569 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:47.440569 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:47.440569 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:47.440569 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:47.440569 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:47.440569 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:47.440569 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:47.440569 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:47.440569 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:47.440569 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:47.440569 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:47.440569 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:47.440569 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:47.440569 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:47.440569 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:47.441863 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:47.441863 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:47.441863 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:47.441863 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:47.441863 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:47.441863 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:47.441863 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:47.441863 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:47.441863 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:47.441863 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:47.441863 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:47.441863 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:47.444369 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 183/357] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:47.445608 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b22c7-e2ee-4d68-9d93-d3aad183bca2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:47.468603 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:47.525304 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276a9a4-2598-4d3a-889e-7f42a4dd9a91 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:47.585785 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45827c-543a-422d-9122-8440ad586284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:47.586795 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45827c-543a-422d-9122-8440ad586284 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:47.586795 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45827c-543a-422d-9122-8440ad586284 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:47.587034 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45827c-543a-422d-9122-8440ad586284 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:47.587692 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45827c-543a-422d-9122-8440ad586284 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:47.587991 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45827c-543a-422d-9122-8440ad586284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:47.590589 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45827c-543a-422d-9122-8440ad586284 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:47.601281 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 175/358] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:47.602885 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45827c-543a-422d-9122-8440ad586284 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:47.655472 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b22c7-e2ee-4d68-9d93-d3aad183bca2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:47.690404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:47.697948 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf198e-6334-4b37-a3d4-ec70e85d8c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:47.698616 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf198e-6334-4b37-a3d4-ec70e85d8c96 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:47.698884 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf198e-6334-4b37-a3d4-ec70e85d8c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:47.699156 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf198e-6334-4b37-a3d4-ec70e85d8c96 None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:47.700503 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf198e-6334-4b37-a3d4-ec70e85d8c96 None admin] RBAC: Authorizing `identity:get_project(project_id=141aed90ccfe453283d0e7fd34fb461d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:47.702275 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf198e-6334-4b37-a3d4-ec70e85d8c96 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:47.704402 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 184/359] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:47 2022] GET /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:47.705331 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf198e-6334-4b37-a3d4-ec70e85d8c96 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:47.822184 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45827c-543a-422d-9122-8440ad586284 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:47.865417 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf198e-6334-4b37-a3d4-ec70e85d8c96 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:47.898354 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee596331-0f34-46e7-94f3-2b15daefe036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:47.899852 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee596331-0f34-46e7-94f3-2b15daefe036 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:47.900583 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee596331-0f34-46e7-94f3-2b15daefe036 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:47.901065 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee596331-0f34-46e7-94f3-2b15daefe036 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:47.926642 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44908e3b-64ab-4ce4-af30-89af91012dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:47.927676 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44908e3b-64ab-4ce4-af30-89af91012dbd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:47.928173 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44908e3b-64ab-4ce4-af30-89af91012dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:47.928685 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44908e3b-64ab-4ce4-af30-89af91012dbd None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:47.929445 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44908e3b-64ab-4ce4-af30-89af91012dbd None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:47.929751 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44908e3b-64ab-4ce4-af30-89af91012dbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:47.931255 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44908e3b-64ab-4ce4-af30-89af91012dbd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:47.933823 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:47.942683 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 185/360] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:47.943179 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44908e3b-64ab-4ce4-af30-89af91012dbd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:48.021675 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee596331-0f34-46e7-94f3-2b15daefe036 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:48.023164 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee596331-0f34-46e7-94f3-2b15daefe036 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:48.066813 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:48.152392 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44908e3b-64ab-4ce4-af30-89af91012dbd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:48.217293 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 176/361] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:41:48.220022 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa7916-d7ae-4f77-9962-b9868e2818d7 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:48.220815 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa7916-d7ae-4f77-9962-b9868e2818d7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:48.221681 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa7916-d7ae-4f77-9962-b9868e2818d7 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:48.224449 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 177/362] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:48.226106 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa7916-d7ae-4f77-9962-b9868e2818d7 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:48.227609 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455c9c2-3a0b-4a7e-88f2-f6126e778997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:48.228616 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455c9c2-3a0b-4a7e-88f2-f6126e778997 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:48.229114 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455c9c2-3a0b-4a7e-88f2-f6126e778997 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:48.229572 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455c9c2-3a0b-4a7e-88f2-f6126e778997 None admin] PATH_INFO: `/v3/users/d1c9d9d78e834de1aa8bb87c67994be0` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:48.231558 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455c9c2-3a0b-4a7e-88f2-f6126e778997 None admin] RBAC: Authorizing `identity:get_user(user_id=d1c9d9d78e834de1aa8bb87c67994be0)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:48.234615 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455c9c2-3a0b-4a7e-88f2-f6126e778997 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:48.239945 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 186/363] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:41:47 2022] GET /identity/v3/users/d1c9d9d78e834de1aa8bb87c67994be0 => generated 293 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:48.241414 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455c9c2-3a0b-4a7e-88f2-f6126e778997 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:48.320874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:48.415031 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa7916-d7ae-4f77-9962-b9868e2818d7 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:48.450946 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455c9c2-3a0b-4a7e-88f2-f6126e778997 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:48.474561 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560a3f5-b44e-4b83-9913-dfc889c7893a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:48.475129 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560a3f5-b44e-4b83-9913-dfc889c7893a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:48.475403 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560a3f5-b44e-4b83-9913-dfc889c7893a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:48.475914 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560a3f5-b44e-4b83-9913-dfc889c7893a None admin] PATH_INFO: `/v3/groups/c5b2af962e9149ebad07610517e45519` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:48.477119 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560a3f5-b44e-4b83-9913-dfc889c7893a None admin] RBAC: Authorizing `identity:get_group(group_id=c5b2af962e9149ebad07610517e45519)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:48.479638 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560a3f5-b44e-4b83-9913-dfc889c7893a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:48.481622 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 178/364] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Oct 2 00:41:48 2022] GET /identity/v3/groups/c5b2af962e9149ebad07610517e45519 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:48.484816 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603550b2-daf3-432c-9df8-e12056959802 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:48.485339 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603550b2-daf3-432c-9df8-e12056959802 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:48.485897 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603550b2-daf3-432c-9df8-e12056959802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:48.495994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:48.510576 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98175bd7-debc-4770-acb5-0930badd9ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:48.511198 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98175bd7-debc-4770-acb5-0930badd9ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:48.511487 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98175bd7-debc-4770-acb5-0930badd9ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:48.511739 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98175bd7-debc-4770-acb5-0930badd9ea5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:48.525477 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-603550b2-daf3-432c-9df8-e12056959802 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:48.526688 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-603550b2-daf3-432c-9df8-e12056959802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:48.612837 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 179/365] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:48.613623 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603550b2-daf3-432c-9df8-e12056959802 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:48.646215 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98175bd7-debc-4770-acb5-0930badd9ea5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:48.648978 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98175bd7-debc-4770-acb5-0930badd9ea5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:48.668038 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:48.743616 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603550b2-daf3-432c-9df8-e12056959802 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:48.807698 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930448a0-de72-4387-83f0-e601aeeb26e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:48.808997 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930448a0-de72-4387-83f0-e601aeeb26e3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:48.809517 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930448a0-de72-4387-83f0-e601aeeb26e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:48.810217 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930448a0-de72-4387-83f0-e601aeeb26e3 None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:48.813046 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930448a0-de72-4387-83f0-e601aeeb26e3 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd87b88a6204ecaa0e15f4cb612ef96)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:48.816194 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930448a0-de72-4387-83f0-e601aeeb26e3 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:48.820762 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 180/366] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:48 2022] GET /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:48.820964 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 187/367] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:41:48.822445 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930448a0-de72-4387-83f0-e601aeeb26e3 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:48.826437 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98175bd7-debc-4770-acb5-0930badd9ea5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:48.864707 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:48.964610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98175bd7-debc-4770-acb5-0930badd9ea5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:49.008048 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca45f8b-0146-418f-827e-f17227974604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:49.008682 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca45f8b-0146-418f-827e-f17227974604 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:49.008983 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca45f8b-0146-418f-827e-f17227974604 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:49.009261 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca45f8b-0146-418f-827e-f17227974604 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:49.009990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca45f8b-0146-418f-827e-f17227974604 None admin] RBAC: Adding query filter params (group.id=c5b2af962e9149ebad07610517e45519, role.id=030fcd169fb44f759772ef3101c07012, scope.project.id=141aed90ccfe453283d0e7fd34fb461d) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:49.010296 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca45f8b-0146-418f-827e-f17227974604 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:49.011759 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca45f8b-0146-418f-827e-f17227974604 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:49.016289 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930448a0-de72-4387-83f0-e601aeeb26e3 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:49.019931 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 188/368] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Oct 2 00:41:48 2022] GET /identity/v3/role_assignments?group.id=c5b2af962e9149ebad07610517e45519&scope.project.id=141aed90ccfe453283d0e7fd34fb461d&role.id=030fcd169fb44f759772ef3101c07012 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:49.020596 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca45f8b-0146-418f-827e-f17227974604 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:49.031907 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:49.067441 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3cbac-61d4-47ac-95f2-d02f7248aa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:49.067915 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3cbac-61d4-47ac-95f2-d02f7248aa50 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:49.068069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3cbac-61d4-47ac-95f2-d02f7248aa50 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:49.068346 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3cbac-61d4-47ac-95f2-d02f7248aa50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:49.072829 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3cbac-61d4-47ac-95f2-d02f7248aa50 None admin] RBAC: Adding query filter params (role.id=f3bcf4f4f01e4fe98ec388ccb5daf537, user.id=d1c9d9d78e834de1aa8bb87c67994be0, scope.system=all) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:49.072829 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3cbac-61d4-47ac-95f2-d02f7248aa50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:49.072829 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3cbac-61d4-47ac-95f2-d02f7248aa50 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:49.090526 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 181/369] 10.222.0.26 () {56 vars in 1308 bytes} [Sun Oct 2 00:41:48 2022] GET /identity/v3/role_assignments?user.id=d1c9d9d78e834de1aa8bb87c67994be0&scope.system=all&role.id=f3bcf4f4f01e4fe98ec388ccb5daf537 => generated 510 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:49.098397 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3cbac-61d4-47ac-95f2-d02f7248aa50 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:49.211540 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:49.228549 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca45f8b-0146-418f-827e-f17227974604 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:49.254336 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3cbac-61d4-47ac-95f2-d02f7248aa50 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:49.310577 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fca79-e58a-4c71-9b3e-ac2c55d99e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:49.312563 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fca79-e58a-4c71-9b3e-ac2c55d99e0b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:49.313401 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fca79-e58a-4c71-9b3e-ac2c55d99e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:49.314054 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fca79-e58a-4c71-9b3e-ac2c55d99e0b None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:49.315774 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4497a2d-a308-4d6b-b6d0-2637dc9a11ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:49.316247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fca79-e58a-4c71-9b3e-ac2c55d99e0b None admin] RBAC: Authorizing `identity:get_project(project_id=4bd87b88a6204ecaa0e15f4cb612ef96)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:49.316426 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4497a2d-a308-4d6b-b6d0-2637dc9a11ac None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:49.316705 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4497a2d-a308-4d6b-b6d0-2637dc9a11ac None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:49.317003 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4497a2d-a308-4d6b-b6d0-2637dc9a11ac None admin] PATH_INFO: `/v3/groups/c5b2af962e9149ebad07610517e45519` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:49.318182 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4497a2d-a308-4d6b-b6d0-2637dc9a11ac None admin] RBAC: Authorizing `identity:get_group(group_id=c5b2af962e9149ebad07610517e45519)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:49.319116 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fca79-e58a-4c71-9b3e-ac2c55d99e0b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:49.319658 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4497a2d-a308-4d6b-b6d0-2637dc9a11ac None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:49.321923 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 182/370] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Oct 2 00:41:49 2022] GET /identity/v3/groups/c5b2af962e9149ebad07610517e45519 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:49.322567 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 189/371] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:49 2022] GET /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96 => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:49.323214 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21608b2d-f03c-4883-bdcc-3e06c55ece38 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:49.323498 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21608b2d-f03c-4883-bdcc-3e06c55ece38 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:49.323773 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21608b2d-f03c-4883-bdcc-3e06c55ece38 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:49.323945 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fca79-e58a-4c71-9b3e-ac2c55d99e0b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:49.325447 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 183/372] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:49.327215 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21608b2d-f03c-4883-bdcc-3e06c55ece38 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:49.389755 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:49.488554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fca79-e58a-4c71-9b3e-ac2c55d99e0b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:49.527813 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21608b2d-f03c-4883-bdcc-3e06c55ece38 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:49.545995 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612d329-80d7-4555-b302-c1c02ed6acd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:49.547142 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612d329-80d7-4555-b302-c1c02ed6acd1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:49.547629 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612d329-80d7-4555-b302-c1c02ed6acd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:49.548094 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612d329-80d7-4555-b302-c1c02ed6acd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:49.573221 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0612d329-80d7-4555-b302-c1c02ed6acd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:49.586998 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0612d329-80d7-4555-b302-c1c02ed6acd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:41:49.586998 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:49.586998 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:49.586998 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:49.586998 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:49.586998 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:49.586998 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:49.586998 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:49.586998 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:49.586998 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:49.586998 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:49.586998 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:49.586998 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:49.586998 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:49.586998 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:49.586998 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:49.588017 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:49.588017 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:49.588017 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:49.588017 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:49.588017 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:49.588017 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:49.588017 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:49.588017 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:49.588017 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:49.588017 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:49.588017 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:49.588017 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:49.588017 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:49.588017 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:49.588017 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:49.588017 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:49.588819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:49.588819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:49.588819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:49.588819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:49.588819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:49.588819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:49.588819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:49.588819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:49.588819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:49.588819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:49.588819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:41:49.588819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:49.589968 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 190/373] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:41:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:49.592802 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dba1cb-7ef8-4fdf-b895-9bb0795296b0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:49.596727 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dba1cb-7ef8-4fdf-b895-9bb0795296b0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:49.597291 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dba1cb-7ef8-4fdf-b895-9bb0795296b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:49.600174 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14749be-00f4-4c15-a6fb-dd8766c84ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:49.601818 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14749be-00f4-4c15-a6fb-dd8766c84ddd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:49.602299 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14749be-00f4-4c15-a6fb-dd8766c84ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:49.602761 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14749be-00f4-4c15-a6fb-dd8766c84ddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:49.604092 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14749be-00f4-4c15-a6fb-dd8766c84ddd None admin] RBAC: Adding query filter params (group.id=c5b2af962e9149ebad07610517e45519, role.id=030fcd169fb44f759772ef3101c07012, scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:49.604621 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14749be-00f4-4c15-a6fb-dd8766c84ddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:49.607898 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14749be-00f4-4c15-a6fb-dd8766c84ddd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:49.619789 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 184/374] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Oct 2 00:41:49 2022] GET /identity/v3/role_assignments?group.id=c5b2af962e9149ebad07610517e45519&scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96&role.id=030fcd169fb44f759772ef3101c07012 => generated 260 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:49.622372 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-81dba1cb-7ef8-4fdf-b895-9bb0795296b0 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:49.623372 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14749be-00f4-4c15-a6fb-dd8766c84ddd None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:49.623775 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-81dba1cb-7ef8-4fdf-b895-9bb0795296b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:49.641614 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:49.708878 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 191/375] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:49.709564 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dba1cb-7ef8-4fdf-b895-9bb0795296b0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:49.828892 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:49.837188 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14749be-00f4-4c15-a6fb-dd8766c84ddd None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:49.839936 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dba1cb-7ef8-4fdf-b895-9bb0795296b0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:49.905492 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6bdaa-b23c-4cec-9420-5bd0803f12ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:49.906865 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6bdaa-b23c-4cec-9420-5bd0803f12ca None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:49.907514 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6bdaa-b23c-4cec-9420-5bd0803f12ca None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:49.908144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6bdaa-b23c-4cec-9420-5bd0803f12ca None admin] PATH_INFO: `/v3/groups/c5b2af962e9149ebad07610517e45519` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:49.910553 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6bdaa-b23c-4cec-9420-5bd0803f12ca None admin] RBAC: Authorizing `identity:get_group(group_id=c5b2af962e9149ebad07610517e45519)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:49.913830 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6bdaa-b23c-4cec-9420-5bd0803f12ca None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:49.917010 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 185/376] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Oct 2 00:41:49 2022] GET /identity/v3/groups/c5b2af962e9149ebad07610517e45519 => generated 226 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:49.925411 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6bdaa-b23c-4cec-9420-5bd0803f12ca None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:49.943571 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c47abb-028e-42b6-a105-243b3187e676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:49.944787 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c47abb-028e-42b6-a105-243b3187e676 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:49.945436 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c47abb-028e-42b6-a105-243b3187e676 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:49.946045 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c47abb-028e-42b6-a105-243b3187e676 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:49.947372 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c47abb-028e-42b6-a105-243b3187e676 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:49.948228 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c47abb-028e-42b6-a105-243b3187e676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:49.951268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c47abb-028e-42b6-a105-243b3187e676 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:49.978363 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 192/377] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:49.987702 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c47abb-028e-42b6-a105-243b3187e676 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:50.023214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:50.162978 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6bdaa-b23c-4cec-9420-5bd0803f12ca None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:50.223440 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c47abb-028e-42b6-a105-243b3187e676 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:50.254217 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6fdb3-b301-4396-97b1-0e13e6de7326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:50.255154 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6fdb3-b301-4396-97b1-0e13e6de7326 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:50.255668 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6fdb3-b301-4396-97b1-0e13e6de7326 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:50.256181 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6fdb3-b301-4396-97b1-0e13e6de7326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:50.257438 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6fdb3-b301-4396-97b1-0e13e6de7326 None admin] RBAC: Adding query filter params (group.id=c5b2af962e9149ebad07610517e45519, role.id=424fdbf5034b4445bf8a3022b9fb8b4c, scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:50.257946 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6fdb3-b301-4396-97b1-0e13e6de7326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:50.260555 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6fdb3-b301-4396-97b1-0e13e6de7326 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:50.285136 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 186/378] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Oct 2 00:41:49 2022] GET /identity/v3/role_assignments?group.id=c5b2af962e9149ebad07610517e45519&scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96&role.id=424fdbf5034b4445bf8a3022b9fb8b4c => generated 260 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:50.298688 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788a0dc-cb7d-41c1-a0f4-86a1611a1bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:50.300054 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788a0dc-cb7d-41c1-a0f4-86a1611a1bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:50.300731 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788a0dc-cb7d-41c1-a0f4-86a1611a1bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:50.301453 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788a0dc-cb7d-41c1-a0f4-86a1611a1bf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:50.436656 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788a0dc-cb7d-41c1-a0f4-86a1611a1bf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:50.439783 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788a0dc-cb7d-41c1-a0f4-86a1611a1bf7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:50.463789 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6fdb3-b301-4396-97b1-0e13e6de7326 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:50.471751 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:50.609806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:50.663930 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 193/379] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:41:50.674948 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788a0dc-cb7d-41c1-a0f4-86a1611a1bf7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:50.820310 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6fdb3-b301-4396-97b1-0e13e6de7326 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:50.909604 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788a0dc-cb7d-41c1-a0f4-86a1611a1bf7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:50.937807 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:50.941769 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f48693-9e04-4c0f-a7db-1e5e4facc017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:50.942412 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f48693-9e04-4c0f-a7db-1e5e4facc017 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:50.942698 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f48693-9e04-4c0f-a7db-1e5e4facc017 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:50.942963 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f48693-9e04-4c0f-a7db-1e5e4facc017 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:50.972523 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f48693-9e04-4c0f-a7db-1e5e4facc017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:50.978817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-64f48693-9e04-4c0f-a7db-1e5e4facc017 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:50.978817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:50.978817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:50.978817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:50.978817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:50.978817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:50.978817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:50.978817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:50.978817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:50.978817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:50.978817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:50.978817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:50.978817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:50.978817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:50.978817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:50.978817 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:50.980412 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:50.980412 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:50.980412 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:50.980412 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:50.980412 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:50.980412 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:50.980412 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:50.980412 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:50.980412 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:50.980412 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:50.980412 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:50.980412 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:50.980412 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:50.980412 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:50.980412 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:50.980412 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:50.982500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:50.982500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:50.982500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:50.982500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:50.982500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:50.982500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:50.982500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:50.982500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:50.982500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:50.982500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:50.982500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:50.982500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:50.989437 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 187/380] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 527 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:50.991705 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d12acc-c0b4-405e-ade0-43c156b113c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:50.993171 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d12acc-c0b4-405e-ade0-43c156b113c1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:50.993972 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d12acc-c0b4-405e-ade0-43c156b113c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:50.994745 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d12acc-c0b4-405e-ade0-43c156b113c1 None admin] PATH_INFO: `/v3/projects/6575bddc339f4fb18300234b880a2b64` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:50.998240 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f48693-9e04-4c0f-a7db-1e5e4facc017 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:50.998474 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d12acc-c0b4-405e-ade0-43c156b113c1 None admin] RBAC: Authorizing `identity:get_project(project_id=6575bddc339f4fb18300234b880a2b64)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:51.001752 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d12acc-c0b4-405e-ade0-43c156b113c1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:51.005551 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 194/381] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:50 2022] GET /identity/v3/projects/6575bddc339f4fb18300234b880a2b64 => generated 344 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:51.017101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d12acc-c0b4-405e-ade0-43c156b113c1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:51.269050 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d12acc-c0b4-405e-ade0-43c156b113c1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:51.296996 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:51.318134 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f48693-9e04-4c0f-a7db-1e5e4facc017 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:51.354945 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84de9e-7710-4c85-9ee3-92a027718f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:51.355946 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84de9e-7710-4c85-9ee3-92a027718f9f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:51.356414 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84de9e-7710-4c85-9ee3-92a027718f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:51.357007 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84de9e-7710-4c85-9ee3-92a027718f9f None admin] PATH_INFO: `/v3/groups/44a675205d804b3bbafd472ecd53192f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:51.385985 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84de9e-7710-4c85-9ee3-92a027718f9f None admin] RBAC: Authorizing `identity:get_group(group_id=44a675205d804b3bbafd472ecd53192f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:51.389380 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84de9e-7710-4c85-9ee3-92a027718f9f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:51.389840 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711ea00-e3a6-455b-9c5c-8e1e342a1170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:51.391194 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711ea00-e3a6-455b-9c5c-8e1e342a1170 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:51.391911 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711ea00-e3a6-455b-9c5c-8e1e342a1170 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:51.392690 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711ea00-e3a6-455b-9c5c-8e1e342a1170 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:51.392866 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 195/382] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Oct 2 00:41:51 2022] GET /identity/v3/groups/44a675205d804b3bbafd472ecd53192f => generated 229 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:51.394586 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711ea00-e3a6-455b-9c5c-8e1e342a1170 None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:51.395414 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711ea00-e3a6-455b-9c5c-8e1e342a1170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:51.398348 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711ea00-e3a6-455b-9c5c-8e1e342a1170 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:51.401566 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84de9e-7710-4c85-9ee3-92a027718f9f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:51.417171 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 188/383] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:51.436517 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711ea00-e3a6-455b-9c5c-8e1e342a1170 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:51.600195 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:51.633427 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711ea00-e3a6-455b-9c5c-8e1e342a1170 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:51.703051 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6ebfd-97d9-4bb1-93b4-617703a84411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:51.704696 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6ebfd-97d9-4bb1-93b4-617703a84411 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:51.705616 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6ebfd-97d9-4bb1-93b4-617703a84411 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:51.706397 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6ebfd-97d9-4bb1-93b4-617703a84411 None admin] PATH_INFO: `/v3/groups/c5b2af962e9149ebad07610517e45519` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:51.708874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6ebfd-97d9-4bb1-93b4-617703a84411 None admin] RBAC: Authorizing `identity:get_group(group_id=c5b2af962e9149ebad07610517e45519)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:51.711903 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6ebfd-97d9-4bb1-93b4-617703a84411 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:51.715819 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 189/384] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Oct 2 00:41:51 2022] GET /identity/v3/groups/c5b2af962e9149ebad07610517e45519 => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:51.725957 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6ebfd-97d9-4bb1-93b4-617703a84411 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:51.791240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84de9e-7710-4c85-9ee3-92a027718f9f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:51.833475 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:51.910355 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276875e-5479-438d-b29b-014a67776e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:51.911899 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276875e-5479-438d-b29b-014a67776e80 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:51.915763 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276875e-5479-438d-b29b-014a67776e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:51.916670 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276875e-5479-438d-b29b-014a67776e80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:51.920650 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276875e-5479-438d-b29b-014a67776e80 None admin] RBAC: Adding query filter params (group.id=44a675205d804b3bbafd472ecd53192f, role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.project.id=6575bddc339f4fb18300234b880a2b64) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:51.921817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276875e-5479-438d-b29b-014a67776e80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:51.927251 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276875e-5479-438d-b29b-014a67776e80 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:51.949895 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 196/385] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Oct 2 00:41:51 2022] GET /identity/v3/role_assignments?group.id=44a675205d804b3bbafd472ecd53192f&scope.project.id=6575bddc339f4fb18300234b880a2b64&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 260 bytes in 549 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:52.088231 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6ebfd-97d9-4bb1-93b4-617703a84411 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:52.164320 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c5078-ef4b-4f4e-804d-4388d19076a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:52.165446 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c5078-ef4b-4f4e-804d-4388d19076a0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:52.165912 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c5078-ef4b-4f4e-804d-4388d19076a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:52.166381 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c5078-ef4b-4f4e-804d-4388d19076a0 None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:52.170348 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c5078-ef4b-4f4e-804d-4388d19076a0 None admin] RBAC: Authorizing `identity:get_project(project_id=141aed90ccfe453283d0e7fd34fb461d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:52.173216 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c5078-ef4b-4f4e-804d-4388d19076a0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:52.176468 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 190/386] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:51 2022] GET /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d => generated 298 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:52.187229 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276875e-5479-438d-b29b-014a67776e80 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:52.406775 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276875e-5479-438d-b29b-014a67776e80 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:52.427666 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:52.486713 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b209b4d-2f8c-4b7a-b1e0-31fce95210bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:52.487941 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b209b4d-2f8c-4b7a-b1e0-31fce95210bc None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:52.488450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b209b4d-2f8c-4b7a-b1e0-31fce95210bc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:52.488974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b209b4d-2f8c-4b7a-b1e0-31fce95210bc None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d/groups/c5b2af962e9149ebad07610517e45519/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:52.498676 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b209b4d-2f8c-4b7a-b1e0-31fce95210bc None admin] RBAC: Authorizing `identity:create_grant(project_id=141aed90ccfe453283d0e7fd34fb461d, group_id=c5b2af962e9149ebad07610517e45519, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:52.501684 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b209b4d-2f8c-4b7a-b1e0-31fce95210bc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:52.533771 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 197/387] 10.222.0.26 () {58 vars in 1442 bytes} [Sun Oct 2 00:41:52 2022] PUT /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d/groups/c5b2af962e9149ebad07610517e45519/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:41:52.713709 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9e5ac-ef0a-4aa8-aec1-0296369e944e None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:52.714180 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9e5ac-ef0a-4aa8-aec1-0296369e944e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:52.714330 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9e5ac-ef0a-4aa8-aec1-0296369e944e None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:52.715727 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 191/388] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:41:52.736116 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4cebc-143a-4a7b-9ecb-a3dc852e1e61 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:52.736616 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4cebc-143a-4a7b-9ecb-a3dc852e1e61 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:52.737134 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4cebc-143a-4a7b-9ecb-a3dc852e1e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:52.782872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b0a4cebc-143a-4a7b-9ecb-a3dc852e1e61 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:52.785030 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b0a4cebc-143a-4a7b-9ecb-a3dc852e1e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:52.947318 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 198/389] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:53.282404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9e5ac-ef0a-4aa8-aec1-0296369e944e None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:53.440699 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:53.463606 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9e5ac-ef0a-4aa8-aec1-0296369e944e None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:53.534874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa28a12-e2c1-4876-9012-9273ed4e8775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:53.535888 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa28a12-e2c1-4876-9012-9273ed4e8775 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:53.536372 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa28a12-e2c1-4876-9012-9273ed4e8775 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:53.536864 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa28a12-e2c1-4876-9012-9273ed4e8775 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:53.566297 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa28a12-e2c1-4876-9012-9273ed4e8775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:53.574395 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b78f3e-8a9f-4f24-8257-ba4ccf6dd23c None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:53.575371 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b78f3e-8a9f-4f24-8257-ba4ccf6dd23c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:53.575636 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-faa28a12-e2c1-4876-9012-9273ed4e8775 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:53.575636 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:53.575636 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:53.575636 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:53.575636 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:53.575636 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:53.575636 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:53.575636 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:53.575636 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:53.575636 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:53.575636 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:53.575636 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:53.575636 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:53.575636 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:53.575636 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:53.575636 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:53.576693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:53.576693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:53.576693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:53.576693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:53.576693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:53.576693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:53.576693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:53.576693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:53.576693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:53.576693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:53.576693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:53.576693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:53.576693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:53.576693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:53.576693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:53.576693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:53.577537 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:53.577537 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:53.577537 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:53.577537 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:53.577537 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:53.577537 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:53.577537 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:53.577537 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:53.577537 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:53.577537 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:53.577537 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:53.577537 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:53.578974 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 192/390] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:41:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:41:53.579230 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b78f3e-8a9f-4f24-8257-ba4ccf6dd23c None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:53.581245 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 199/391] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:53.587059 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa28a12-e2c1-4876-9012-9273ed4e8775 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:53.594078 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7261b1-9cf6-4060-b276-f6035a0cc5d4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:53.594692 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7261b1-9cf6-4060-b276-f6035a0cc5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:53.595168 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7261b1-9cf6-4060-b276-f6035a0cc5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:53.617791 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ce7261b1-9cf6-4060-b276-f6035a0cc5d4 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:53.619369 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ce7261b1-9cf6-4060-b276-f6035a0cc5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:53.762734 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 200/392] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:53.783676 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa28a12-e2c1-4876-9012-9273ed4e8775 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:53.826380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8dfc92-300a-4eb1-8e72-91c294a33322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:53.827383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dfc92-300a-4eb1-8e72-91c294a33322 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:53.827863 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dfc92-300a-4eb1-8e72-91c294a33322 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:53.828331 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dfc92-300a-4eb1-8e72-91c294a33322 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:53.829280 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dfc92-300a-4eb1-8e72-91c294a33322 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:53.829812 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dfc92-300a-4eb1-8e72-91c294a33322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:53.831455 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dfc92-300a-4eb1-8e72-91c294a33322 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:53.842528 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 193/393] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:41:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:53.848998 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7261b1-9cf6-4060-b276-f6035a0cc5d4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:53.860970 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd15244-4e4a-4f4d-ad1f-c3c54a745137 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:53.861288 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd15244-4e4a-4f4d-ad1f-c3c54a745137 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:53.861551 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd15244-4e4a-4f4d-ad1f-c3c54a745137 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:53.863313 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 194/394] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:53.868549 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f11d0a-047e-42de-a8ca-365044e729dc None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:53.868826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f11d0a-047e-42de-a8ca-365044e729dc None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:53.869138 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f11d0a-047e-42de-a8ca-365044e729dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:53.913951 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:53.916310 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-61f11d0a-047e-42de-a8ca-365044e729dc None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:53.921085 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-61f11d0a-047e-42de-a8ca-365044e729dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:53.943388 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:54.037067 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7261b1-9cf6-4060-b276-f6035a0cc5d4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:54.083423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112b309-8e56-4d6e-9c5c-4350bc86d829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:54.084001 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112b309-8e56-4d6e-9c5c-4350bc86d829 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:54.084281 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112b309-8e56-4d6e-9c5c-4350bc86d829 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:54.084549 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112b309-8e56-4d6e-9c5c-4350bc86d829 None admin] PATH_INFO: `/v3/groups/c5b2af962e9149ebad07610517e45519` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:54.088760 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112b309-8e56-4d6e-9c5c-4350bc86d829 None admin] RBAC: Authorizing `identity:get_group(group_id=c5b2af962e9149ebad07610517e45519)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:54.090816 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112b309-8e56-4d6e-9c5c-4350bc86d829 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:54.093139 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 201/395] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Oct 2 00:41:53 2022] GET /identity/v3/groups/c5b2af962e9149ebad07610517e45519 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:54.093976 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112b309-8e56-4d6e-9c5c-4350bc86d829 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:54.102518 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 195/396] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 02 00:41:54.103417 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f11d0a-047e-42de-a8ca-365044e729dc None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:54.219428 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:54.228646 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112b309-8e56-4d6e-9c5c-4350bc86d829 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:54.309916 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecf9c0-d532-4e46-b13e-9adf35b259f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:54.310832 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecf9c0-d532-4e46-b13e-9adf35b259f3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:54.311242 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecf9c0-d532-4e46-b13e-9adf35b259f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:54.311520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecf9c0-d532-4e46-b13e-9adf35b259f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:54.338357 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecf9c0-d532-4e46-b13e-9adf35b259f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:54.349673 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-daecf9c0-d532-4e46-b13e-9adf35b259f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:54.349673 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:54.349673 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:54.349673 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:54.349673 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:54.349673 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:54.349673 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:54.349673 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:54.349673 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:54.349673 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:54.349673 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:54.349673 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:54.349673 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:54.349673 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:54.349673 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:54.349673 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:54.350639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:54.350639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:54.350639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:54.350639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:54.350639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:54.350639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:54.350639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:54.350639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:54.350639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:54.350639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:54.350639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:54.350639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:54.350639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:54.350639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:54.350639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:54.350639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:54.351456 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:54.351456 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:54.351456 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:54.351456 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:54.351456 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:54.351456 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:54.351456 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:54.351456 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:54.351456 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:54.351456 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:54.351456 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:54.351456 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:54.359310 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 202/397] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:41:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:54.365959 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f11d0a-047e-42de-a8ca-365044e729dc None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:54.368457 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecf9c0-d532-4e46-b13e-9adf35b259f3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:54.437375 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574666ab-8f51-48f6-b763-07beb5ee2e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:54.438036 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574666ab-8f51-48f6-b763-07beb5ee2e0e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:54.438320 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574666ab-8f51-48f6-b763-07beb5ee2e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:54.438597 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574666ab-8f51-48f6-b763-07beb5ee2e0e None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:54.439835 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574666ab-8f51-48f6-b763-07beb5ee2e0e None admin] RBAC: Authorizing `identity:get_project(project_id=141aed90ccfe453283d0e7fd34fb461d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:54.442033 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574666ab-8f51-48f6-b763-07beb5ee2e0e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:54.443837 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 196/398] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:54 2022] GET /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d => generated 298 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:54.445377 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574666ab-8f51-48f6-b763-07beb5ee2e0e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:54.464713 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:54.543894 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecf9c0-d532-4e46-b13e-9adf35b259f3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:54.590139 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574666ab-8f51-48f6-b763-07beb5ee2e0e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:54.590644 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f836a8-239d-41ea-a508-343ea50893e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:54.592318 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f836a8-239d-41ea-a508-343ea50893e8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:54.592841 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f836a8-239d-41ea-a508-343ea50893e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:54.593374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f836a8-239d-41ea-a508-343ea50893e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:54.594541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f836a8-239d-41ea-a508-343ea50893e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:54.596105 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f836a8-239d-41ea-a508-343ea50893e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:54.597813 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f836a8-239d-41ea-a508-343ea50893e8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:54.614986 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 203/399] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:41:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:54.614986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f836a8-239d-41ea-a508-343ea50893e8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:54.645233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da821bb-e4c5-49ac-8814-b01cddaf5a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:54.645900 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da821bb-e4c5-49ac-8814-b01cddaf5a32 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:54.646181 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da821bb-e4c5-49ac-8814-b01cddaf5a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:54.646454 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da821bb-e4c5-49ac-8814-b01cddaf5a32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:54.650597 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:54.665049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da821bb-e4c5-49ac-8814-b01cddaf5a32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:54.671571 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-3da821bb-e4c5-49ac-8814-b01cddaf5a32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:54.671571 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:54.671571 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:54.671571 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:54.671571 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:54.671571 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:54.671571 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:54.671571 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:54.671571 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:54.671571 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:54.671571 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:54.671571 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:54.671571 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:54.671571 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:54.671571 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:54.671571 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:54.672654 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:54.672654 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:54.672654 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:54.672654 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:54.672654 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:54.672654 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:54.672654 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:54.672654 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:54.672654 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:54.672654 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:54.672654 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:54.672654 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:54.672654 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:54.672654 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:54.672654 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:54.672654 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:54.673519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:54.673519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:54.673519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:54.673519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:54.673519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:54.673519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:54.673519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:54.673519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:54.673519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:54.673519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:54.673519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:54.673519 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:54.678361 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 197/400] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:54.679051 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da821bb-e4c5-49ac-8814-b01cddaf5a32 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:54.766741 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:54.784647 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f836a8-239d-41ea-a508-343ea50893e8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:54.808193 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da821bb-e4c5-49ac-8814-b01cddaf5a32 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:54.839047 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda5308-451c-4ad7-816d-e4e60f846eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:54.839734 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda5308-451c-4ad7-816d-e4e60f846eac None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:54.840016 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda5308-451c-4ad7-816d-e4e60f846eac None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:54.840351 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda5308-451c-4ad7-816d-e4e60f846eac None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d/groups/c5b2af962e9149ebad07610517e45519/roles/030fcd169fb44f759772ef3101c07012` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:54.844497 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda5308-451c-4ad7-816d-e4e60f846eac None admin] RBAC: Authorizing `identity:create_grant(project_id=141aed90ccfe453283d0e7fd34fb461d, group_id=c5b2af962e9149ebad07610517e45519, role_id=030fcd169fb44f759772ef3101c07012)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:54.847589 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda5308-451c-4ad7-816d-e4e60f846eac None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:54.857798 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184cf38-b912-4688-9dd2-f10d183c8d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:54.858793 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184cf38-b912-4688-9dd2-f10d183c8d1e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:54.859331 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184cf38-b912-4688-9dd2-f10d183c8d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:54.859818 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184cf38-b912-4688-9dd2-f10d183c8d1e None admin] PATH_INFO: `/v3/groups/c5b2af962e9149ebad07610517e45519` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:54.861882 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184cf38-b912-4688-9dd2-f10d183c8d1e None admin] RBAC: Authorizing `identity:get_group(group_id=c5b2af962e9149ebad07610517e45519)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:54.864570 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184cf38-b912-4688-9dd2-f10d183c8d1e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:54.873570 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 198/401] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Oct 2 00:41:54 2022] GET /identity/v3/groups/c5b2af962e9149ebad07610517e45519 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:54.873570 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184cf38-b912-4688-9dd2-f10d183c8d1e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:54.884656 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 204/402] 10.222.0.26 () {58 vars in 1442 bytes} [Sun Oct 2 00:41:54 2022] PUT /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d/groups/c5b2af962e9149ebad07610517e45519/roles/030fcd169fb44f759772ef3101c07012 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:41:54.892666 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda5308-451c-4ad7-816d-e4e60f846eac None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:55.170533 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:55.181424 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184cf38-b912-4688-9dd2-f10d183c8d1e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:55.221864 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda5308-451c-4ad7-816d-e4e60f846eac None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:55.289023 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2e05b-135d-442d-a1f6-fce03175acf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:55.290731 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2e05b-135d-442d-a1f6-fce03175acf0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:55.291396 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2e05b-135d-442d-a1f6-fce03175acf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:55.292744 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2e05b-135d-442d-a1f6-fce03175acf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:55.295207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2e05b-135d-442d-a1f6-fce03175acf0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:55.296007 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2e05b-135d-442d-a1f6-fce03175acf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:55.300233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2e05b-135d-442d-a1f6-fce03175acf0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:55.319909 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:55.326796 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21e989-9d19-49e9-bef1-7d2cbb0e623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:55.327871 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21e989-9d19-49e9-bef1-7d2cbb0e623b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:55.328340 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21e989-9d19-49e9-bef1-7d2cbb0e623b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:55.328823 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21e989-9d19-49e9-bef1-7d2cbb0e623b None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:55.332746 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21e989-9d19-49e9-bef1-7d2cbb0e623b None admin] RBAC: Authorizing `identity:get_project(project_id=4bd87b88a6204ecaa0e15f4cb612ef96)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:55.335882 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21e989-9d19-49e9-bef1-7d2cbb0e623b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:55.340121 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 199/403] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:55.344384 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 205/404] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:54 2022] GET /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96 => generated 302 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:55.350105 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2e05b-135d-442d-a1f6-fce03175acf0 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:55.353761 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21e989-9d19-49e9-bef1-7d2cbb0e623b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:55.502949 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21e989-9d19-49e9-bef1-7d2cbb0e623b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:55.562054 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316bea8-947c-4c23-929b-5d06de2d066d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:55.563652 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316bea8-947c-4c23-929b-5d06de2d066d None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:55.564428 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316bea8-947c-4c23-929b-5d06de2d066d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:55.565201 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316bea8-947c-4c23-929b-5d06de2d066d None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96/groups/c5b2af962e9149ebad07610517e45519/roles/030fcd169fb44f759772ef3101c07012` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:55.569504 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316bea8-947c-4c23-929b-5d06de2d066d None admin] RBAC: Authorizing `identity:create_grant(project_id=4bd87b88a6204ecaa0e15f4cb612ef96, group_id=c5b2af962e9149ebad07610517e45519, role_id=030fcd169fb44f759772ef3101c07012)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:55.572584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316bea8-947c-4c23-929b-5d06de2d066d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:55.583086 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2e05b-135d-442d-a1f6-fce03175acf0 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:55.607503 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 206/405] 10.222.0.26 () {58 vars in 1442 bytes} [Sun Oct 2 00:41:55 2022] PUT /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96/groups/c5b2af962e9149ebad07610517e45519/roles/030fcd169fb44f759772ef3101c07012 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:41:55.607503 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb924d4e-f8d9-427f-944e-8612d30ce556 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:55.607503 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb924d4e-f8d9-427f-944e-8612d30ce556 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:55.607503 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb924d4e-f8d9-427f-944e-8612d30ce556 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:55.610437 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 207/406] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:55.616339 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3ee7e-5167-4a5a-b88b-a81adcb91fe4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:55.616734 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3ee7e-5167-4a5a-b88b-a81adcb91fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:55.616878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3ee7e-5167-4a5a-b88b-a81adcb91fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:55.636123 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:55.639295 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-24c3ee7e-5167-4a5a-b88b-a81adcb91fe4 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:55.640734 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-24c3ee7e-5167-4a5a-b88b-a81adcb91fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:55.688221 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14db837-e37b-43d6-be9e-a4f99a8f5ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:55.689177 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14db837-e37b-43d6-be9e-a4f99a8f5ddd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:55.689453 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14db837-e37b-43d6-be9e-a4f99a8f5ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:55.689732 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14db837-e37b-43d6-be9e-a4f99a8f5ddd None admin] PATH_INFO: `/v3/groups/c5b2af962e9149ebad07610517e45519` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:55.692667 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14db837-e37b-43d6-be9e-a4f99a8f5ddd None admin] RBAC: Authorizing `identity:get_group(group_id=c5b2af962e9149ebad07610517e45519)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:55.694410 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14db837-e37b-43d6-be9e-a4f99a8f5ddd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:55.701727 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 200/407] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Oct 2 00:41:55 2022] GET /identity/v3/groups/c5b2af962e9149ebad07610517e45519 => generated 226 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:55.704931 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14db837-e37b-43d6-be9e-a4f99a8f5ddd None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:55.806415 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 208/408] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:41:55.840435 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:55.882687 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14db837-e37b-43d6-be9e-a4f99a8f5ddd None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:55.923736 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c7b98-fe17-476e-a355-be39562ec203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:55.924398 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c7b98-fe17-476e-a355-be39562ec203 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:55.924692 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c7b98-fe17-476e-a355-be39562ec203 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:55.924973 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c7b98-fe17-476e-a355-be39562ec203 None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:55.926285 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c7b98-fe17-476e-a355-be39562ec203 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd87b88a6204ecaa0e15f4cb612ef96)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:55.927779 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c7b98-fe17-476e-a355-be39562ec203 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:55.929949 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 201/409] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:55 2022] GET /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:55.936824 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3ee7e-5167-4a5a-b88b-a81adcb91fe4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:56.089437 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3ee7e-5167-4a5a-b88b-a81adcb91fe4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:56.136385 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeb8cf-3873-4552-ab88-079823abbe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:56.137094 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeb8cf-3873-4552-ab88-079823abbe02 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:56.137378 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeb8cf-3873-4552-ab88-079823abbe02 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:56.137656 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeb8cf-3873-4552-ab88-079823abbe02 None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96/groups/c5b2af962e9149ebad07610517e45519/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:56.140857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfeb8cf-3873-4552-ab88-079823abbe02 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bd87b88a6204ecaa0e15f4cb612ef96, group_id=c5b2af962e9149ebad07610517e45519, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:56.142401 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfeb8cf-3873-4552-ab88-079823abbe02 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:56.146161 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:56.174810 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 209/410] 10.222.0.26 () {58 vars in 1442 bytes} [Sun Oct 2 00:41:55 2022] PUT /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96/groups/c5b2af962e9149ebad07610517e45519/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:41:56.314090 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c7b98-fe17-476e-a355-be39562ec203 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:56.482623 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c7b98-fe17-476e-a355-be39562ec203 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:56.550835 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797fc3df-6063-494f-a2ef-95651816452f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:56.552400 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fc3df-6063-494f-a2ef-95651816452f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:56.553364 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fc3df-6063-494f-a2ef-95651816452f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:56.554139 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fc3df-6063-494f-a2ef-95651816452f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:56.559960 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:56.579859 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797fc3df-6063-494f-a2ef-95651816452f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:56.590829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-797fc3df-6063-494f-a2ef-95651816452f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:41:56.590829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:56.590829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:56.590829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:56.590829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:56.590829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:56.590829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:56.590829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:56.590829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:56.590829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:56.590829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:56.590829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:56.590829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:56.590829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:56.590829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:56.590829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:56.593792 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:56.593792 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:56.593792 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:56.593792 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:56.593792 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:56.593792 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:56.593792 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:56.593792 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:56.593792 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:56.593792 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:56.593792 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:56.593792 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:56.593792 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:56.593792 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:56.593792 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:56.593792 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:56.596918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:56.596918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:56.596918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:56.596918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:56.596918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:56.596918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:56.596918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:56.596918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:56.596918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:56.596918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:56.596918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:41:56.596918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:56.596918 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 202/411] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:41:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:56.606496 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeb8cf-3873-4552-ab88-079823abbe02 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:56.610732 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af0377-a0df-4063-bedb-356c1e324dd0 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:56.611212 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af0377-a0df-4063-bedb-356c1e324dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:56.611674 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af0377-a0df-4063-bedb-356c1e324dd0 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:56.616651 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 203/412] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:41:56.626205 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf11562-1604-4cb9-9a8d-70e1c10666bb None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:56.627668 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf11562-1604-4cb9-9a8d-70e1c10666bb None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:56.628155 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf11562-1604-4cb9-9a8d-70e1c10666bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:56.665774 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-bbf11562-1604-4cb9-9a8d-70e1c10666bb None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:56.666938 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-bbf11562-1604-4cb9-9a8d-70e1c10666bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:56.785209 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 204/413] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:41:56.879349 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeb8cf-3873-4552-ab88-079823abbe02 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:56.987533 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214078b-4679-4ad1-b16b-36241efc6a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:56.988073 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214078b-4679-4ad1-b16b-36241efc6a01 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:56.988352 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214078b-4679-4ad1-b16b-36241efc6a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:56.988630 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214078b-4679-4ad1-b16b-36241efc6a01 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:56.989449 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214078b-4679-4ad1-b16b-36241efc6a01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:56.989765 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214078b-4679-4ad1-b16b-36241efc6a01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:56.991207 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214078b-4679-4ad1-b16b-36241efc6a01 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:57.006218 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 210/414] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:57.015646 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf11562-1604-4cb9-9a8d-70e1c10666bb None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:57.164014 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf11562-1604-4cb9-9a8d-70e1c10666bb None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:57.205461 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:57.217695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936877c-a4cd-4981-a7c2-1adf5279bd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:57.218354 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936877c-a4cd-4981-a7c2-1adf5279bd14 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:57.218645 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936877c-a4cd-4981-a7c2-1adf5279bd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:57.218897 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936877c-a4cd-4981-a7c2-1adf5279bd14 None admin] PATH_INFO: `/v3/groups/44a675205d804b3bbafd472ecd53192f` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:57.220058 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936877c-a4cd-4981-a7c2-1adf5279bd14 None admin] RBAC: Authorizing `identity:get_group(group_id=44a675205d804b3bbafd472ecd53192f)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:57.221581 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936877c-a4cd-4981-a7c2-1adf5279bd14 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:57.223527 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 205/415] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Oct 2 00:41:57 2022] GET /identity/v3/groups/44a675205d804b3bbafd472ecd53192f => generated 229 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:57.232512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214078b-4679-4ad1-b16b-36241efc6a01 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:57.349646 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:57.390675 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936877c-a4cd-4981-a7c2-1adf5279bd14 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:57.445410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214078b-4679-4ad1-b16b-36241efc6a01 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:57.509486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1898c-2e59-4ef5-866c-0b8526c55e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:57.509486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1898c-2e59-4ef5-866c-0b8526c55e1e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:57.509486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1898c-2e59-4ef5-866c-0b8526c55e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:57.509486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1898c-2e59-4ef5-866c-0b8526c55e1e None admin] PATH_INFO: `/v3/projects/6575bddc339f4fb18300234b880a2b64` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:57.509855 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1898c-2e59-4ef5-866c-0b8526c55e1e None admin] RBAC: Authorizing `identity:get_project(project_id=6575bddc339f4fb18300234b880a2b64)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:57.512242 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1898c-2e59-4ef5-866c-0b8526c55e1e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:57.516818 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 211/416] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:57 2022] GET /identity/v3/projects/6575bddc339f4fb18300234b880a2b64 => generated 344 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:57.526122 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1898c-2e59-4ef5-866c-0b8526c55e1e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:57.638423 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936877c-a4cd-4981-a7c2-1adf5279bd14 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:57.684542 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaa52a-8024-4da2-adad-af7132bd78ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:57.686266 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaa52a-8024-4da2-adad-af7132bd78ab None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:57.686742 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaa52a-8024-4da2-adad-af7132bd78ab None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:57.687844 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaa52a-8024-4da2-adad-af7132bd78ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:57.700911 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcaa52a-8024-4da2-adad-af7132bd78ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:57.706811 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-8dcaa52a-8024-4da2-adad-af7132bd78ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:57.706811 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:57.706811 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:57.706811 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:57.706811 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:57.706811 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:57.706811 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:57.706811 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:57.706811 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:57.706811 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:57.706811 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:57.706811 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:57.706811 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:57.706811 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:57.706811 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:57.706811 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:57.707748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:57.707748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:57.707748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:57.707748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:57.707748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:57.707748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:57.707748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:57.707748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:57.707748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:57.707748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:57.707748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:57.707748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:57.707748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:57.707748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:57.707748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:57.707748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:57.708548 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:57.708548 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:57.708548 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:57.708548 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:57.708548 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:57.708548 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:57.708548 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:57.708548 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:57.708548 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:57.708548 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:57.708548 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:41:57.708548 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:41:57.711178 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 206/417] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:41:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:57.718009 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaa52a-8024-4da2-adad-af7132bd78ab None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:57.788144 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1898c-2e59-4ef5-866c-0b8526c55e1e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:57.795605 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:57.833283 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1d406-e12f-40c7-90aa-0af8cf619161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:57.834348 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1d406-e12f-40c7-90aa-0af8cf619161 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:57.834838 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1d406-e12f-40c7-90aa-0af8cf619161 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:57.835303 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1d406-e12f-40c7-90aa-0af8cf619161 None admin] PATH_INFO: `/v3/projects/6575bddc339f4fb18300234b880a2b64/groups/44a675205d804b3bbafd472ecd53192f/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:57.838078 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1d406-e12f-40c7-90aa-0af8cf619161 None admin] RBAC: Authorizing `identity:create_grant(project_id=6575bddc339f4fb18300234b880a2b64, group_id=44a675205d804b3bbafd472ecd53192f, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:57.839901 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1d406-e12f-40c7-90aa-0af8cf619161 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:57.845636 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:57.858722 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 212/418] 10.222.0.26 () {58 vars in 1442 bytes} [Sun Oct 2 00:41:57 2022] PUT /identity/v3/projects/6575bddc339f4fb18300234b880a2b64/groups/44a675205d804b3bbafd472ecd53192f/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:41:57.964172 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaa52a-8024-4da2-adad-af7132bd78ab None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:58.061257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e2845-4724-4a64-b8f0-b1d1c5901221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:58.062256 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2845-4724-4a64-b8f0-b1d1c5901221 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:58.062732 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2845-4724-4a64-b8f0-b1d1c5901221 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:58.063205 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2845-4724-4a64-b8f0-b1d1c5901221 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:58.064390 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e2845-4724-4a64-b8f0-b1d1c5901221 None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:58.064960 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e2845-4724-4a64-b8f0-b1d1c5901221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:58.067622 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e2845-4724-4a64-b8f0-b1d1c5901221 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:58.092758 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 207/419] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:41:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:41:58.098569 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1d406-e12f-40c7-90aa-0af8cf619161 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:58.229888 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1d406-e12f-40c7-90aa-0af8cf619161 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:58.268267 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99447827-1d9e-43cd-9ff6-9e259fbe1dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:58.269240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99447827-1d9e-43cd-9ff6-9e259fbe1dcd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:58.269660 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99447827-1d9e-43cd-9ff6-9e259fbe1dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:58.270070 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99447827-1d9e-43cd-9ff6-9e259fbe1dcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:58.351714 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:58.367828 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99447827-1d9e-43cd-9ff6-9e259fbe1dcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:58.369661 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99447827-1d9e-43cd-9ff6-9e259fbe1dcd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:58.559083 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 213/420] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:41:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 02 00:41:58.566122 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e2845-4724-4a64-b8f0-b1d1c5901221 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:58.637299 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d85f46-f64a-483c-9e73-0a2c8fc982fe None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:58.637715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d85f46-f64a-483c-9e73-0a2c8fc982fe None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:58.638656 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d85f46-f64a-483c-9e73-0a2c8fc982fe None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:58.641435 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 214/421] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:58.651893 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cae82-dcad-415f-9738-10a843c1a402 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:58.652721 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cae82-dcad-415f-9738-10a843c1a402 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:58.653537 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cae82-dcad-415f-9738-10a843c1a402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:58.684702 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-130cae82-dcad-415f-9738-10a843c1a402 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:58.687865 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-130cae82-dcad-415f-9738-10a843c1a402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:58.774770 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e2845-4724-4a64-b8f0-b1d1c5901221 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:58.815837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:58.857857 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 215/422] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:41:58.867701 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883d310-b91d-4b8e-849e-16f9230c4573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:58.868795 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883d310-b91d-4b8e-849e-16f9230c4573 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:58.869329 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883d310-b91d-4b8e-849e-16f9230c4573 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:58.869820 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883d310-b91d-4b8e-849e-16f9230c4573 None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:58.871783 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883d310-b91d-4b8e-849e-16f9230c4573 None admin] RBAC: Authorizing `identity:get_project(project_id=141aed90ccfe453283d0e7fd34fb461d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:58.875239 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883d310-b91d-4b8e-849e-16f9230c4573 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:58.878795 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 208/423] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:41:58 2022] GET /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:58.889223 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cae82-dcad-415f-9738-10a843c1a402 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:58.929540 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:59.107798 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cae82-dcad-415f-9738-10a843c1a402 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:59.175184 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727da49-d6c8-40a9-97f2-7153a6c9c317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:59.176261 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727da49-d6c8-40a9-97f2-7153a6c9c317 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:59.176758 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727da49-d6c8-40a9-97f2-7153a6c9c317 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:59.177262 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727da49-d6c8-40a9-97f2-7153a6c9c317 None admin] PATH_INFO: `/v3/groups/c5b2af962e9149ebad07610517e45519` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:59.179427 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727da49-d6c8-40a9-97f2-7153a6c9c317 None admin] RBAC: Authorizing `identity:get_group(group_id=c5b2af962e9149ebad07610517e45519)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:59.182395 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727da49-d6c8-40a9-97f2-7153a6c9c317 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:59.186674 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 216/424] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Oct 2 00:41:58 2022] GET /identity/v3/groups/c5b2af962e9149ebad07610517e45519 => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:59.196723 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883d310-b91d-4b8e-849e-16f9230c4573 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:59.267531 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19c5d6-79e8-4dda-9ca0-12367f8f670b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:59.268035 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19c5d6-79e8-4dda-9ca0-12367f8f670b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:59.268530 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19c5d6-79e8-4dda-9ca0-12367f8f670b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:59.271546 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 217/425] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:59.278861 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e3304-7552-4c8c-81b0-8e9d104735b4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:59.279174 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e3304-7552-4c8c-81b0-8e9d104735b4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:59.279519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e3304-7552-4c8c-81b0-8e9d104735b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:59.334962 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ae0e3304-7552-4c8c-81b0-8e9d104735b4 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:59.337045 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ae0e3304-7552-4c8c-81b0-8e9d104735b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:59.485760 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883d310-b91d-4b8e-849e-16f9230c4573 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:59.534213 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 218/426] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:59.535744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e3304-7552-4c8c-81b0-8e9d104735b4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:59.554941 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38a003-b8c2-4bd5-aa38-b22fcc8fd5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:59.555981 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a003-b8c2-4bd5-aa38-b22fcc8fd5cb None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:59.556513 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a003-b8c2-4bd5-aa38-b22fcc8fd5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:59.557728 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a003-b8c2-4bd5-aa38-b22fcc8fd5cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:59.558400 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38a003-b8c2-4bd5-aa38-b22fcc8fd5cb None admin] RBAC: Adding query filter params (group.id=c5b2af962e9149ebad07610517e45519, role.id=424fdbf5034b4445bf8a3022b9fb8b4c, scope.project.id=141aed90ccfe453283d0e7fd34fb461d) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:41:59.558944 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38a003-b8c2-4bd5-aa38-b22fcc8fd5cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:41:59.562050 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38a003-b8c2-4bd5-aa38-b22fcc8fd5cb None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:41:59.578872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:59.581549 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 209/427] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Oct 2 00:41:59 2022] GET /identity/v3/role_assignments?group.id=c5b2af962e9149ebad07610517e45519&scope.project.id=141aed90ccfe453283d0e7fd34fb461d&role.id=424fdbf5034b4445bf8a3022b9fb8b4c => generated 611 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:41:59.590380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6af78-e92d-4bfc-b384-ffae43aa2f98 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:59.590380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6af78-e92d-4bfc-b384-ffae43aa2f98 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:59.590380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6af78-e92d-4bfc-b384-ffae43aa2f98 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:59.592917 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 210/428] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:41:59 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:41:59.604990 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed8271-3f9c-4240-ab87-ac6693d456b2 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:59.604990 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed8271-3f9c-4240-ab87-ac6693d456b2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:59.604990 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed8271-3f9c-4240-ab87-ac6693d456b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:59.636985 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-43ed8271-3f9c-4240-ab87-ac6693d456b2 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:41:59.636985 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-43ed8271-3f9c-4240-ab87-ac6693d456b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:41:59.784758 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:41:59.826032 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 211/429] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:41:59.848787 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed8271-3f9c-4240-ab87-ac6693d456b2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:41:59.890395 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e3304-7552-4c8c-81b0-8e9d104735b4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:41:59.963477 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47207752-e927-4a25-bb7c-60ee51fcd949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:41:59.964143 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47207752-e927-4a25-bb7c-60ee51fcd949 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:41:59.964419 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47207752-e927-4a25-bb7c-60ee51fcd949 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:41:59.964698 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47207752-e927-4a25-bb7c-60ee51fcd949 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:41:59.980804 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47207752-e927-4a25-bb7c-60ee51fcd949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:41:59.986942 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-47207752-e927-4a25-bb7c-60ee51fcd949 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:59.986942 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:41:59.986942 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:41:59.986942 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:41:59.986942 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:41:59.986942 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:41:59.986942 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:41:59.986942 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:41:59.986942 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:41:59.986942 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:41:59.986942 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:41:59.986942 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:41:59.986942 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:41:59.986942 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:41:59.986942 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:41:59.986942 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:41:59.988724 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:41:59.988724 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:41:59.988724 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:41:59.988724 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:41:59.988724 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:41:59.988724 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:41:59.988724 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:41:59.988724 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:41:59.988724 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:41:59.988724 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:41:59.988724 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:41:59.988724 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:41:59.988724 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:41:59.988724 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:41:59.988724 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:41:59.988724 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:41:59.990364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:41:59.990364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:41:59.990364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:41:59.990364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:41:59.990364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:41:59.990364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:41:59.990364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:41:59.990364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:41:59.990364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:41:59.990364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:41:59.990364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:41:59.990364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:41:59.990364 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 219/430] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:41:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:41:59.993824 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47207752-e927-4a25-bb7c-60ee51fcd949 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:00.076431 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed8271-3f9c-4240-ab87-ac6693d456b2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:00.122110 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4320b0-9f79-4c08-bead-01527c02a3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:00.122860 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4320b0-9f79-4c08-bead-01527c02a3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:00.123335 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4320b0-9f79-4c08-bead-01527c02a3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:00.123613 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4320b0-9f79-4c08-bead-01527c02a3a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:00.138321 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4320b0-9f79-4c08-bead-01527c02a3a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:00.141058 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:00.144630 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-ff4320b0-9f79-4c08-bead-01527c02a3a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:42:00.144630 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:00.144630 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:00.144630 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:00.144630 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:00.144630 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:00.144630 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:00.144630 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:00.144630 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:00.144630 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:00.144630 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:00.144630 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:00.144630 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:00.144630 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:00.144630 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:00.144630 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:00.146394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:00.146394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:00.146394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:00.146394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:00.146394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:00.146394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:00.146394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:00.146394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:00.146394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:00.146394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:00.146394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:00.146394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:00.146394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:00.146394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:00.146394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:00.146394 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:00.148844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:00.148844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:00.148844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:00.148844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:00.148844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:00.148844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:00.148844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:00.148844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:00.148844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:00.148844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:00.148844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:42:00.148844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:00.148844 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 212/431] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:41:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:42:00.148844 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4320b0-9f79-4c08-bead-01527c02a3a7 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:00.193175 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47207752-e927-4a25-bb7c-60ee51fcd949 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:00.206537 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:00.249936 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d159c4-a78f-4cc6-88b0-70a1d6831ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:00.250562 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d159c4-a78f-4cc6-88b0-70a1d6831ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:00.250841 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d159c4-a78f-4cc6-88b0-70a1d6831ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:00.251127 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d159c4-a78f-4cc6-88b0-70a1d6831ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:00.251779 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d159c4-a78f-4cc6-88b0-70a1d6831ac6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:00.252081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d159c4-a78f-4cc6-88b0-70a1d6831ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:00.255301 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d159c4-a78f-4cc6-88b0-70a1d6831ac6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:00.270041 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 220/432] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:41:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:42:00.271713 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d159c4-a78f-4cc6-88b0-70a1d6831ac6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:00.293569 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4320b0-9f79-4c08-bead-01527c02a3a7 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:00.345775 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab67874-1f2c-4912-b60c-bfd2d78fb058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:00.346831 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab67874-1f2c-4912-b60c-bfd2d78fb058 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:00.347648 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab67874-1f2c-4912-b60c-bfd2d78fb058 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:00.348093 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab67874-1f2c-4912-b60c-bfd2d78fb058 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:00.363373 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab67874-1f2c-4912-b60c-bfd2d78fb058 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:00.368535 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-dab67874-1f2c-4912-b60c-bfd2d78fb058 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:42:00.368535 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:00.368535 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:00.368535 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:00.368535 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:00.368535 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:00.368535 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:00.368535 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:00.368535 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:00.368535 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:00.368535 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:00.368535 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:00.368535 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:00.368535 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:00.368535 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:00.368535 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:00.369631 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:00.369631 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:00.369631 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:00.369631 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:00.369631 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:00.369631 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:00.369631 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:00.369631 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:00.369631 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:00.369631 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:00.369631 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:00.369631 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:00.369631 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:00.369631 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:00.369631 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:00.369631 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:00.370432 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:00.370432 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:00.370432 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:00.370432 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:00.370432 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:00.370432 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:00.370432 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:00.370432 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:00.370432 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:00.370432 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:00.370432 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:42:00.370432 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:00.370432 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 213/433] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:42:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:00.371641 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab67874-1f2c-4912-b60c-bfd2d78fb058 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:00.411044 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d159c4-a78f-4cc6-88b0-70a1d6831ac6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:00.463830 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30001e-ed3b-4d57-bc48-1658ea76763d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:00.464455 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30001e-ed3b-4d57-bc48-1658ea76763d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:00.464735 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30001e-ed3b-4d57-bc48-1658ea76763d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:00.465043 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30001e-ed3b-4d57-bc48-1658ea76763d None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:00.465731 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30001e-ed3b-4d57-bc48-1658ea76763d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:00.466562 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30001e-ed3b-4d57-bc48-1658ea76763d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:00.467969 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30001e-ed3b-4d57-bc48-1658ea76763d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:00.470950 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:00.485336 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 221/434] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:00.486610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30001e-ed3b-4d57-bc48-1658ea76763d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:00.537467 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:00.542499 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab67874-1f2c-4912-b60c-bfd2d78fb058 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:00.585353 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277865a5-933b-40ac-82d7-40297954ee97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:00.585968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277865a5-933b-40ac-82d7-40297954ee97 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:00.586250 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277865a5-933b-40ac-82d7-40297954ee97 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:00.586522 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277865a5-933b-40ac-82d7-40297954ee97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:00.654010 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30001e-ed3b-4d57-bc48-1658ea76763d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:00.709352 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0056d-9661-4c13-bbc2-b263e30fea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:00.710396 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0056d-9661-4c13-bbc2-b263e30fea18 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:00.710873 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0056d-9661-4c13-bbc2-b263e30fea18 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:00.711365 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0056d-9661-4c13-bbc2-b263e30fea18 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:00.712634 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0056d-9661-4c13-bbc2-b263e30fea18 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:00.713198 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0056d-9661-4c13-bbc2-b263e30fea18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:00.716377 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0056d-9661-4c13-bbc2-b263e30fea18 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:00.723811 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277865a5-933b-40ac-82d7-40297954ee97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:00.725395 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277865a5-933b-40ac-82d7-40297954ee97 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:00.741850 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 222/435] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:42:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:00.741850 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0056d-9661-4c13-bbc2-b263e30fea18 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:00.861711 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:00.907311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:00.921520 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 214/436] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:42:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:42:00.922486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0056d-9661-4c13-bbc2-b263e30fea18 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:00.923811 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277865a5-933b-40ac-82d7-40297954ee97 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:00.977770 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46377ea2-6f57-4fe5-af16-4ca228be7103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:00.978761 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46377ea2-6f57-4fe5-af16-4ca228be7103 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:00.979215 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46377ea2-6f57-4fe5-af16-4ca228be7103 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:00.979668 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46377ea2-6f57-4fe5-af16-4ca228be7103 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:01.074475 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277865a5-933b-40ac-82d7-40297954ee97 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:01.079441 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46377ea2-6f57-4fe5-af16-4ca228be7103 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:01.082286 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46377ea2-6f57-4fe5-af16-4ca228be7103 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:01.120849 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e3296-2278-4117-9384-ce4c4130c783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:01.121552 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e3296-2278-4117-9384-ce4c4130c783 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:01.122548 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e3296-2278-4117-9384-ce4c4130c783 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:01.123042 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e3296-2278-4117-9384-ce4c4130c783 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:01.165715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:01.217858 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 223/437] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:42:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:42:01.218738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46377ea2-6f57-4fe5-af16-4ca228be7103 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:01.230180 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:01.239070 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e3296-2278-4117-9384-ce4c4130c783 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:01.242500 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e3296-2278-4117-9384-ce4c4130c783 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:01.345658 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46377ea2-6f57-4fe5-af16-4ca228be7103 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:01.392622 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 215/438] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:42:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:42:01.392622 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27b720-8c13-4340-ab7b-8e0a4208052b None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:01.392622 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27b720-8c13-4340-ab7b-8e0a4208052b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:01.392622 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27b720-8c13-4340-ab7b-8e0a4208052b None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:01.392622 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 216/439] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:01.392622 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27b720-8c13-4340-ab7b-8e0a4208052b None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:01.397715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b2910-e81f-48da-b3e6-0e0c7d82ac35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:01.398707 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b2910-e81f-48da-b3e6-0e0c7d82ac35 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:01.399149 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b2910-e81f-48da-b3e6-0e0c7d82ac35 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:01.399585 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b2910-e81f-48da-b3e6-0e0c7d82ac35 None admin] PATH_INFO: `/v3/projects/141aed90ccfe453283d0e7fd34fb461d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:01.401474 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b2910-e81f-48da-b3e6-0e0c7d82ac35 None admin] RBAC: Authorizing `identity:get_project(project_id=141aed90ccfe453283d0e7fd34fb461d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:01.407589 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b2910-e81f-48da-b3e6-0e0c7d82ac35 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:01.407589 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 224/440] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:42:01 2022] GET /identity/v3/projects/141aed90ccfe453283d0e7fd34fb461d => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:01.409159 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b75c59-9edb-4502-a99b-1c7da75295f6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:01.409631 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b75c59-9edb-4502-a99b-1c7da75295f6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:01.410099 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b75c59-9edb-4502-a99b-1c7da75295f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:01.433360 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f9b75c59-9edb-4502-a99b-1c7da75295f6 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:01.435165 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f9b75c59-9edb-4502-a99b-1c7da75295f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:01.474325 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:01.535856 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 225/441] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:01.541113 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:01.542594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b75c59-9edb-4502-a99b-1c7da75295f6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:01.551458 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27b720-8c13-4340-ab7b-8e0a4208052b None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:01.614207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6bb5e-44db-449e-ae20-b62e2a984241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:01.615262 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6bb5e-44db-449e-ae20-b62e2a984241 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:01.615740 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6bb5e-44db-449e-ae20-b62e2a984241 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:01.616204 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6bb5e-44db-449e-ae20-b62e2a984241 None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:01.618218 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6bb5e-44db-449e-ae20-b62e2a984241 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd87b88a6204ecaa0e15f4cb612ef96)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:01.621023 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6bb5e-44db-449e-ae20-b62e2a984241 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:01.628967 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 217/442] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:42:01 2022] GET /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:01.628967 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6bb5e-44db-449e-ae20-b62e2a984241 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:01.732671 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b75c59-9edb-4502-a99b-1c7da75295f6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:01.778566 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2869b1-9812-4fc7-9a3c-c40e61828ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:01.780345 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2869b1-9812-4fc7-9a3c-c40e61828ebf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:01.781116 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2869b1-9812-4fc7-9a3c-c40e61828ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:01.781793 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2869b1-9812-4fc7-9a3c-c40e61828ebf None admin] PATH_INFO: `/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:01.784286 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2869b1-9812-4fc7-9a3c-c40e61828ebf None admin] RBAC: Authorizing `identity:get_project(project_id=4bd87b88a6204ecaa0e15f4cb612ef96)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:01.787116 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2869b1-9812-4fc7-9a3c-c40e61828ebf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:01.791023 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 226/443] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:42:01 2022] GET /identity/v3/projects/4bd87b88a6204ecaa0e15f4cb612ef96 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:01.792615 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2869b1-9812-4fc7-9a3c-c40e61828ebf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:01.813946 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6bb5e-44db-449e-ae20-b62e2a984241 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:01.850041 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:01.867032 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915cd5a-8e75-40b5-8c6d-e5b6a79a14b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:01.867666 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915cd5a-8e75-40b5-8c6d-e5b6a79a14b5 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:01.867947 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915cd5a-8e75-40b5-8c6d-e5b6a79a14b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:01.868221 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915cd5a-8e75-40b5-8c6d-e5b6a79a14b5 None admin] PATH_INFO: `/v3/groups/c5b2af962e9149ebad07610517e45519` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:01.869421 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915cd5a-8e75-40b5-8c6d-e5b6a79a14b5 None admin] RBAC: Authorizing `identity:get_group(group_id=c5b2af962e9149ebad07610517e45519)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:01.870901 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915cd5a-8e75-40b5-8c6d-e5b6a79a14b5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:01.873417 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 218/444] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Oct 2 00:42:01 2022] GET /identity/v3/groups/c5b2af962e9149ebad07610517e45519 => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:01.874204 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915cd5a-8e75-40b5-8c6d-e5b6a79a14b5 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:01.912924 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:01.984449 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2869b1-9812-4fc7-9a3c-c40e61828ebf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:01.989228 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915cd5a-8e75-40b5-8c6d-e5b6a79a14b5 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:02.026338 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023eb85-70b4-4525-9e2d-b0bb260ad026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:02.026976 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023eb85-70b4-4525-9e2d-b0bb260ad026 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:02.027254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023eb85-70b4-4525-9e2d-b0bb260ad026 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:02.027528 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023eb85-70b4-4525-9e2d-b0bb260ad026 None admin] PATH_INFO: `/v3/groups/c5b2af962e9149ebad07610517e45519` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:02.029278 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023eb85-70b4-4525-9e2d-b0bb260ad026 None admin] RBAC: Authorizing `identity:get_group(group_id=c5b2af962e9149ebad07610517e45519)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:02.030755 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023eb85-70b4-4525-9e2d-b0bb260ad026 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:02.032712 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 219/445] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Oct 2 00:42:01 2022] GET /identity/v3/groups/c5b2af962e9149ebad07610517e45519 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:02.033537 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023eb85-70b4-4525-9e2d-b0bb260ad026 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:02.046272 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe525b-8317-4c28-b0e5-94488e77e8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:02.047322 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe525b-8317-4c28-b0e5-94488e77e8fe None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:02.047817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe525b-8317-4c28-b0e5-94488e77e8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:02.048272 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe525b-8317-4c28-b0e5-94488e77e8fe None admin] PATH_INFO: `/v3/groups/c5b2af962e9149ebad07610517e45519` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:02.050302 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe525b-8317-4c28-b0e5-94488e77e8fe None admin] RBAC: Authorizing `identity:get_group(group_id=c5b2af962e9149ebad07610517e45519)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:02.053002 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe525b-8317-4c28-b0e5-94488e77e8fe None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:02.056106 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 227/446] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Oct 2 00:42:01 2022] GET /identity/v3/groups/c5b2af962e9149ebad07610517e45519 => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:02.057408 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe525b-8317-4c28-b0e5-94488e77e8fe None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:02.191610 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023eb85-70b4-4525-9e2d-b0bb260ad026 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:02.192603 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:02.194518 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:02.208281 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe525b-8317-4c28-b0e5-94488e77e8fe None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:02.249553 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b255dac-207d-41b4-81ee-e643ccf2c1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:02.250088 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b255dac-207d-41b4-81ee-e643ccf2c1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:02.250369 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b255dac-207d-41b4-81ee-e643ccf2c1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:02.250642 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b255dac-207d-41b4-81ee-e643ccf2c1c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:02.266429 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b255dac-207d-41b4-81ee-e643ccf2c1c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:02.272727 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-5b255dac-207d-41b4-81ee-e643ccf2c1c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:42:02.272727 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:02.272727 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:02.272727 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:02.272727 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:02.272727 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:02.272727 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:02.272727 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:02.272727 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:02.272727 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:02.272727 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:02.272727 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:02.272727 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:02.272727 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:02.272727 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:02.272727 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:02.274438 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:02.274438 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:02.274438 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:02.274438 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:02.274438 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:02.274438 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:02.274438 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:02.274438 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:02.274438 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:02.274438 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:02.274438 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:02.274438 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:02.274438 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:02.274438 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:02.274438 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:02.274438 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:02.275926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:02.275926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:02.275926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:02.275926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:02.275926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:02.275926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:02.275926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:02.275926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:02.275926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:02.275926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:02.275926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:42:02.275926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:02.277095 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ab42b-3427-492b-ae03-44a48fa193eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:02.277242 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 220/447] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:42:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:02.277242 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b255dac-207d-41b4-81ee-e643ccf2c1c8 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:02.277468 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ab42b-3427-492b-ae03-44a48fa193eb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:02.277468 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ab42b-3427-492b-ae03-44a48fa193eb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:02.277468 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ab42b-3427-492b-ae03-44a48fa193eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:02.277468 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ab42b-3427-492b-ae03-44a48fa193eb None admin] RBAC: Adding query filter params (group.id=c5b2af962e9149ebad07610517e45519, role.id=030fcd169fb44f759772ef3101c07012, scope.project.id=141aed90ccfe453283d0e7fd34fb461d) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:02.277904 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ab42b-3427-492b-ae03-44a48fa193eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:02.281694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ab42b-3427-492b-ae03-44a48fa193eb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:02.291343 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 228/448] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Oct 2 00:42:02 2022] GET /identity/v3/role_assignments?group.id=c5b2af962e9149ebad07610517e45519&scope.project.id=141aed90ccfe453283d0e7fd34fb461d&role.id=030fcd169fb44f759772ef3101c07012 => generated 611 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:02.295417 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ab42b-3427-492b-ae03-44a48fa193eb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:02.460492 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b255dac-207d-41b4-81ee-e643ccf2c1c8 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:02.503553 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ab42b-3427-492b-ae03-44a48fa193eb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:02.511933 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50b61a-ef63-4139-a368-0d7ea02e9041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:02.513299 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50b61a-ef63-4139-a368-0d7ea02e9041 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:02.513990 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50b61a-ef63-4139-a368-0d7ea02e9041 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:02.514484 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50b61a-ef63-4139-a368-0d7ea02e9041 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:02.515504 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50b61a-ef63-4139-a368-0d7ea02e9041 None admin] RBAC: Adding query filter params (group.id=c5b2af962e9149ebad07610517e45519, role.id=424fdbf5034b4445bf8a3022b9fb8b4c, scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:02.515853 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50b61a-ef63-4139-a368-0d7ea02e9041 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:02.517541 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50b61a-ef63-4139-a368-0d7ea02e9041 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:02.525742 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 221/449] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Oct 2 00:42:02 2022] GET /identity/v3/role_assignments?group.id=c5b2af962e9149ebad07610517e45519&scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96&role.id=424fdbf5034b4445bf8a3022b9fb8b4c => generated 611 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:02.527173 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50b61a-ef63-4139-a368-0d7ea02e9041 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:02.592440 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884149fa-c36c-4653-9f65-440b3a46f82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:02.593452 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884149fa-c36c-4653-9f65-440b3a46f82a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:02.593926 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884149fa-c36c-4653-9f65-440b3a46f82a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:02.596435 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884149fa-c36c-4653-9f65-440b3a46f82a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:02.597952 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884149fa-c36c-4653-9f65-440b3a46f82a None admin] RBAC: Adding query filter params (group.id=c5b2af962e9149ebad07610517e45519, role.id=030fcd169fb44f759772ef3101c07012, scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:02.598495 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884149fa-c36c-4653-9f65-440b3a46f82a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:02.601614 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884149fa-c36c-4653-9f65-440b3a46f82a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:02.602454 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:02.613855 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 229/450] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Oct 2 00:42:02 2022] GET /identity/v3/role_assignments?group.id=c5b2af962e9149ebad07610517e45519&scope.project.id=4bd87b88a6204ecaa0e15f4cb612ef96&role.id=030fcd169fb44f759772ef3101c07012 => generated 611 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:02.771569 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50b61a-ef63-4139-a368-0d7ea02e9041 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:02.832024 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e3e5f-f717-4a9f-b4cd-b3f840ecc744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:02.832649 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e3e5f-f717-4a9f-b4cd-b3f840ecc744 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:02.832929 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e3e5f-f717-4a9f-b4cd-b3f840ecc744 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:02.833223 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e3e5f-f717-4a9f-b4cd-b3f840ecc744 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:02.833918 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e3e5f-f717-4a9f-b4cd-b3f840ecc744 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:02.834335 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e3e5f-f717-4a9f-b4cd-b3f840ecc744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:02.835740 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e3e5f-f717-4a9f-b4cd-b3f840ecc744 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:02.853014 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 222/451] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:42:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:02.861761 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884149fa-c36c-4653-9f65-440b3a46f82a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:02.905863 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:03.039978 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884149fa-c36c-4653-9f65-440b3a46f82a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:03.102647 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212fa4f-31ee-42f7-939b-c8b1445c762c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:03.105827 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212fa4f-31ee-42f7-939b-c8b1445c762c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:03.106901 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212fa4f-31ee-42f7-939b-c8b1445c762c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:03.107465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212fa4f-31ee-42f7-939b-c8b1445c762c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:03.207565 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212fa4f-31ee-42f7-939b-c8b1445c762c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:03.210549 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212fa4f-31ee-42f7-939b-c8b1445c762c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:03.240524 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:03.373216 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 230/452] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:42:03.379264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e3e5f-f717-4a9f-b4cd-b3f840ecc744 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:03.527599 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:03.546399 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e3e5f-f717-4a9f-b4cd-b3f840ecc744 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:03.586622 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71541f91-287b-40d8-ad5d-6a2bbc437a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:03.587357 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71541f91-287b-40d8-ad5d-6a2bbc437a66 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:03.587696 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71541f91-287b-40d8-ad5d-6a2bbc437a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:03.588112 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71541f91-287b-40d8-ad5d-6a2bbc437a66 None admin] PATH_INFO: `/v3/projects/6575bddc339f4fb18300234b880a2b64` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:03.589427 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71541f91-287b-40d8-ad5d-6a2bbc437a66 None admin] RBAC: Authorizing `identity:get_project(project_id=6575bddc339f4fb18300234b880a2b64)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:03.591676 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71541f91-287b-40d8-ad5d-6a2bbc437a66 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:03.593734 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 223/453] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:42:03 2022] GET /identity/v3/projects/6575bddc339f4fb18300234b880a2b64 => generated 344 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:42:03.600565 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212fa4f-31ee-42f7-939b-c8b1445c762c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:03.728961 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212fa4f-31ee-42f7-939b-c8b1445c762c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:03.758021 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:03.771766 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bde14-e468-45d3-bcf6-d83a5ff4de51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:03.772443 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bde14-e468-45d3-bcf6-d83a5ff4de51 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:03.772763 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bde14-e468-45d3-bcf6-d83a5ff4de51 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:03.773135 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bde14-e468-45d3-bcf6-d83a5ff4de51 None admin] PATH_INFO: `/v3/groups/44a675205d804b3bbafd472ecd53192f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:03.774323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bde14-e468-45d3-bcf6-d83a5ff4de51 None admin] RBAC: Authorizing `identity:get_group(group_id=44a675205d804b3bbafd472ecd53192f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:03.775825 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bde14-e468-45d3-bcf6-d83a5ff4de51 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:03.777475 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 231/454] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Oct 2 00:42:03 2022] GET /identity/v3/groups/44a675205d804b3bbafd472ecd53192f => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:42:03.784125 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71541f91-287b-40d8-ad5d-6a2bbc437a66 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:03.910222 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71541f91-287b-40d8-ad5d-6a2bbc437a66 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:03.956145 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527054a2-daa8-45f9-9a5e-22b8d1ebb42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:03.956888 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527054a2-daa8-45f9-9a5e-22b8d1ebb42b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:03.957302 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527054a2-daa8-45f9-9a5e-22b8d1ebb42b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:03.957666 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527054a2-daa8-45f9-9a5e-22b8d1ebb42b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:03.958531 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527054a2-daa8-45f9-9a5e-22b8d1ebb42b None admin] RBAC: Adding query filter params (group.id=44a675205d804b3bbafd472ecd53192f, role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.project.id=6575bddc339f4fb18300234b880a2b64) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:03.958931 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527054a2-daa8-45f9-9a5e-22b8d1ebb42b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:03.960550 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527054a2-daa8-45f9-9a5e-22b8d1ebb42b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:03.968017 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 224/455] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Oct 2 00:42:03 2022] GET /identity/v3/role_assignments?group.id=44a675205d804b3bbafd472ecd53192f&scope.project.id=6575bddc339f4fb18300234b880a2b64&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:42:06.938725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45894870-1c43-463b-bd74-93b734653875 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:06.938725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45894870-1c43-463b-bd74-93b734653875 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:06.938725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45894870-1c43-463b-bd74-93b734653875 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:06.941212 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 232/456] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:06.949452 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac791a-c25e-4063-b2ff-8a26199ad8c0 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:06.950544 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac791a-c25e-4063-b2ff-8a26199ad8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:06.950825 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac791a-c25e-4063-b2ff-8a26199ad8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:06.978950 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5bac791a-c25e-4063-b2ff-8a26199ad8c0 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:06.980245 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5bac791a-c25e-4063-b2ff-8a26199ad8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:07.001124 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:07.112897 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 225/457] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:07.778850 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e40c9e-63d8-4433-91af-c96e5c9027ff None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:07.779385 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e40c9e-63d8-4433-91af-c96e5c9027ff None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:07.779813 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e40c9e-63d8-4433-91af-c96e5c9027ff None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:07.781685 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 233/458] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:07.787914 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c0e4e-9ff8-4548-b69f-d8ea2768b84a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:07.788439 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c0e4e-9ff8-4548-b69f-d8ea2768b84a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:07.788869 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c0e4e-9ff8-4548-b69f-d8ea2768b84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:07.798420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e40c9e-63d8-4433-91af-c96e5c9027ff None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:07.829526 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b57c0e4e-9ff8-4548-b69f-d8ea2768b84a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:07.831557 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b57c0e4e-9ff8-4548-b69f-d8ea2768b84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:08.007646 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 226/459] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:42:08.024498 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e40c9e-63d8-4433-91af-c96e5c9027ff None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:08.092755 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a388a76-260c-4f6f-aeac-91ffdc34969e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:08.094187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a388a76-260c-4f6f-aeac-91ffdc34969e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:08.094862 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a388a76-260c-4f6f-aeac-91ffdc34969e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:08.095552 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a388a76-260c-4f6f-aeac-91ffdc34969e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:08.115546 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a388a76-260c-4f6f-aeac-91ffdc34969e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:08.118585 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a388a76-260c-4f6f-aeac-91ffdc34969e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:08.147463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-7a388a76-260c-4f6f-aeac-91ffdc34969e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:08.147463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:08.147463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:08.147463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:08.147463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:08.147463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:08.147463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:08.147463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:08.147463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:08.147463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:08.147463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:08.147463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:08.147463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:08.147463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:08.147463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:08.147463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:08.149466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:08.149466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:08.149466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:08.149466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:08.149466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:08.149466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:08.149466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:08.149466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:08.149466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:08.149466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:08.149466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:08.149466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:08.149466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:08.149466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:08.149466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:08.149466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:08.149466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:08.151294 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:08.151294 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:08.151294 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:08.154273 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 234/460] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:08.163550 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c0e4e-9ff8-4548-b69f-d8ea2768b84a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:08.285243 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1805fcd-8fd6-46af-88ae-c3574383a4b4 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:08.286072 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1805fcd-8fd6-46af-88ae-c3574383a4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:08.286724 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1805fcd-8fd6-46af-88ae-c3574383a4b4 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:08.289365 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 235/461] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:08.296185 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54291d9-2813-4d0b-a63b-09b0d8491036 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:08.296468 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54291d9-2813-4d0b-a63b-09b0d8491036 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:08.296710 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54291d9-2813-4d0b-a63b-09b0d8491036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:08.329941 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f54291d9-2813-4d0b-a63b-09b0d8491036 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:08.331648 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f54291d9-2813-4d0b-a63b-09b0d8491036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:08.357445 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:08.391301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c0e4e-9ff8-4548-b69f-d8ea2768b84a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:08.425360 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:08.439736 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac782b-06b0-406a-ad0d-d4d919eba302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:08.440365 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac782b-06b0-406a-ad0d-d4d919eba302 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:08.440635 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac782b-06b0-406a-ad0d-d4d919eba302 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:08.440894 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac782b-06b0-406a-ad0d-d4d919eba302 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:08.441624 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac782b-06b0-406a-ad0d-d4d919eba302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:08.441932 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac782b-06b0-406a-ad0d-d4d919eba302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:08.444271 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac782b-06b0-406a-ad0d-d4d919eba302 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:08.476311 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 227/462] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:08.476311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac782b-06b0-406a-ad0d-d4d919eba302 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:08.494910 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 236/463] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:08.496356 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54291d9-2813-4d0b-a63b-09b0d8491036 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:08.683018 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac782b-06b0-406a-ad0d-d4d919eba302 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:08.727002 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ea20e-a9d8-446d-a001-cf17633da937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:08.727322 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54291d9-2813-4d0b-a63b-09b0d8491036 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:08.727685 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ea20e-a9d8-446d-a001-cf17633da937 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:08.727930 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ea20e-a9d8-446d-a001-cf17633da937 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:08.728203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ea20e-a9d8-446d-a001-cf17633da937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:08.742518 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:08.749495 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ea20e-a9d8-446d-a001-cf17633da937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:08.752219 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ea20e-a9d8-446d-a001-cf17633da937 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:08.770366 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eae603-2e12-40a2-9bd7-f5e0bda038fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:08.770990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eae603-2e12-40a2-9bd7-f5e0bda038fe None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:08.771552 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eae603-2e12-40a2-9bd7-f5e0bda038fe None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:08.771835 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eae603-2e12-40a2-9bd7-f5e0bda038fe None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:08.772551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eae603-2e12-40a2-9bd7-f5e0bda038fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:08.774052 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eae603-2e12-40a2-9bd7-f5e0bda038fe None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:08.782668 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-7e5ea20e-a9d8-446d-a001-cf17633da937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:08.782668 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:08.782668 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:08.782668 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:08.782668 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:08.782668 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:08.782668 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:08.782668 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:08.782668 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:08.782668 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:08.782668 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:08.782668 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:08.782668 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:08.782668 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:08.782668 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:08.782668 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:08.785518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:08.785518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:08.785518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:08.785518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:08.785518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:08.785518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:08.785518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:08.785518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:08.785518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:08.785518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:08.785518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:08.785518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:08.785518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:08.785518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:08.785518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:08.785518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:08.785518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:08.789199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:08.789199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:08.789199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:08.789199 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 228/464] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:08.789199 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d04ffa-0604-4914-800a-666b9c213f00 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:08.790203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d04ffa-0604-4914-800a-666b9c213f00 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:08.790203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d04ffa-0604-4914-800a-666b9c213f00 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:08.796098 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 229/465] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:08.798150 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d04ffa-0604-4914-800a-666b9c213f00 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:08.808496 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 237/466] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Oct 2 00:42:08 2022] POST /identity/v3/users => generated 246 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:42:08.810572 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24058709-197f-4044-a62b-77aa0aec02d6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:08.810964 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24058709-197f-4044-a62b-77aa0aec02d6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:08.811487 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24058709-197f-4044-a62b-77aa0aec02d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:08.833008 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-24058709-197f-4044-a62b-77aa0aec02d6 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:08.834338 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-24058709-197f-4044-a62b-77aa0aec02d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:08.862886 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:08.927173 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 238/467] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:09.004713 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d04ffa-0604-4914-800a-666b9c213f00 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:09.101264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a70459-f738-450d-b9f0-5189e4761ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:09.103453 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a70459-f738-450d-b9f0-5189e4761ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:09.104163 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a70459-f738-450d-b9f0-5189e4761ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:09.104879 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a70459-f738-450d-b9f0-5189e4761ec9 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:09.106238 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a70459-f738-450d-b9f0-5189e4761ec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:09.106986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a70459-f738-450d-b9f0-5189e4761ec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:09.109770 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a70459-f738-450d-b9f0-5189e4761ec9 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:09.132435 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 230/468] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:09.139302 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24058709-197f-4044-a62b-77aa0aec02d6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:09.165968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a70459-f738-450d-b9f0-5189e4761ec9 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:09.271670 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:09.293258 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24058709-197f-4044-a62b-77aa0aec02d6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:09.343649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f2efd-e9c1-4659-b13c-13e0421e85dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:09.344709 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f2efd-e9c1-4659-b13c-13e0421e85dd None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:09.345248 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f2efd-e9c1-4659-b13c-13e0421e85dd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:09.345566 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f2efd-e9c1-4659-b13c-13e0421e85dd None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:09.346228 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f2efd-e9c1-4659-b13c-13e0421e85dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:09.347699 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f2efd-e9c1-4659-b13c-13e0421e85dd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:09.351691 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a70459-f738-450d-b9f0-5189e4761ec9 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:09.377010 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 239/469] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Oct 2 00:42:09 2022] POST /identity/v3/users => generated 248 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:42:09.377010 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa7a0a-efb6-4372-8f4d-e1cc0413507d None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:09.377010 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa7a0a-efb6-4372-8f4d-e1cc0413507d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:09.377010 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa7a0a-efb6-4372-8f4d-e1cc0413507d None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:09.377010 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 240/470] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:09.377702 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa7a0a-efb6-4372-8f4d-e1cc0413507d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:09.415462 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:09.440816 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3d7e1-5508-4eca-9f30-d831742b69f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:09.441923 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d7e1-5508-4eca-9f30-d831742b69f9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:09.442450 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d7e1-5508-4eca-9f30-d831742b69f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:09.442981 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d7e1-5508-4eca-9f30-d831742b69f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:09.458294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3d7e1-5508-4eca-9f30-d831742b69f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:09.460276 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3d7e1-5508-4eca-9f30-d831742b69f9 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:09.481892 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-ccf3d7e1-5508-4eca-9f30-d831742b69f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:09.481892 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:09.481892 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:09.481892 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:09.481892 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:09.481892 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:09.481892 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:09.481892 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:09.481892 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:09.481892 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:09.481892 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:09.481892 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:09.481892 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:09.481892 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:09.481892 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:09.481892 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:09.483080 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:09.483080 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:09.483080 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:09.483080 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:09.483080 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:09.483080 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:09.483080 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:09.483080 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:09.483080 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:09.483080 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:09.483080 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:09.483080 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:09.483080 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:09.483080 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:09.483080 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:09.483080 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:09.483080 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:09.483939 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:09.483939 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:09.483939 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:09.491746 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 231/471] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:42:09.492263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a31dad-30eb-47d4-b0c6-5eedd463a559 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:09.492741 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a31dad-30eb-47d4-b0c6-5eedd463a559 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:09.493260 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a31dad-30eb-47d4-b0c6-5eedd463a559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:09.523998 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-84a31dad-30eb-47d4-b0c6-5eedd463a559 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:09.526105 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-84a31dad-30eb-47d4-b0c6-5eedd463a559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:09.562150 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa7a0a-efb6-4372-8f4d-e1cc0413507d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:09.611570 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82ea22-ce5d-45c0-847a-50813db02c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:09.612654 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82ea22-ce5d-45c0-847a-50813db02c6f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:09.613184 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82ea22-ce5d-45c0-847a-50813db02c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:09.613676 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82ea22-ce5d-45c0-847a-50813db02c6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:09.630097 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82ea22-ce5d-45c0-847a-50813db02c6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:09.631938 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82ea22-ce5d-45c0-847a-50813db02c6f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:09.654707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-3b82ea22-ce5d-45c0-847a-50813db02c6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:09.654707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:09.654707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:09.654707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:09.654707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:09.654707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:09.654707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:09.654707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:09.654707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:09.654707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:09.654707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:09.654707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:09.654707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:09.654707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:09.654707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:09.654707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:09.655701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:09.655701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:09.655701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:09.655701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:09.655701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:09.655701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:09.655701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:09.655701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:09.655701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:09.655701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:09.655701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:09.655701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:09.655701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:09.655701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:09.655701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:09.655701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:09.655701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:09.656545 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:09.656545 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:09.656545 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:09.663784 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 232/472] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:09.663784 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a31dad-30eb-47d4-b0c6-5eedd463a559 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:09.664492 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 241/473] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:09.665700 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82ea22-ce5d-45c0-847a-50813db02c6f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:09.731296 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:09.753580 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:09.823463 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82ea22-ce5d-45c0-847a-50813db02c6f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:09.844667 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a31dad-30eb-47d4-b0c6-5eedd463a559 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:09.892912 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448a512-d9f2-49e4-adac-5d27bfc95951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:09.894532 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448a512-d9f2-49e4-adac-5d27bfc95951 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:09.895391 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448a512-d9f2-49e4-adac-5d27bfc95951 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:09.895893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448a512-d9f2-49e4-adac-5d27bfc95951 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:09.896751 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448a512-d9f2-49e4-adac-5d27bfc95951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:09.897281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448a512-d9f2-49e4-adac-5d27bfc95951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:09.898910 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448a512-d9f2-49e4-adac-5d27bfc95951 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:09.901836 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdb932-4c9e-4c07-b710-9acc2ad1d343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:09.902893 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdb932-4c9e-4c07-b710-9acc2ad1d343 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:09.905134 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdb932-4c9e-4c07-b710-9acc2ad1d343 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:09.905716 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdb932-4c9e-4c07-b710-9acc2ad1d343 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:09.906903 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdb932-4c9e-4c07-b710-9acc2ad1d343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:09.907408 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdb932-4c9e-4c07-b710-9acc2ad1d343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:09.910365 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdb932-4c9e-4c07-b710-9acc2ad1d343 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:09.916169 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 233/474] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:09.923408 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448a512-d9f2-49e4-adac-5d27bfc95951 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:09.941928 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 242/475] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:09.947377 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdb932-4c9e-4c07-b710-9acc2ad1d343 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:10.073372 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:10.086705 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448a512-d9f2-49e4-adac-5d27bfc95951 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:10.101401 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdb932-4c9e-4c07-b710-9acc2ad1d343 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:10.135231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:10.148586 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477f5c5-3dd1-457f-9408-d37cfea90a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:10.150065 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477f5c5-3dd1-457f-9408-d37cfea90a46 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:10.150551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477f5c5-3dd1-457f-9408-d37cfea90a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:10.151023 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477f5c5-3dd1-457f-9408-d37cfea90a46 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:10.151237 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411beda9-a213-4446-8ffd-69cb24777b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:10.152280 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411beda9-a213-4446-8ffd-69cb24777b1f None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:10.152662 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477f5c5-3dd1-457f-9408-d37cfea90a46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:10.152776 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411beda9-a213-4446-8ffd-69cb24777b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:10.153903 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411beda9-a213-4446-8ffd-69cb24777b1f None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:10.155168 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411beda9-a213-4446-8ffd-69cb24777b1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:10.155808 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477f5c5-3dd1-457f-9408-d37cfea90a46 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:10.158003 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411beda9-a213-4446-8ffd-69cb24777b1f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:10.186116 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 243/476] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Oct 2 00:42:09 2022] POST /identity/v3/users => generated 249 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:42:10.187385 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477f5c5-3dd1-457f-9408-d37cfea90a46 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:10.222264 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 234/477] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Oct 2 00:42:09 2022] POST /identity/v3/users => generated 248 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:42:10.371364 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477f5c5-3dd1-457f-9408-d37cfea90a46 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:10.444748 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a3f42-b77e-4676-9c2f-7a01f6970e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:10.445832 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a3f42-b77e-4676-9c2f-7a01f6970e4c None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:10.446329 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a3f42-b77e-4676-9c2f-7a01f6970e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:10.446806 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a3f42-b77e-4676-9c2f-7a01f6970e4c None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:10.447745 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a3f42-b77e-4676-9c2f-7a01f6970e4c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:10.449498 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a3f42-b77e-4676-9c2f-7a01f6970e4c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:10.465746 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.sql.core [None req-6e2a3f42-b77e-4676-9c2f-7a01f6970e4c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 02 00:42:10.465746 dv-cinder-master-3-smb devstack@keystone.service[81450]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 02 00:42:10.465746 dv-cinder-master-3-smb devstack@keystone.service[81450]: [parameters: {'id': '6ff3f2f951cc418db842016a60ba8620', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 02 00:42:10.465746 dv-cinder-master-3-smb devstack@keystone.service[81450]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81450) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 02 00:42:10.486829 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-6e2a3f42-b77e-4676-9c2f-7a01f6970e4c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 02 00:42:10.486829 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:10.486829 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 00:42:10.486829 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 02 00:42:10.486829 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 00:42:10.486829 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 02 00:42:10.486829 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 00:42:10.486829 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application result = self._query(query) Oct 02 00:42:10.486829 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 00:42:10.486829 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application conn.query(q) Oct 02 00:42:10.486829 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 00:42:10.486829 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 00:42:10.486829 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 00:42:10.486829 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application result.read() Oct 02 00:42:10.486829 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 00:42:10.487892 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 02 00:42:10.487892 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 00:42:10.487892 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 02 00:42:10.487892 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 00:42:10.487892 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 02 00:42:10.487892 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 00:42:10.487892 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 02 00:42:10.487892 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 02 00:42:10.487892 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:10.487892 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 02 00:42:10.487892 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:10.487892 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:10.487892 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 02 00:42:10.487892 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 02 00:42:10.487892 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 02 00:42:10.487892 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return ref.to_dict() Oct 02 00:42:10.487892 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 02 00:42:10.487892 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application next(self.gen) Oct 02 00:42:10.488889 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 02 00:42:10.488889 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application yield resource Oct 02 00:42:10.488889 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 02 00:42:10.488889 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application next(self.gen) Oct 02 00:42:10.488889 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 02 00:42:10.488889 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self.session.rollback() Oct 02 00:42:10.488889 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 00:42:10.488889 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self.force_reraise() Oct 02 00:42:10.488889 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 00:42:10.488889 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise self.value Oct 02 00:42:10.488889 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 02 00:42:10.488889 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 02 00:42:10.488889 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 02 00:42:10.488889 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application session.commit() Oct 02 00:42:10.488889 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 02 00:42:10.488889 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 02 00:42:10.488889 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 02 00:42:10.489802 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._prepare_impl() Oct 02 00:42:10.489802 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 02 00:42:10.489802 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self.session.flush() Oct 02 00:42:10.489802 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 02 00:42:10.489802 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._flush(objects) Oct 02 00:42:10.489802 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 02 00:42:10.489802 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 02 00:42:10.489802 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 02 00:42:10.489802 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application compat.raise_( Oct 02 00:42:10.489802 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 00:42:10.489802 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception Oct 02 00:42:10.489802 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 02 00:42:10.489802 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application flush_context.execute() Oct 02 00:42:10.489802 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 02 00:42:10.489802 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rec.execute(self) Oct 02 00:42:10.489802 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 02 00:42:10.489802 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 02 00:42:10.490713 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 02 00:42:10.490713 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 02 00:42:10.490713 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 02 00:42:10.490713 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 02 00:42:10.490713 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 02 00:42:10.490713 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 02 00:42:10.490713 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 02 00:42:10.490713 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 02 00:42:10.490713 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 02 00:42:10.490713 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 02 00:42:10.490713 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 02 00:42:10.490713 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 02 00:42:10.490713 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 02 00:42:10.490713 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 02 00:42:10.490713 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 00:42:10.490713 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception Oct 02 00:42:10.491542 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 00:42:10.491542 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 02 00:42:10.491542 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 00:42:10.491542 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 02 00:42:10.491542 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 00:42:10.491542 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application result = self._query(query) Oct 02 00:42:10.491542 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 00:42:10.491542 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application conn.query(q) Oct 02 00:42:10.491542 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 00:42:10.491542 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 00:42:10.491542 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 00:42:10.491542 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application result.read() Oct 02 00:42:10.491542 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 00:42:10.491542 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 02 00:42:10.491542 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 00:42:10.491542 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 02 00:42:10.492338 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 00:42:10.492338 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 02 00:42:10.492338 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 00:42:10.492338 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 02 00:42:10.492338 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 02 00:42:10.492338 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 02 00:42:10.492338 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [parameters: {'id': '6ff3f2f951cc418db842016a60ba8620', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 02 00:42:10.492338 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 02 00:42:10.492338 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:10.492338 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:42:10.492338 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:10.492338 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:10.492338 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:10.492338 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:10.492338 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:10.492338 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:10.499096 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:10.499096 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:10.499096 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:10.499096 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:10.499096 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:10.499096 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:10.499096 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 02 00:42:10.499096 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 02 00:42:10.499096 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:10.499096 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:10.499096 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 02 00:42:10.499096 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 02 00:42:10.499096 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 02 00:42:10.499096 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 02 00:42:10.499096 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 02 00:42:10.499096 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:10.502587 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 244/478] 10.222.0.26 () {60 vars in 1131 bytes} [Sun Oct 2 00:42:10 2022] POST /identity/v3/roles => generated 144 bytes in 316 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:10.509784 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411beda9-a213-4446-8ffd-69cb24777b1f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:10.644697 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411beda9-a213-4446-8ffd-69cb24777b1f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:10.692690 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90ab63-8990-4e2a-a3fc-746073d080d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:10.693853 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90ab63-8990-4e2a-a3fc-746073d080d2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:10.694355 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90ab63-8990-4e2a-a3fc-746073d080d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:10.694840 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90ab63-8990-4e2a-a3fc-746073d080d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:10.717775 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90ab63-8990-4e2a-a3fc-746073d080d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:10.728664 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-0e90ab63-8990-4e2a-a3fc-746073d080d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:42:10.728664 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:10.728664 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:10.728664 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:10.728664 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:10.728664 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:10.728664 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:10.728664 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:10.728664 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:10.728664 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:10.728664 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:10.728664 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:10.728664 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:10.728664 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:10.728664 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:10.728664 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:10.729693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:10.729693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:10.729693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:10.729693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:10.729693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:10.729693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:10.729693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:10.729693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:10.729693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:10.729693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:10.729693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:10.729693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:10.729693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:10.729693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:10.729693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:10.729693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:10.730665 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:10.730665 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:10.730665 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:10.730665 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:10.730665 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:10.730665 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:10.730665 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:10.730665 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:10.730665 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:10.730665 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:10.730665 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:42:10.730665 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:10.732106 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 235/479] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:42:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:10.737430 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a3f42-b77e-4676-9c2f-7a01f6970e4c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:10.803863 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:10.874007 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a3f42-b77e-4676-9c2f-7a01f6970e4c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:10.924235 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3d143-8be6-43b0-8434-4f52b98a5e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:10.924861 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3d143-8be6-43b0-8434-4f52b98a5e44 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:10.925177 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3d143-8be6-43b0-8434-4f52b98a5e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:10.925416 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3d143-8be6-43b0-8434-4f52b98a5e44 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:10.926094 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3d143-8be6-43b0-8434-4f52b98a5e44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:10.926391 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3d143-8be6-43b0-8434-4f52b98a5e44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:10.927774 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3d143-8be6-43b0-8434-4f52b98a5e44 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:10.937636 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 245/480] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:12.115259 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1167c-df7a-4b74-b420-23e9325ff241 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:12.117037 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1167c-df7a-4b74-b420-23e9325ff241 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:12.117788 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1167c-df7a-4b74-b420-23e9325ff241 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:12.120933 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 236/481] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:12.130292 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b64ae7-4813-4bfc-b1f7-9adc6f2a471a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:12.131727 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b64ae7-4813-4bfc-b1f7-9adc6f2a471a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:12.132609 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b64ae7-4813-4bfc-b1f7-9adc6f2a471a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:12.166722 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d5b64ae7-4813-4bfc-b1f7-9adc6f2a471a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:12.176084 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d5b64ae7-4813-4bfc-b1f7-9adc6f2a471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:12.323895 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 246/482] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:12.859843 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1167c-df7a-4b74-b420-23e9325ff241 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:12.889579 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:13.112759 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1167c-df7a-4b74-b420-23e9325ff241 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:13.191994 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa5c55-e6bc-4fa4-a9d6-6438134268cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:13.193828 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa5c55-e6bc-4fa4-a9d6-6438134268cb None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:13.194448 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa5c55-e6bc-4fa4-a9d6-6438134268cb None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:13.194948 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa5c55-e6bc-4fa4-a9d6-6438134268cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:13.210239 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa5c55-e6bc-4fa4-a9d6-6438134268cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:13.222965 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-16fa5c55-e6bc-4fa4-a9d6-6438134268cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:13.222965 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:13.222965 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:13.222965 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:13.222965 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:13.222965 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:13.222965 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:13.222965 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:13.222965 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:13.222965 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:13.222965 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:13.222965 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:13.222965 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:13.222965 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:13.222965 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:13.222965 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:13.224787 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:13.224787 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:13.224787 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:13.224787 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:13.224787 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:13.224787 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:13.224787 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:13.224787 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:13.224787 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:13.224787 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:13.224787 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:13.224787 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:13.224787 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:13.224787 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:13.224787 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:13.224787 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:13.226126 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:13.226126 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:13.226126 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:13.226126 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:13.226126 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:13.226126 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:13.226126 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:13.226126 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:13.226126 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:13.226126 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:13.226126 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:13.226126 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:13.229770 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 237/483] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:13.236992 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b64ae7-4813-4bfc-b1f7-9adc6f2a471a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:13.320735 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:13.429455 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d9b2a-7378-4c32-a4c8-c00f26523918 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:13.429824 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d9b2a-7378-4c32-a4c8-c00f26523918 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:13.430012 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d9b2a-7378-4c32-a4c8-c00f26523918 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:13.431759 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 238/484] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:13.432007 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b64ae7-4813-4bfc-b1f7-9adc6f2a471a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:13.442451 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b935d0-8925-4d57-9d7a-b9ac6f2cc90d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:13.442795 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b935d0-8925-4d57-9d7a-b9ac6f2cc90d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:13.443003 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b935d0-8925-4d57-9d7a-b9ac6f2cc90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:13.478183 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d6cbe-06fd-46e5-aee1-c451fea96450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:13.478826 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d6cbe-06fd-46e5-aee1-c451fea96450 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:13.479110 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d6cbe-06fd-46e5-aee1-c451fea96450 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:13.479383 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d6cbe-06fd-46e5-aee1-c451fea96450 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:13.480076 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d6cbe-06fd-46e5-aee1-c451fea96450 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:13.480383 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d6cbe-06fd-46e5-aee1-c451fea96450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:13.486143 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d6cbe-06fd-46e5-aee1-c451fea96450 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:13.487323 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-23b935d0-8925-4d57-9d7a-b9ac6f2cc90d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:13.488569 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-23b935d0-8925-4d57-9d7a-b9ac6f2cc90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:13.504341 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 247/485] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:42:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:13.510273 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d6cbe-06fd-46e5-aee1-c451fea96450 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:13.615740 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:13.623362 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 239/486] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:42:13.711756 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:13.719976 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d6cbe-06fd-46e5-aee1-c451fea96450 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:13.737731 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2f529-a4ae-4690-b563-88c8c50c3e2b None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:13.738125 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2f529-a4ae-4690-b563-88c8c50c3e2b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:13.738291 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2f529-a4ae-4690-b563-88c8c50c3e2b None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:13.739701 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 240/487] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:42:13.761476 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a78e7c-a25c-4830-8d4f-186c2d28ff37 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:13.761765 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a78e7c-a25c-4830-8d4f-186c2d28ff37 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:13.762065 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a78e7c-a25c-4830-8d4f-186c2d28ff37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:13.766251 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5628816-6650-48a6-afce-7ceacc4a0155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:13.766907 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5628816-6650-48a6-afce-7ceacc4a0155 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:13.767191 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5628816-6650-48a6-afce-7ceacc4a0155 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:13.767476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5628816-6650-48a6-afce-7ceacc4a0155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:13.794919 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a2a78e7c-a25c-4830-8d4f-186c2d28ff37 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:13.796155 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a2a78e7c-a25c-4830-8d4f-186c2d28ff37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:13.799389 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5628816-6650-48a6-afce-7ceacc4a0155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:13.800876 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5628816-6650-48a6-afce-7ceacc4a0155 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:13.825969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e5628816-6650-48a6-afce-7ceacc4a0155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:13.825969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:13.825969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:13.825969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:13.825969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:13.825969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:13.825969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:13.825969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:13.825969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:13.825969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:13.825969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:13.825969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:13.825969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:13.825969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:13.825969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:13.825969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:13.828538 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:13.828538 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:13.828538 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:13.828538 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:13.828538 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:13.828538 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:13.828538 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:13.828538 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:13.828538 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:13.828538 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:13.828538 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:13.828538 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:13.828538 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:13.828538 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:13.828538 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:13.828538 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:13.828538 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:13.834799 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:13.834799 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:13.834799 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:13.834799 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 248/488] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:42:13.838058 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5628816-6650-48a6-afce-7ceacc4a0155 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:13.947118 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 241/489] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:13.948221 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a78e7c-a25c-4830-8d4f-186c2d28ff37 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:14.010607 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5628816-6650-48a6-afce-7ceacc4a0155 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:14.051228 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e7634-bc50-4b6b-a855-bbd99648714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:14.052026 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e7634-bc50-4b6b-a855-bbd99648714f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:14.052413 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e7634-bc50-4b6b-a855-bbd99648714f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:14.052823 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e7634-bc50-4b6b-a855-bbd99648714f None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:14.054204 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e7634-bc50-4b6b-a855-bbd99648714f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:14.054634 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e7634-bc50-4b6b-a855-bbd99648714f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:14.056506 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e7634-bc50-4b6b-a855-bbd99648714f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:14.067406 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a78e7c-a25c-4830-8d4f-186c2d28ff37 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:14.080841 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 249/490] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:14.082568 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e109b2-bb78-4671-858d-a91ad2c686af None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:14.083470 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e109b2-bb78-4671-858d-a91ad2c686af None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:14.083865 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e109b2-bb78-4671-858d-a91ad2c686af None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:14.086048 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 250/491] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:14.086956 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e109b2-bb78-4671-858d-a91ad2c686af None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:14.108690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:14.112748 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:14.115367 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8769eb8-3ac2-4e66-a520-c1465e180d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:14.116729 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8769eb8-3ac2-4e66-a520-c1465e180d26 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:14.117118 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8769eb8-3ac2-4e66-a520-c1465e180d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:14.117484 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8769eb8-3ac2-4e66-a520-c1465e180d26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:14.134719 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8769eb8-3ac2-4e66-a520-c1465e180d26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:14.143951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-f8769eb8-3ac2-4e66-a520-c1465e180d26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:14.143951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:14.143951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:14.143951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:14.143951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:14.143951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:14.143951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:14.143951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:14.143951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:14.143951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:14.143951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:14.143951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:14.143951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:14.143951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:14.143951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:14.143951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:14.145221 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:14.145221 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:14.145221 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:14.145221 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:14.145221 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:14.145221 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:14.145221 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:14.145221 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:14.145221 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:14.145221 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:14.145221 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:14.145221 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:14.145221 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:14.145221 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:14.145221 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:14.145221 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:14.146058 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:14.146058 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:14.146058 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:14.146058 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:14.146058 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:14.146058 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:14.146058 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:14.146058 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:14.146058 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:14.146058 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:14.146058 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:14.146058 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:14.146058 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 242/492] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:14.149137 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110548f9-2bd1-48ba-9f6e-96391757c3e0 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:14.149730 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110548f9-2bd1-48ba-9f6e-96391757c3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:14.150196 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110548f9-2bd1-48ba-9f6e-96391757c3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:14.170691 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-110548f9-2bd1-48ba-9f6e-96391757c3e0 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:14.172270 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-110548f9-2bd1-48ba-9f6e-96391757c3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:14.253330 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e109b2-bb78-4671-858d-a91ad2c686af None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:14.258946 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 243/493] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:14.259824 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110548f9-2bd1-48ba-9f6e-96391757c3e0 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:14.295292 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23829a22-fcc2-4900-a6e3-49eef5198cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:14.296217 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23829a22-fcc2-4900-a6e3-49eef5198cca None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:14.296649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23829a22-fcc2-4900-a6e3-49eef5198cca None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:14.297128 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23829a22-fcc2-4900-a6e3-49eef5198cca None admin] PATH_INFO: `/v3/users/nova` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:14.305611 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23829a22-fcc2-4900-a6e3-49eef5198cca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:14.307374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23829a22-fcc2-4900-a6e3-49eef5198cca None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:14.323552 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-23829a22-fcc2-4900-a6e3-49eef5198cca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:42:14.323552 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:14.323552 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:14.323552 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:14.323552 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:14.323552 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:14.323552 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:14.323552 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:14.323552 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:14.323552 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:14.323552 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:14.323552 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:14.323552 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:14.323552 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:14.323552 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:14.323552 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:14.325320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:14.325320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:14.325320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:14.325320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:14.325320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:14.325320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:14.325320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:14.325320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:14.325320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:14.325320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:14.325320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:14.325320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:14.325320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:14.325320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:14.325320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:14.325320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:14.325320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:14.325320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:14.326419 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:14.326419 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:14.326419 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:14.326419 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:14.326419 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:14.326419 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:14.326419 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:14.326419 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:14.326419 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:42:14.326419 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:14.328867 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 251/494] 10.222.0.26 () {56 vars in 1093 bytes} [Sun Oct 2 00:42:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:14.329995 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23829a22-fcc2-4900-a6e3-49eef5198cca None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:14.389222 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110548f9-2bd1-48ba-9f6e-96391757c3e0 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:14.414610 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:14.421853 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:14.437096 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e809c5f-066e-4bca-90d1-327babc243a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:14.438111 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e809c5f-066e-4bca-90d1-327babc243a4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:14.438573 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e809c5f-066e-4bca-90d1-327babc243a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:14.439058 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e809c5f-066e-4bca-90d1-327babc243a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:14.439996 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e809c5f-066e-4bca-90d1-327babc243a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:14.440606 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e809c5f-066e-4bca-90d1-327babc243a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:14.442383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e809c5f-066e-4bca-90d1-327babc243a4 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:14.454354 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 244/495] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:42:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:14.455441 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e809c5f-066e-4bca-90d1-327babc243a4 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:14.460796 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23829a22-fcc2-4900-a6e3-49eef5198cca None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:14.515378 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea43ccf-6916-45f9-9ac7-27923b2de6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:14.516342 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea43ccf-6916-45f9-9ac7-27923b2de6fc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:14.516454 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea43ccf-6916-45f9-9ac7-27923b2de6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:14.516721 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea43ccf-6916-45f9-9ac7-27923b2de6fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:14.530629 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea43ccf-6916-45f9-9ac7-27923b2de6fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:14.537682 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-bea43ccf-6916-45f9-9ac7-27923b2de6fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:14.537682 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:14.537682 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:14.537682 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:14.537682 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:14.537682 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:14.537682 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:14.537682 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:14.537682 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:14.537682 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:14.537682 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:14.537682 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:14.537682 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:14.537682 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:14.537682 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:14.537682 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:14.538656 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:14.538656 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:14.538656 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:14.538656 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:14.538656 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:14.538656 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:14.538656 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:14.538656 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:14.538656 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:14.538656 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:14.538656 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:14.538656 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:14.538656 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:14.538656 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:14.538656 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:14.538656 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:14.539458 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:14.539458 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:14.539458 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:14.539458 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:14.539458 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:14.539458 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:14.539458 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:14.539458 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:14.539458 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:14.539458 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:14.539458 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:14.539458 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:14.539458 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 252/496] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:14.540120 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea43ccf-6916-45f9-9ac7-27923b2de6fc None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:14.585812 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e809c5f-066e-4bca-90d1-327babc243a4 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:14.628083 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d551f1b-eea3-45c5-a833-4e5979383f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:14.629153 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d551f1b-eea3-45c5-a833-4e5979383f3d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:14.629655 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d551f1b-eea3-45c5-a833-4e5979383f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:14.630250 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d551f1b-eea3-45c5-a833-4e5979383f3d None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:14.632099 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d551f1b-eea3-45c5-a833-4e5979383f3d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:14.632653 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d551f1b-eea3-45c5-a833-4e5979383f3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:14.634404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d551f1b-eea3-45c5-a833-4e5979383f3d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:14.670069 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea43ccf-6916-45f9-9ac7-27923b2de6fc None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:14.687819 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 245/497] 10.222.0.26 () {56 vars in 1133 bytes} [Sun Oct 2 00:42:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:14.687819 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d551f1b-eea3-45c5-a833-4e5979383f3d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:14.719311 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:14.725037 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3ee94-4a8f-4765-bae1-ed657289dc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:14.725950 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3ee94-4a8f-4765-bae1-ed657289dc2b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:14.726544 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3ee94-4a8f-4765-bae1-ed657289dc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:14.726845 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3ee94-4a8f-4765-bae1-ed657289dc2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:14.740668 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3ee94-4a8f-4765-bae1-ed657289dc2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:14.742241 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3ee94-4a8f-4765-bae1-ed657289dc2b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:14.746154 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:14.760739 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-69e3ee94-4a8f-4765-bae1-ed657289dc2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:14.760739 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:14.760739 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:14.760739 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:14.760739 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:14.760739 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:14.760739 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:14.760739 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:14.760739 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:14.760739 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:14.760739 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:14.760739 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:14.760739 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:14.760739 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:14.760739 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:14.760739 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:14.762955 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:14.762955 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:14.762955 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:14.762955 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:14.762955 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:14.762955 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:14.762955 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:14.762955 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:14.762955 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:14.762955 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:14.762955 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:14.762955 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:14.762955 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:14.762955 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:14.762955 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:14.762955 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:14.762955 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:14.764209 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:14.764209 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:14.764209 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:14.766914 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 253/498] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:14.767799 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3ee94-4a8f-4765-bae1-ed657289dc2b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:14.825293 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d551f1b-eea3-45c5-a833-4e5979383f3d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:14.864841 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfca59-1c0d-4e99-b511-f3089a066854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:14.865401 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfca59-1c0d-4e99-b511-f3089a066854 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:14.865686 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfca59-1c0d-4e99-b511-f3089a066854 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:14.865964 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfca59-1c0d-4e99-b511-f3089a066854 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:14.866633 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfca59-1c0d-4e99-b511-f3089a066854 None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:14.866936 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfca59-1c0d-4e99-b511-f3089a066854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:14.868355 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfca59-1c0d-4e99-b511-f3089a066854 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:14.878142 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 246/499] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:42:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:14.879047 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfca59-1c0d-4e99-b511-f3089a066854 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:14.888479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3ee94-4a8f-4765-bae1-ed657289dc2b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:14.927948 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cda58-be8a-4f76-aff8-177c6eee5df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:14.928577 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cda58-be8a-4f76-aff8-177c6eee5df0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:14.928854 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cda58-be8a-4f76-aff8-177c6eee5df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:14.929155 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cda58-be8a-4f76-aff8-177c6eee5df0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:14.941303 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cda58-be8a-4f76-aff8-177c6eee5df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:14.946716 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-332cda58-be8a-4f76-aff8-177c6eee5df0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:14.946716 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:14.946716 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:14.946716 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:14.946716 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:14.946716 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:14.946716 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:14.946716 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:14.946716 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:14.946716 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:14.946716 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:14.946716 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:14.946716 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:14.946716 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:14.946716 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:14.946716 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:14.948257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:14.948257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:14.948257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:14.948257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:14.948257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:14.948257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:14.948257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:14.948257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:14.948257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:14.948257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:14.948257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:14.948257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:14.948257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:14.948257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:14.948257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:14.948257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:14.949321 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:14.949321 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:14.949321 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:14.949321 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:14.949321 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:14.949321 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:14.949321 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:14.949321 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:14.949321 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:14.949321 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:14.949321 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:14.949321 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:14.949321 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 254/500] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:14.951784 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cda58-be8a-4f76-aff8-177c6eee5df0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:15.001524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfca59-1c0d-4e99-b511-f3089a066854 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:15.003861 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:15.010744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:15.047260 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb619f-d8eb-47b8-b85c-e9459dec7432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:15.047878 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb619f-d8eb-47b8-b85c-e9459dec7432 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:15.048155 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb619f-d8eb-47b8-b85c-e9459dec7432 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:15.048425 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb619f-d8eb-47b8-b85c-e9459dec7432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:15.076737 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cda58-be8a-4f76-aff8-177c6eee5df0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:15.125505 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb619f-d8eb-47b8-b85c-e9459dec7432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:15.126956 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb619f-d8eb-47b8-b85c-e9459dec7432 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:15.137246 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6430d64-7e42-43ef-88f5-aadf8758af20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:15.139529 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6430d64-7e42-43ef-88f5-aadf8758af20 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:15.140023 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6430d64-7e42-43ef-88f5-aadf8758af20 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:15.140508 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6430d64-7e42-43ef-88f5-aadf8758af20 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:15.141715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6430d64-7e42-43ef-88f5-aadf8758af20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:15.142259 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6430d64-7e42-43ef-88f5-aadf8758af20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:15.144914 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6430d64-7e42-43ef-88f5-aadf8758af20 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:15.171871 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 255/501] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:15.171871 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca7111-1c2d-4dfc-a2c1-34255b9a30aa None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:15.171871 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca7111-1c2d-4dfc-a2c1-34255b9a30aa None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:15.171871 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca7111-1c2d-4dfc-a2c1-34255b9a30aa None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:15.177151 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 256/502] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:15.177151 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca7111-1c2d-4dfc-a2c1-34255b9a30aa None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:15.272869 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 247/503] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:42:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:42:15.274359 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb619f-d8eb-47b8-b85c-e9459dec7432 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:15.277617 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:15.322307 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca7111-1c2d-4dfc-a2c1-34255b9a30aa None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:15.325097 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:15.368489 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87b150-a3fe-435a-a776-c2a4b2cb4b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:15.369294 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87b150-a3fe-435a-a776-c2a4b2cb4b97 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:15.369640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87b150-a3fe-435a-a776-c2a4b2cb4b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:15.370041 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87b150-a3fe-435a-a776-c2a4b2cb4b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:15.383791 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87b150-a3fe-435a-a776-c2a4b2cb4b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:15.385231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87b150-a3fe-435a-a776-c2a4b2cb4b97 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:15.405322 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-db87b150-a3fe-435a-a776-c2a4b2cb4b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:15.405322 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:15.405322 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:15.405322 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:15.405322 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:15.405322 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:15.405322 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:15.405322 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:15.405322 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:15.405322 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:15.405322 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:15.405322 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:15.405322 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:15.405322 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:15.405322 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:15.405322 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:15.406364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:15.406364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:15.406364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:15.406364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:15.406364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:15.406364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:15.406364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:15.406364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:15.406364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:15.406364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:15.406364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:15.406364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:15.406364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:15.406364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:15.406364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:15.406364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:15.406364 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:15.407298 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:15.407298 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:15.407298 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:15.407670 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 257/504] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:15.409368 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87b150-a3fe-435a-a776-c2a4b2cb4b97 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:15.443914 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb619f-d8eb-47b8-b85c-e9459dec7432 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:15.493175 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be98e06-4c65-40b6-9a6d-3be3ef6d502a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:15.493928 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be98e06-4c65-40b6-9a6d-3be3ef6d502a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:15.494253 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be98e06-4c65-40b6-9a6d-3be3ef6d502a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:15.494572 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be98e06-4c65-40b6-9a6d-3be3ef6d502a None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:15.495604 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be98e06-4c65-40b6-9a6d-3be3ef6d502a None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:15.495999 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be98e06-4c65-40b6-9a6d-3be3ef6d502a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:15.498402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be98e06-4c65-40b6-9a6d-3be3ef6d502a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:15.510186 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 248/505] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:42:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:15.511957 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ccb71-fbbf-4a35-93c1-a2cb36eec000 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:15.512593 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ccb71-fbbf-4a35-93c1-a2cb36eec000 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:15.512980 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ccb71-fbbf-4a35-93c1-a2cb36eec000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:15.535602 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-353ccb71-fbbf-4a35-93c1-a2cb36eec000 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:15.537208 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-353ccb71-fbbf-4a35-93c1-a2cb36eec000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:15.557098 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87b150-a3fe-435a-a776-c2a4b2cb4b97 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:15.599856 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a1622-fdca-4b27-84c0-94d41e341aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:15.600511 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a1622-fdca-4b27-84c0-94d41e341aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:15.600790 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a1622-fdca-4b27-84c0-94d41e341aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:15.601105 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a1622-fdca-4b27-84c0-94d41e341aa0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:15.610189 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a1622-fdca-4b27-84c0-94d41e341aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:15.611949 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a1622-fdca-4b27-84c0-94d41e341aa0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:15.624793 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:15.628669 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-634a1622-fdca-4b27-84c0-94d41e341aa0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 02 00:42:15.628669 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:15.628669 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:15.628669 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:15.628669 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:15.628669 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:15.628669 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:15.628669 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:15.628669 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:15.628669 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:15.628669 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:15.628669 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:15.628669 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:15.628669 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:15.628669 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:15.628669 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:15.630370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:15.630370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:15.630370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:15.630370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:15.630370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:15.630370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:15.630370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:15.630370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:15.630370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:15.630370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:15.630370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:15.630370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:15.630370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:15.630370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:15.630370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:15.630370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:15.630370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:15.630370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:15.632179 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:15.632179 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:15.632179 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:15.632179 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:15.632179 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:15.632179 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:15.632179 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:15.632179 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:15.632179 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 02 00:42:15.632179 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:15.632179 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 258/506] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:42:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:15.632179 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a1622-fdca-4b27-84c0-94d41e341aa0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:15.649585 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 249/507] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:15.649585 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ccb71-fbbf-4a35-93c1-a2cb36eec000 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:15.657900 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:15.768738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a1622-fdca-4b27-84c0-94d41e341aa0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:15.813417 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe5011-75a6-47dc-b1f9-07f71e9621c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:15.814462 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe5011-75a6-47dc-b1f9-07f71e9621c2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:15.814816 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe5011-75a6-47dc-b1f9-07f71e9621c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:15.815248 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe5011-75a6-47dc-b1f9-07f71e9621c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:15.822956 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ccb71-fbbf-4a35-93c1-a2cb36eec000 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:15.834460 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe5011-75a6-47dc-b1f9-07f71e9621c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:15.837062 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe5011-75a6-47dc-b1f9-07f71e9621c2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:15.862033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-7abe5011-75a6-47dc-b1f9-07f71e9621c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:15.862033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:15.862033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:15.862033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:15.862033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:15.862033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:15.862033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:15.862033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:15.862033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:15.862033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:15.862033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:15.862033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:15.862033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:15.862033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:15.862033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:15.862033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:15.863885 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:15.863885 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:15.863885 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:15.863885 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:15.863885 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:15.863885 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:15.863885 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:15.863885 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:15.863885 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:15.863885 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:15.863885 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:15.863885 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:15.863885 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:15.863885 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:15.863885 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:15.863885 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:15.863885 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:15.867200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:15.867200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:15.867200 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:15.867200 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 259/508] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:15.867200 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe5011-75a6-47dc-b1f9-07f71e9621c2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:15.894458 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0effeb-9232-4b3a-90a2-4c7eaec4bbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:15.895309 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0effeb-9232-4b3a-90a2-4c7eaec4bbfd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:15.895742 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0effeb-9232-4b3a-90a2-4c7eaec4bbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:15.896181 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0effeb-9232-4b3a-90a2-4c7eaec4bbfd None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:15.897294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0effeb-9232-4b3a-90a2-4c7eaec4bbfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:15.897795 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0effeb-9232-4b3a-90a2-4c7eaec4bbfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:15.900136 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0effeb-9232-4b3a-90a2-4c7eaec4bbfd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:15.927002 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 250/509] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:15.927002 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0effeb-9232-4b3a-90a2-4c7eaec4bbfd None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:15.986347 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:15.988882 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:16.041078 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe5011-75a6-47dc-b1f9-07f71e9621c2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:16.043947 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0effeb-9232-4b3a-90a2-4c7eaec4bbfd None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:16.082324 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c1e0b-a50d-4194-99c4-ecec88ebf443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:16.083106 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c1e0b-a50d-4194-99c4-ecec88ebf443 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:16.083528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c1e0b-a50d-4194-99c4-ecec88ebf443 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:16.083957 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c1e0b-a50d-4194-99c4-ecec88ebf443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:16.085493 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e22192-5d19-4936-8e74-01b073939363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:16.086189 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e22192-5d19-4936-8e74-01b073939363 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:16.086574 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e22192-5d19-4936-8e74-01b073939363 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:16.086939 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e22192-5d19-4936-8e74-01b073939363 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:16.087955 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e22192-5d19-4936-8e74-01b073939363 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:16.088336 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e22192-5d19-4936-8e74-01b073939363 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:16.089949 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e22192-5d19-4936-8e74-01b073939363 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:16.098935 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c1e0b-a50d-4194-99c4-ecec88ebf443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:16.101524 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c1e0b-a50d-4194-99c4-ecec88ebf443 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:16.118837 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 251/510] 10.222.0.26 () {56 vars in 1137 bytes} [Sun Oct 2 00:42:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:16.120042 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e22192-5d19-4936-8e74-01b073939363 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:16.126256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-5c8c1e0b-a50d-4194-99c4-ecec88ebf443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:16.126256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:16.126256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:16.126256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:16.126256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:16.126256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:16.126256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:16.126256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:16.126256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:16.126256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:16.126256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:16.126256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:16.126256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:16.126256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:16.126256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:16.126256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:16.127969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:16.127969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:16.127969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:16.127969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:16.127969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:16.127969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:16.127969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:16.127969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:16.127969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:16.127969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:16.127969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:16.127969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:16.127969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:16.127969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:16.127969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:16.127969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:16.127969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:16.129494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:16.129494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:16.129494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:16.129494 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 260/511] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:16.129494 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c1e0b-a50d-4194-99c4-ecec88ebf443 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:16.243308 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e22192-5d19-4936-8e74-01b073939363 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:16.255875 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c1e0b-a50d-4194-99c4-ecec88ebf443 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:16.259966 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:16.282046 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:16.287246 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edfc32-7e1c-4cbc-83f2-ac15e106d067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:16.288027 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edfc32-7e1c-4cbc-83f2-ac15e106d067 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:16.288377 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edfc32-7e1c-4cbc-83f2-ac15e106d067 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:16.288765 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edfc32-7e1c-4cbc-83f2-ac15e106d067 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:16.289557 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edfc32-7e1c-4cbc-83f2-ac15e106d067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:16.290016 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edfc32-7e1c-4cbc-83f2-ac15e106d067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:16.291749 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edfc32-7e1c-4cbc-83f2-ac15e106d067 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:16.301825 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e01482-9f90-4152-a7f4-d64415117b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:16.302681 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e01482-9f90-4152-a7f4-d64415117b05 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:16.303034 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e01482-9f90-4152-a7f4-d64415117b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:16.303477 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e01482-9f90-4152-a7f4-d64415117b05 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:16.310945 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 252/512] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:16.312186 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edfc32-7e1c-4cbc-83f2-ac15e106d067 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:16.317703 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e01482-9f90-4152-a7f4-d64415117b05 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:16.319433 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e01482-9f90-4152-a7f4-d64415117b05 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:16.333228 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-03e01482-9f90-4152-a7f4-d64415117b05 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 02 00:42:16.333228 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:16.333228 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:16.333228 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:16.333228 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:16.333228 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:16.333228 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:16.333228 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:16.333228 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:16.333228 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:16.333228 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:16.333228 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:16.333228 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:16.333228 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:16.333228 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:16.333228 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:16.343821 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:16.343821 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:16.343821 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:16.343821 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:16.343821 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:16.343821 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:16.343821 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:16.343821 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:16.343821 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:16.343821 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:16.343821 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:16.343821 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:16.343821 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:16.343821 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:16.343821 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:16.343821 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:16.343821 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:16.343821 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:16.345870 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:16.345870 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:16.345870 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:16.345870 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:16.345870 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:16.345870 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:16.345870 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:16.345870 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:16.345870 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 02 00:42:16.345870 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:16.345870 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 261/513] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:42:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:16.345870 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e01482-9f90-4152-a7f4-d64415117b05 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:16.469717 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edfc32-7e1c-4cbc-83f2-ac15e106d067 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:16.484690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e01482-9f90-4152-a7f4-d64415117b05 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:16.512767 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8d9f3-64a5-42bb-8c79-8136b02f9872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:16.513956 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8d9f3-64a5-42bb-8c79-8136b02f9872 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:16.514244 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8d9f3-64a5-42bb-8c79-8136b02f9872 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:16.514535 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8d9f3-64a5-42bb-8c79-8136b02f9872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:16.527508 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8d9f3-64a5-42bb-8c79-8136b02f9872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:16.529096 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb02d53-89aa-49b0-afa3-43c2b1597f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:16.529298 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8d9f3-64a5-42bb-8c79-8136b02f9872 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:16.529892 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb02d53-89aa-49b0-afa3-43c2b1597f98 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:16.530269 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb02d53-89aa-49b0-afa3-43c2b1597f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:16.530624 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb02d53-89aa-49b0-afa3-43c2b1597f98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:16.545546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-19d8d9f3-64a5-42bb-8c79-8136b02f9872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:16.545546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:16.545546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:16.545546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:16.545546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:16.545546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:16.545546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:16.545546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:16.545546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:16.545546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:16.545546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:16.545546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:16.545546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:16.545546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:16.545546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:16.545546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:16.547477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:16.547477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:16.547477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:16.547477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:16.547477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:16.547477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:16.547477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:16.547477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:16.547477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:16.547477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:16.547477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:16.547477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:16.547477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:16.547477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:16.547477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:16.547477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:16.547477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:16.549741 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:16.549741 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:16.549741 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:16.549741 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 253/514] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:16.549741 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8d9f3-64a5-42bb-8c79-8136b02f9872 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:16.578782 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:16.597742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:16.623948 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb02d53-89aa-49b0-afa3-43c2b1597f98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:16.625874 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb02d53-89aa-49b0-afa3-43c2b1597f98 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:16.676881 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8d9f3-64a5-42bb-8c79-8136b02f9872 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:16.719259 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17540e29-fd26-443d-9160-154c9b470720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:16.720013 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17540e29-fd26-443d-9160-154c9b470720 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:16.720454 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17540e29-fd26-443d-9160-154c9b470720 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:16.720859 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17540e29-fd26-443d-9160-154c9b470720 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:16.721720 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17540e29-fd26-443d-9160-154c9b470720 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:16.722138 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17540e29-fd26-443d-9160-154c9b470720 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:16.723733 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17540e29-fd26-443d-9160-154c9b470720 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:16.738160 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 254/515] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:16.739342 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17540e29-fd26-443d-9160-154c9b470720 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:16.750563 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 262/516] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:42:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:42:16.751930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb02d53-89aa-49b0-afa3-43c2b1597f98 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:16.852472 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:16.855307 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:16.874804 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17540e29-fd26-443d-9160-154c9b470720 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:16.879052 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb02d53-89aa-49b0-afa3-43c2b1597f98 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:16.922831 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6579e9-9d8d-4a87-b028-2f8e9aa22b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:16.923679 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6579e9-9d8d-4a87-b028-2f8e9aa22b84 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:16.924066 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6579e9-9d8d-4a87-b028-2f8e9aa22b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:16.924406 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6579e9-9d8d-4a87-b028-2f8e9aa22b84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:16.926095 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86234f4-a8f8-4149-aeb7-71b9cda37a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:16.926842 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86234f4-a8f8-4149-aeb7-71b9cda37a0b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:16.927206 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86234f4-a8f8-4149-aeb7-71b9cda37a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:16.927565 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86234f4-a8f8-4149-aeb7-71b9cda37a0b None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:16.928378 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86234f4-a8f8-4149-aeb7-71b9cda37a0b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:16.928765 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86234f4-a8f8-4149-aeb7-71b9cda37a0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:16.930323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86234f4-a8f8-4149-aeb7-71b9cda37a0b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:16.932292 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6579e9-9d8d-4a87-b028-2f8e9aa22b84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:16.934481 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6579e9-9d8d-4a87-b028-2f8e9aa22b84 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:16.952973 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-eb6579e9-9d8d-4a87-b028-2f8e9aa22b84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:16.952973 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:16.952973 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:16.952973 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:16.952973 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:16.952973 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:16.952973 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:16.952973 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:16.952973 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:16.952973 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:16.952973 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:16.952973 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:16.952973 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:16.952973 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:16.952973 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:16.954842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:16.954842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:16.954842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:16.954842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:16.954842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:16.954842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:16.954842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:16.954842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:16.954842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:16.954842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:16.954842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:16.954842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:16.954842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:16.954842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:16.954842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:16.954842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:16.954842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:16.956547 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:16.956547 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:16.956547 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:16.956547 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:16.956547 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:16.956547 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:16.956547 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:16.956547 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:16.956547 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 255/517] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:16.956547 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6579e9-9d8d-4a87-b028-2f8e9aa22b84 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:16.979327 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 263/518] 10.222.0.26 () {56 vars in 1137 bytes} [Sun Oct 2 00:42:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:16.979327 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86234f4-a8f8-4149-aeb7-71b9cda37a0b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:17.097150 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6579e9-9d8d-4a87-b028-2f8e9aa22b84 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:17.109884 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86234f4-a8f8-4149-aeb7-71b9cda37a0b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:17.143297 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967df97-255e-46b2-8e98-3e0a64367cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:17.144036 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967df97-255e-46b2-8e98-3e0a64367cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:17.144425 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967df97-255e-46b2-8e98-3e0a64367cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:17.144757 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967df97-255e-46b2-8e98-3e0a64367cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:17.145536 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967df97-255e-46b2-8e98-3e0a64367cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:17.145983 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967df97-255e-46b2-8e98-3e0a64367cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:17.147613 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967df97-255e-46b2-8e98-3e0a64367cc2 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:17.156706 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8373962-1863-4e3c-8956-7785d0d03607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:17.157539 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8373962-1863-4e3c-8956-7785d0d03607 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:17.157871 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8373962-1863-4e3c-8956-7785d0d03607 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:17.158187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8373962-1863-4e3c-8956-7785d0d03607 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:17.163390 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 256/519] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:17.164454 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967df97-255e-46b2-8e98-3e0a64367cc2 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:17.169262 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:17.170542 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8373962-1863-4e3c-8956-7785d0d03607 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:17.174563 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8373962-1863-4e3c-8956-7785d0d03607 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:17.177077 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:17.192123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-b8373962-1863-4e3c-8956-7785d0d03607 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 02 00:42:17.192123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:17.192123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:17.192123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:17.192123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:17.192123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:17.192123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:17.192123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:17.192123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:17.192123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:17.192123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:17.192123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:17.192123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:17.192123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:17.192123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:17.192123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:17.194006 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:17.194006 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:17.194006 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:17.194006 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:17.194006 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:17.194006 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:17.194006 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:17.194006 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:17.194006 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:17.194006 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:17.194006 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:17.194006 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:17.194006 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:17.194006 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:17.194006 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:17.194006 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:17.194006 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:17.194006 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:17.195028 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:17.195028 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:17.195028 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:17.195028 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:17.195028 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:17.195028 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:17.195028 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:17.195028 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:17.195028 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 02 00:42:17.195028 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:17.202062 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 264/520] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:17.203793 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8373962-1863-4e3c-8956-7785d0d03607 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:17.289656 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967df97-255e-46b2-8e98-3e0a64367cc2 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:17.332254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8776a5c-ea60-47bd-9343-9c4f68ec2116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:17.333012 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8776a5c-ea60-47bd-9343-9c4f68ec2116 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:17.333322 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8776a5c-ea60-47bd-9343-9c4f68ec2116 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:17.333546 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8776a5c-ea60-47bd-9343-9c4f68ec2116 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:17.344199 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8373962-1863-4e3c-8956-7785d0d03607 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:17.345069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8776a5c-ea60-47bd-9343-9c4f68ec2116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:17.346569 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8776a5c-ea60-47bd-9343-9c4f68ec2116 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:17.362708 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-d8776a5c-ea60-47bd-9343-9c4f68ec2116 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:17.362708 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:17.362708 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:17.362708 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:17.362708 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:17.362708 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:17.362708 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:17.362708 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:17.362708 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:17.362708 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:17.362708 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:17.362708 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:17.362708 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:17.362708 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:17.362708 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:17.362708 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:17.364266 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:17.364266 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:17.364266 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:17.364266 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:17.364266 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:17.364266 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:17.364266 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:17.364266 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:17.364266 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:17.364266 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:17.364266 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:17.364266 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:17.364266 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:17.364266 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:17.364266 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:17.364266 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:17.364266 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:17.365195 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:17.365195 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:17.365195 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:17.365195 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 257/521] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:17.365195 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8776a5c-ea60-47bd-9343-9c4f68ec2116 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:17.392497 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac936af-3ae1-49c8-80b0-8e3b9e2b6003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:17.393285 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac936af-3ae1-49c8-80b0-8e3b9e2b6003 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:17.393715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac936af-3ae1-49c8-80b0-8e3b9e2b6003 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:17.394044 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac936af-3ae1-49c8-80b0-8e3b9e2b6003 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:17.394806 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac936af-3ae1-49c8-80b0-8e3b9e2b6003 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:17.395287 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac936af-3ae1-49c8-80b0-8e3b9e2b6003 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:17.396890 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac936af-3ae1-49c8-80b0-8e3b9e2b6003 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:17.423549 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 265/522] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:17.424582 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac936af-3ae1-49c8-80b0-8e3b9e2b6003 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:17.441836 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:17.505790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8776a5c-ea60-47bd-9343-9c4f68ec2116 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:17.515160 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:17.543220 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406dd3b-e67a-4f9a-907c-5ce68f4c7435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:17.545136 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406dd3b-e67a-4f9a-907c-5ce68f4c7435 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:17.545504 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406dd3b-e67a-4f9a-907c-5ce68f4c7435 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:17.545961 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406dd3b-e67a-4f9a-907c-5ce68f4c7435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:17.561379 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac936af-3ae1-49c8-80b0-8e3b9e2b6003 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:17.597980 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdc7f1-f02c-40a6-861e-f8f2752f87e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:17.598583 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdc7f1-f02c-40a6-861e-f8f2752f87e2 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:17.598871 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdc7f1-f02c-40a6-861e-f8f2752f87e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:17.599139 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdc7f1-f02c-40a6-861e-f8f2752f87e2 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:17.599787 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdc7f1-f02c-40a6-861e-f8f2752f87e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:17.601290 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdc7f1-f02c-40a6-861e-f8f2752f87e2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:17.624679 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406dd3b-e67a-4f9a-907c-5ce68f4c7435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:17.626128 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406dd3b-e67a-4f9a-907c-5ce68f4c7435 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:17.626312 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 266/523] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Oct 2 00:42:17 2022] POST /identity/v3/users => generated 247 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:42:17.637317 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdc7f1-f02c-40a6-861e-f8f2752f87e2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:17.709466 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:17.760583 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdc7f1-f02c-40a6-861e-f8f2752f87e2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:17.766779 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 258/524] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:42:17.773923 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406dd3b-e67a-4f9a-907c-5ce68f4c7435 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:17.783550 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:17.816051 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa7658-9584-4cc6-9f17-997ab3a63d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:17.816681 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa7658-9584-4cc6-9f17-997ab3a63d8e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:17.817006 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa7658-9584-4cc6-9f17-997ab3a63d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:17.817263 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa7658-9584-4cc6-9f17-997ab3a63d8e None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:17.818017 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa7658-9584-4cc6-9f17-997ab3a63d8e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:17.818328 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa7658-9584-4cc6-9f17-997ab3a63d8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:17.819865 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa7658-9584-4cc6-9f17-997ab3a63d8e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:17.851082 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 267/525] 10.222.0.26 () {56 vars in 1139 bytes} [Sun Oct 2 00:42:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:17.851082 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa7658-9584-4cc6-9f17-997ab3a63d8e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:17.899836 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406dd3b-e67a-4f9a-907c-5ce68f4c7435 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:17.947461 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c49c1-3728-4bcb-b887-8ad867304afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:17.948222 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c49c1-3728-4bcb-b887-8ad867304afc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:17.948645 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c49c1-3728-4bcb-b887-8ad867304afc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:17.949102 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c49c1-3728-4bcb-b887-8ad867304afc None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:17.950138 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c49c1-3728-4bcb-b887-8ad867304afc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:17.950582 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c49c1-3728-4bcb-b887-8ad867304afc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:17.952134 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c49c1-3728-4bcb-b887-8ad867304afc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:17.968105 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 259/526] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:17.969284 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c49c1-3728-4bcb-b887-8ad867304afc None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:17.993682 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa7658-9584-4cc6-9f17-997ab3a63d8e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:17.999198 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:18.038499 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af7041-e481-4758-bc27-89235c8ee225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:18.039667 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af7041-e481-4758-bc27-89235c8ee225 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:18.040032 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af7041-e481-4758-bc27-89235c8ee225 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:18.040328 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af7041-e481-4758-bc27-89235c8ee225 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:18.041117 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af7041-e481-4758-bc27-89235c8ee225 None admin] RBAC: Adding query filter params (role.id=714239b608694824a75962d8cbb39f70, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=81e0396b7ba341ce8d02b1a149786d95) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:18.041418 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af7041-e481-4758-bc27-89235c8ee225 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:18.043057 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af7041-e481-4758-bc27-89235c8ee225 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:18.050601 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 268/527] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:42:17 2022] GET /identity/v3/role_assignments?user.id=81e0396b7ba341ce8d02b1a149786d95&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=714239b608694824a75962d8cbb39f70 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:18.051346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af7041-e481-4758-bc27-89235c8ee225 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:18.114544 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:18.133865 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c49c1-3728-4bcb-b887-8ad867304afc None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:18.176968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae173b-5869-4013-ae65-46631d973a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:18.177989 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae173b-5869-4013-ae65-46631d973a0a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:18.177989 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae173b-5869-4013-ae65-46631d973a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:18.178261 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae173b-5869-4013-ae65-46631d973a0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:18.192064 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae173b-5869-4013-ae65-46631d973a0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:18.193698 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae173b-5869-4013-ae65-46631d973a0a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:18.211172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-5fae173b-5869-4013-ae65-46631d973a0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:18.211172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:18.211172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:18.211172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:18.211172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:18.211172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:18.211172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:18.211172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:18.211172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:18.211172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:18.211172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:18.211172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:18.211172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:18.211172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:18.211172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:18.211172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:18.213486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:18.213486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:18.213486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:18.213486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:18.213486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:18.213486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:18.213486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:18.213486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:18.213486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:18.213486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:18.213486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:18.213486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:18.213486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:18.213486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:18.213486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:18.213486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:18.213486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:18.215167 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:18.215167 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:18.215167 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:18.215167 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 260/528] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:18.215167 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae173b-5869-4013-ae65-46631d973a0a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:18.268078 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af7041-e481-4758-bc27-89235c8ee225 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:18.326952 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eba67a-aa16-4306-8c50-c784ab9fa751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:18.328009 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eba67a-aa16-4306-8c50-c784ab9fa751 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:18.328492 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eba67a-aa16-4306-8c50-c784ab9fa751 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:18.328976 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eba67a-aa16-4306-8c50-c784ab9fa751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:18.356251 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:18.429107 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae173b-5869-4013-ae65-46631d973a0a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:18.463414 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eba67a-aa16-4306-8c50-c784ab9fa751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:18.468449 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eba67a-aa16-4306-8c50-c784ab9fa751 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:18.488718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0571c99-c693-4445-991e-bbf91312b6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:18.489790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571c99-c693-4445-991e-bbf91312b6cd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:18.490196 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571c99-c693-4445-991e-bbf91312b6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:18.490700 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571c99-c693-4445-991e-bbf91312b6cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:18.503758 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0571c99-c693-4445-991e-bbf91312b6cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:18.506190 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0571c99-c693-4445-991e-bbf91312b6cd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:18.538146 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e0571c99-c693-4445-991e-bbf91312b6cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:18.538146 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:18.538146 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:18.538146 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:18.538146 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:18.538146 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:18.538146 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:18.538146 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:18.538146 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:18.538146 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:18.538146 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:18.538146 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:18.538146 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:18.538146 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:18.538146 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:18.540075 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:18.540075 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:18.540075 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:18.540075 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:18.540075 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:18.540075 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:18.540075 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:18.540075 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:18.540075 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:18.540075 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:18.540075 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:18.540075 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:18.540075 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:18.540075 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:18.540075 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:18.540075 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:18.540075 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:18.541915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:18.541915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:18.541915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:18.541915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:18.541915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:18.541915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:18.541915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:18.541915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:18.549330 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 261/529] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:18.552677 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:18.553089 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0571c99-c693-4445-991e-bbf91312b6cd None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:18.693608 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 269/530] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:42:18.694535 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eba67a-aa16-4306-8c50-c784ab9fa751 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:18.738957 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0571c99-c693-4445-991e-bbf91312b6cd None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:18.778524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:18.789895 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bb678-b502-4289-8200-9242bd910e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:18.790528 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bb678-b502-4289-8200-9242bd910e6c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:18.790806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bb678-b502-4289-8200-9242bd910e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:18.791078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bb678-b502-4289-8200-9242bd910e6c None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:18.791747 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bb678-b502-4289-8200-9242bd910e6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:18.792049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bb678-b502-4289-8200-9242bd910e6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:18.794619 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bb678-b502-4289-8200-9242bd910e6c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:18.813112 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 262/531] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:18.813112 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bb678-b502-4289-8200-9242bd910e6c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:18.874863 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eba67a-aa16-4306-8c50-c784ab9fa751 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:18.938520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74dca4-37fd-4ed1-bd79-1cad940b808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:18.939129 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74dca4-37fd-4ed1-bd79-1cad940b808f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:18.939409 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74dca4-37fd-4ed1-bd79-1cad940b808f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:18.939678 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74dca4-37fd-4ed1-bd79-1cad940b808f None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:18.940383 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74dca4-37fd-4ed1-bd79-1cad940b808f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:18.940688 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74dca4-37fd-4ed1-bd79-1cad940b808f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:18.942196 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74dca4-37fd-4ed1-bd79-1cad940b808f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:18.946150 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:18.964851 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 270/532] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:18.967044 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74dca4-37fd-4ed1-bd79-1cad940b808f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:18.984514 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bb678-b502-4289-8200-9242bd910e6c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:19.023869 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95325af4-d1c2-4ae9-a474-95b1c303f84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:19.024571 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95325af4-d1c2-4ae9-a474-95b1c303f84c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:19.024855 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95325af4-d1c2-4ae9-a474-95b1c303f84c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:19.025211 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95325af4-d1c2-4ae9-a474-95b1c303f84c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:19.037342 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95325af4-d1c2-4ae9-a474-95b1c303f84c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:19.038833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95325af4-d1c2-4ae9-a474-95b1c303f84c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:19.056063 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-95325af4-d1c2-4ae9-a474-95b1c303f84c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:19.056063 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:19.056063 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:19.056063 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:19.056063 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:19.056063 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:19.056063 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:19.056063 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:19.056063 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:19.056063 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:19.056063 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:19.056063 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:19.056063 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:19.056063 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:19.056063 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:19.056063 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:19.057869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:19.057869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:19.057869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:19.057869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:19.057869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:19.057869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:19.057869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:19.057869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:19.057869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:19.057869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:19.057869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:19.057869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:19.057869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:19.057869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:19.057869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:19.057869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:19.057869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:19.059088 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:19.059088 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:19.059088 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:19.059088 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 263/533] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:19.059088 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95325af4-d1c2-4ae9-a474-95b1c303f84c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:19.111407 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:19.140824 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74dca4-37fd-4ed1-bd79-1cad940b808f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:19.187948 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95325af4-d1c2-4ae9-a474-95b1c303f84c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:19.195879 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d1eec-538f-41f1-8984-554fb5bffcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:19.197598 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d1eec-538f-41f1-8984-554fb5bffcbd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:19.198527 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d1eec-538f-41f1-8984-554fb5bffcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:19.199310 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d1eec-538f-41f1-8984-554fb5bffcbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:19.213001 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d1eec-538f-41f1-8984-554fb5bffcbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:19.216268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d1eec-538f-41f1-8984-554fb5bffcbd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:19.230803 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e106e1-e83d-4d9b-8dfa-aa9cbf2bc43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:19.231550 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e106e1-e83d-4d9b-8dfa-aa9cbf2bc43f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:19.231834 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e106e1-e83d-4d9b-8dfa-aa9cbf2bc43f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:19.232109 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e106e1-e83d-4d9b-8dfa-aa9cbf2bc43f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:19.232906 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e106e1-e83d-4d9b-8dfa-aa9cbf2bc43f None admin] RBAC: Adding query filter params (role.id=714239b608694824a75962d8cbb39f70, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=2920ad41c61b401299ca5ae1714b4031) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:19.233301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e106e1-e83d-4d9b-8dfa-aa9cbf2bc43f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:19.234785 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e106e1-e83d-4d9b-8dfa-aa9cbf2bc43f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:19.238551 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c13d1eec-538f-41f1-8984-554fb5bffcbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:19.238551 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:19.238551 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:19.238551 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:19.238551 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:19.238551 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:19.238551 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:19.238551 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:19.238551 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:19.238551 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:19.238551 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:19.238551 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:19.238551 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:19.238551 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:19.238551 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:19.239424 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:19.239424 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:19.239424 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:19.239424 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:19.239424 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:19.239424 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:19.239424 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:19.239424 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:19.239424 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:19.239424 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:19.239424 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:19.239424 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:19.239424 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:19.239424 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:19.239424 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:19.239424 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:19.239424 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:19.240275 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:19.240275 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:19.240275 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:19.240275 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:19.240275 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:19.240275 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:19.240275 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:19.240275 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:19.241522 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 264/534] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:42:19 2022] GET /identity/v3/role_assignments?user.id=2920ad41c61b401299ca5ae1714b4031&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=714239b608694824a75962d8cbb39f70 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:19.242568 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e106e1-e83d-4d9b-8dfa-aa9cbf2bc43f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:19.245481 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 271/535] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:19.250617 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d1eec-538f-41f1-8984-554fb5bffcbd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:19.376313 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:19.446754 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d1eec-538f-41f1-8984-554fb5bffcbd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:19.488675 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e106e1-e83d-4d9b-8dfa-aa9cbf2bc43f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:19.497133 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:19.514609 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4a4d0-35ae-46ee-9767-be1a9ef3a768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:19.515559 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4a4d0-35ae-46ee-9767-be1a9ef3a768 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:19.516007 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4a4d0-35ae-46ee-9767-be1a9ef3a768 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:19.516456 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4a4d0-35ae-46ee-9767-be1a9ef3a768 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:19.518451 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4a4d0-35ae-46ee-9767-be1a9ef3a768 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:19.519016 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4a4d0-35ae-46ee-9767-be1a9ef3a768 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:19.521752 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4a4d0-35ae-46ee-9767-be1a9ef3a768 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:19.545210 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 272/536] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:19.555357 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4a4d0-35ae-46ee-9767-be1a9ef3a768 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:19.616160 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe134c-6e2f-4ce9-be48-7849ee6cb812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:19.617198 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe134c-6e2f-4ce9-be48-7849ee6cb812 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:19.617682 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe134c-6e2f-4ce9-be48-7849ee6cb812 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:19.618158 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe134c-6e2f-4ce9-be48-7849ee6cb812 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:19.619309 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe134c-6e2f-4ce9-be48-7849ee6cb812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:19.619842 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe134c-6e2f-4ce9-be48-7849ee6cb812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:19.624092 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe134c-6e2f-4ce9-be48-7849ee6cb812 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:19.647850 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 265/537] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:19.654943 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe134c-6e2f-4ce9-be48-7849ee6cb812 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:19.767804 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4a4d0-35ae-46ee-9767-be1a9ef3a768 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:19.806794 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:19.826543 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac86286-9465-4eaa-8a5d-cba70985ef92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:19.827336 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac86286-9465-4eaa-8a5d-cba70985ef92 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:19.827835 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac86286-9465-4eaa-8a5d-cba70985ef92 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:19.828389 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac86286-9465-4eaa-8a5d-cba70985ef92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:19.830096 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac86286-9465-4eaa-8a5d-cba70985ef92 None admin] RBAC: Adding query filter params (role.id=714239b608694824a75962d8cbb39f70, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=3469f1e6a9bf47b58d208bffc3415014) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:19.830731 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac86286-9465-4eaa-8a5d-cba70985ef92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:19.834191 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac86286-9465-4eaa-8a5d-cba70985ef92 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:19.844170 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 273/538] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:42:19 2022] GET /identity/v3/role_assignments?user.id=3469f1e6a9bf47b58d208bffc3415014&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=714239b608694824a75962d8cbb39f70 => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:19.857818 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe134c-6e2f-4ce9-be48-7849ee6cb812 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:19.908434 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb85e27-c325-4966-92a9-9d7c8378e02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:19.909131 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb85e27-c325-4966-92a9-9d7c8378e02e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:19.909416 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb85e27-c325-4966-92a9-9d7c8378e02e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:19.909694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb85e27-c325-4966-92a9-9d7c8378e02e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:19.917814 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb85e27-c325-4966-92a9-9d7c8378e02e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:19.919461 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb85e27-c325-4966-92a9-9d7c8378e02e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:19.932628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-1fb85e27-c325-4966-92a9-9d7c8378e02e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:19.932628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:19.932628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:19.932628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:19.932628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:19.932628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:19.932628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:19.932628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:19.932628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:19.932628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:19.932628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:19.932628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:19.932628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:19.932628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:19.932628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:19.933719 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:19.933719 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:19.933719 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:19.933719 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:19.933719 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:19.933719 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:19.933719 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:19.933719 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:19.933719 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:19.933719 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:19.933719 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:19.933719 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:19.933719 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:19.933719 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:19.933719 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:19.933719 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:19.933719 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:19.935544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:19.935544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:19.935544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:19.935544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:19.935544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:19.935544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:19.935544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:19.935544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:19.935544 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 266/539] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:19.941929 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac86286-9465-4eaa-8a5d-cba70985ef92 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:20.141634 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac86286-9465-4eaa-8a5d-cba70985ef92 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:20.193331 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c631265-5c2a-467d-a957-11f646af0cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:20.194069 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c631265-5c2a-467d-a957-11f646af0cde None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:20.194553 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c631265-5c2a-467d-a957-11f646af0cde None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:20.194960 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c631265-5c2a-467d-a957-11f646af0cde None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:20.195718 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c631265-5c2a-467d-a957-11f646af0cde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:20.196196 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c631265-5c2a-467d-a957-11f646af0cde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:20.198517 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c631265-5c2a-467d-a957-11f646af0cde None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:20.223791 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 274/540] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:20.229716 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb85e27-c325-4966-92a9-9d7c8378e02e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:20.274999 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:20.394496 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb85e27-c325-4966-92a9-9d7c8378e02e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:20.473777 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996d96d-4244-4d43-80b7-2636561fac2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:20.474165 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996d96d-4244-4d43-80b7-2636561fac2a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:20.474728 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996d96d-4244-4d43-80b7-2636561fac2a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:20.476535 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996d96d-4244-4d43-80b7-2636561fac2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:20.477388 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996d96d-4244-4d43-80b7-2636561fac2a None admin] RBAC: Adding query filter params (role.id=714239b608694824a75962d8cbb39f70, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=5100db0c968c406fa89e117877604c50) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:20.477705 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996d96d-4244-4d43-80b7-2636561fac2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:20.483807 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996d96d-4244-4d43-80b7-2636561fac2a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:20.493744 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 267/541] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:42:20 2022] GET /identity/v3/role_assignments?user.id=5100db0c968c406fa89e117877604c50&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=714239b608694824a75962d8cbb39f70 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:42:20.830143 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1dd6f-d68e-454c-a0ad-fd744f4dea11 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:20.830769 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1dd6f-d68e-454c-a0ad-fd744f4dea11 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:20.830769 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1dd6f-d68e-454c-a0ad-fd744f4dea11 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:20.832345 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 275/542] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:20.839319 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39081093-017a-44a8-808d-5805ef863bff None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:20.840759 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39081093-017a-44a8-808d-5805ef863bff None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:20.841569 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39081093-017a-44a8-808d-5805ef863bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:20.870959 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-39081093-017a-44a8-808d-5805ef863bff None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:20.872729 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-39081093-017a-44a8-808d-5805ef863bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:20.970486 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 268/543] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:21.506493 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1dd6f-d68e-454c-a0ad-fd744f4dea11 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:21.560624 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:21.653918 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1dd6f-d68e-454c-a0ad-fd744f4dea11 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:21.703124 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fc019-5d49-43f7-9899-89b567587663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:21.704119 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fc019-5d49-43f7-9899-89b567587663 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:21.704600 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fc019-5d49-43f7-9899-89b567587663 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:21.705092 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fc019-5d49-43f7-9899-89b567587663 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:21.719309 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fc019-5d49-43f7-9899-89b567587663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:21.724689 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d07fc019-5d49-43f7-9899-89b567587663 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:21.724689 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:21.724689 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:21.724689 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:21.724689 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:21.724689 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:21.724689 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:21.724689 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:21.724689 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:21.724689 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:21.724689 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:21.724689 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:21.724689 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:21.724689 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:21.724689 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:21.724689 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:21.725634 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:21.725634 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:21.725634 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:21.725634 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:21.725634 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:21.725634 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:21.725634 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:21.725634 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:21.725634 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:21.725634 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:21.725634 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:21.725634 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:21.725634 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:21.725634 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:21.725634 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:21.725634 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:21.726444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:21.726444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:21.726444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:21.726444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:21.726444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:21.726444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:21.726444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:21.726444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:21.726444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:21.726444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:21.726444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:21.726444 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:21.733456 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 276/544] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:21.742108 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39081093-017a-44a8-808d-5805ef863bff None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:21.778827 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:21.819967 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdb517-495f-4d89-9ccc-8e8f02ac72d6 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:21.820519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdb517-495f-4d89-9ccc-8e8f02ac72d6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:21.821682 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdb517-495f-4d89-9ccc-8e8f02ac72d6 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:21.823213 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 277/545] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:21.834437 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdac46a-f0dd-42cc-8d36-a93bc0231ca8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:21.835402 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdac46a-f0dd-42cc-8d36-a93bc0231ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:21.835814 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdac46a-f0dd-42cc-8d36-a93bc0231ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:21.869786 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8cdac46a-f0dd-42cc-8d36-a93bc0231ca8 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:21.871499 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8cdac46a-f0dd-42cc-8d36-a93bc0231ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:21.930931 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39081093-017a-44a8-808d-5805ef863bff None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:21.973912 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf7e71-b929-4300-90b0-9cc932c8d588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:21.974775 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf7e71-b929-4300-90b0-9cc932c8d588 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:21.975206 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf7e71-b929-4300-90b0-9cc932c8d588 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:21.975318 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 278/546] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:42:21.980202 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4b68e-e52c-4f17-b555-7da546e6bba8 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:21.980202 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4b68e-e52c-4f17-b555-7da546e6bba8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:21.980202 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4b68e-e52c-4f17-b555-7da546e6bba8 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:21.981649 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf7e71-b929-4300-90b0-9cc932c8d588 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:21.982560 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf7e71-b929-4300-90b0-9cc932c8d588 None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:21.983016 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf7e71-b929-4300-90b0-9cc932c8d588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:21.983457 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 279/547] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:21.984759 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf7e71-b929-4300-90b0-9cc932c8d588 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:21.985198 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecb34c-2daa-4dcf-bda7-0339dcdbc0d5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:21.985487 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecb34c-2daa-4dcf-bda7-0339dcdbc0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:21.985768 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecb34c-2daa-4dcf-bda7-0339dcdbc0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:22.003869 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 269/548] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:42:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:22.006878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-71ecb34c-2daa-4dcf-bda7-0339dcdbc0d5 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:22.008112 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-71ecb34c-2daa-4dcf-bda7-0339dcdbc0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:22.009298 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf7e71-b929-4300-90b0-9cc932c8d588 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:22.045548 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:22.135426 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 280/549] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:42:22.169326 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:22.184926 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf7e71-b929-4300-90b0-9cc932c8d588 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:22.236168 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d2693-e099-4ce4-a567-9c9d4de96711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:22.236737 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d2693-e099-4ce4-a567-9c9d4de96711 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:22.237068 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d2693-e099-4ce4-a567-9c9d4de96711 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:22.237348 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d2693-e099-4ce4-a567-9c9d4de96711 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:22.250345 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d2693-e099-4ce4-a567-9c9d4de96711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:22.251839 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d2693-e099-4ce4-a567-9c9d4de96711 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:22.271651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-155d2693-e099-4ce4-a567-9c9d4de96711 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:22.271651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:22.271651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:22.271651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:22.271651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:22.271651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:22.271651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:22.271651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:22.271651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:22.271651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:22.271651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:22.271651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:22.271651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:22.271651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:22.271651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:22.271651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:22.272610 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:22.272610 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:22.272610 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:22.272610 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:22.272610 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:22.272610 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:22.272610 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:22.272610 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:22.272610 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:22.272610 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:22.272610 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:22.272610 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:22.272610 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:22.272610 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:22.272610 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:22.272610 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:22.272610 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:22.273994 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:22.273994 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:22.273994 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:22.273994 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 270/550] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:22.279612 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecb34c-2daa-4dcf-bda7-0339dcdbc0d5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:22.387836 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d2693-e099-4ce4-a567-9c9d4de96711 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:22.445531 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecb34c-2daa-4dcf-bda7-0339dcdbc0d5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:22.521283 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ea89f-e833-41b8-a5bb-5b82e492b281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:22.522247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ea89f-e833-41b8-a5bb-5b82e492b281 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:22.524115 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ea89f-e833-41b8-a5bb-5b82e492b281 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:22.524598 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ea89f-e833-41b8-a5bb-5b82e492b281 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:22.525482 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ea89f-e833-41b8-a5bb-5b82e492b281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:22.526200 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ea89f-e833-41b8-a5bb-5b82e492b281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:22.528859 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ea89f-e833-41b8-a5bb-5b82e492b281 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:22.555763 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 281/551] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:22.560026 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ea89f-e833-41b8-a5bb-5b82e492b281 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:22.621557 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:22.626806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d2693-e099-4ce4-a567-9c9d4de96711 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:22.668976 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:22.677135 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdbadc-b1e1-4766-87eb-1a2f5b0853e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:22.677921 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdbadc-b1e1-4766-87eb-1a2f5b0853e9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:22.678276 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdbadc-b1e1-4766-87eb-1a2f5b0853e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:22.678622 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdbadc-b1e1-4766-87eb-1a2f5b0853e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:22.695788 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdbadc-b1e1-4766-87eb-1a2f5b0853e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:22.705237 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-98bdbadc-b1e1-4766-87eb-1a2f5b0853e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:22.705237 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:22.705237 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:22.705237 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:22.705237 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:22.705237 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:22.705237 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:22.705237 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:22.705237 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:22.705237 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:22.705237 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:22.705237 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:22.705237 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:22.705237 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:22.705237 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:22.705237 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:22.706260 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:22.706260 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:22.706260 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:22.706260 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:22.706260 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:22.706260 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:22.706260 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:22.706260 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:22.706260 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:22.706260 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:22.706260 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:22.706260 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:22.706260 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:22.706260 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:22.706260 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:22.706260 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:22.707089 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:22.707089 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:22.707089 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:22.707089 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:22.707089 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:22.707089 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:22.707089 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:22.707089 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:22.707089 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:22.707089 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:22.707089 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:22.707089 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:22.707905 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 271/552] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:42:22.708503 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdbadc-b1e1-4766-87eb-1a2f5b0853e9 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:22.725940 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ea89f-e833-41b8-a5bb-5b82e492b281 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:22.779384 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dc3e5-3363-4690-b3f8-102ee44755e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:22.780344 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dc3e5-3363-4690-b3f8-102ee44755e2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:22.780472 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dc3e5-3363-4690-b3f8-102ee44755e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:22.780819 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dc3e5-3363-4690-b3f8-102ee44755e2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:22.795256 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dc3e5-3363-4690-b3f8-102ee44755e2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:22.798000 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dc3e5-3363-4690-b3f8-102ee44755e2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:22.816277 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a03dc3e5-3363-4690-b3f8-102ee44755e2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:42:22.816277 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:22.816277 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:22.816277 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:22.816277 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:22.816277 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:22.816277 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:22.816277 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:22.816277 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:22.816277 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:22.816277 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:22.816277 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:22.816277 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:22.816277 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:22.816277 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:22.816277 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:22.817342 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:22.817342 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:22.817342 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:22.817342 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:22.817342 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:22.817342 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:22.817342 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:22.817342 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:22.817342 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:22.817342 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:22.817342 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:22.817342 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:22.817342 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:22.817342 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:22.817342 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:22.817342 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:22.817342 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:22.817342 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:22.818291 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:22.818291 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:22.818291 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:22.818291 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:22.818291 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:22.818291 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:22.818291 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:22.818291 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:22.818291 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:42:22.818291 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:22.818291 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 282/553] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:42:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:42:22.818874 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd397c-ced0-4670-ac70-daf37403e6db None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:22.819547 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd397c-ced0-4670-ac70-daf37403e6db None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:22.819547 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd397c-ced0-4670-ac70-daf37403e6db None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:22.820881 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 283/554] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:22.821381 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd397c-ced0-4670-ac70-daf37403e6db None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:22.873377 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdbadc-b1e1-4766-87eb-1a2f5b0853e9 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:22.917090 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae8a6f-7515-4e94-8fa7-2b5dc6550201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:22.917726 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae8a6f-7515-4e94-8fa7-2b5dc6550201 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:22.918376 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae8a6f-7515-4e94-8fa7-2b5dc6550201 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:22.919158 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae8a6f-7515-4e94-8fa7-2b5dc6550201 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:22.932504 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae8a6f-7515-4e94-8fa7-2b5dc6550201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:22.943901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-12ae8a6f-7515-4e94-8fa7-2b5dc6550201 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:22.943901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:22.943901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:22.943901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:22.943901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:22.943901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:22.943901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:22.943901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:22.943901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:22.943901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:22.943901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:22.943901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:22.943901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:22.943901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:22.943901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:22.943901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:22.945179 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:22.945179 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:22.945179 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:22.945179 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:22.945179 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:22.945179 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:22.945179 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:22.945179 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:22.945179 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:22.945179 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:22.945179 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:22.945179 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:22.945179 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:22.945179 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:22.945179 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:22.945179 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:22.946032 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:22.946032 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:22.946032 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:22.946032 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:22.946032 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:22.946032 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:22.946032 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:22.946032 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:22.946032 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:22.946032 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:22.946032 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:22.946032 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:22.947710 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 272/555] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:22.947710 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae8a6f-7515-4e94-8fa7-2b5dc6550201 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:22.955014 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:22.983166 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd397c-ced0-4670-ac70-daf37403e6db None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:23.039018 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:23.040303 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdab435-8a3c-4c03-9760-848461a64437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:23.041055 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdab435-8a3c-4c03-9760-848461a64437 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:23.041520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdab435-8a3c-4c03-9760-848461a64437 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:23.042031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdab435-8a3c-4c03-9760-848461a64437 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:23.042950 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdab435-8a3c-4c03-9760-848461a64437 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:23.043421 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdab435-8a3c-4c03-9760-848461a64437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:23.045017 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdab435-8a3c-4c03-9760-848461a64437 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:23.057763 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 284/556] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:42:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:23.059396 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c7943-5164-44a2-8cc4-b0a9871121d4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:23.059672 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c7943-5164-44a2-8cc4-b0a9871121d4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:23.059929 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c7943-5164-44a2-8cc4-b0a9871121d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:23.079969 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-458c7943-5164-44a2-8cc4-b0a9871121d4 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:23.081224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-458c7943-5164-44a2-8cc4-b0a9871121d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:23.107135 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae8a6f-7515-4e94-8fa7-2b5dc6550201 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:23.155768 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32e5d4-7d87-4145-9718-661ab58b77b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:23.156383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32e5d4-7d87-4145-9718-661ab58b77b2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:23.156657 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32e5d4-7d87-4145-9718-661ab58b77b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:23.156926 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32e5d4-7d87-4145-9718-661ab58b77b2 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:23.157695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32e5d4-7d87-4145-9718-661ab58b77b2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:23.157995 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32e5d4-7d87-4145-9718-661ab58b77b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:23.159471 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32e5d4-7d87-4145-9718-661ab58b77b2 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:23.164183 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 285/557] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:23.165403 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c7943-5164-44a2-8cc4-b0a9871121d4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:23.191977 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 273/558] 10.222.0.26 () {56 vars in 1135 bytes} [Sun Oct 2 00:42:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:23.193575 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32e5d4-7d87-4145-9718-661ab58b77b2 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:23.289641 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:23.347543 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32e5d4-7d87-4145-9718-661ab58b77b2 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:23.349261 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c7943-5164-44a2-8cc4-b0a9871121d4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:23.372767 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:23.403740 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334b15a-cbe7-4053-a673-79f679a22a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:23.404361 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334b15a-cbe7-4053-a673-79f679a22a8a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:23.404726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334b15a-cbe7-4053-a673-79f679a22a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:23.405230 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334b15a-cbe7-4053-a673-79f679a22a8a None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:23.406139 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334b15a-cbe7-4053-a673-79f679a22a8a None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:23.406442 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334b15a-cbe7-4053-a673-79f679a22a8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:23.407068 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3320602-c309-405a-a8cd-5d377e28ebc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:23.407948 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3320602-c309-405a-a8cd-5d377e28ebc3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:23.408384 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334b15a-cbe7-4053-a673-79f679a22a8a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:23.408655 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3320602-c309-405a-a8cd-5d377e28ebc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:23.409174 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3320602-c309-405a-a8cd-5d377e28ebc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:23.422081 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3320602-c309-405a-a8cd-5d377e28ebc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:23.423943 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3320602-c309-405a-a8cd-5d377e28ebc3 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:23.424540 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 286/559] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:42:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:23.426315 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334b15a-cbe7-4053-a673-79f679a22a8a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:23.452611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-f3320602-c309-405a-a8cd-5d377e28ebc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:23.452611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:23.452611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:23.452611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:23.452611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:23.452611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:23.452611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:23.452611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:23.452611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:23.452611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:23.452611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:23.452611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:23.452611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:23.452611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:23.452611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:23.452611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:23.453683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:23.453683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:23.453683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:23.453683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:23.453683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:23.453683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:23.453683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:23.453683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:23.453683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:23.453683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:23.453683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:23.453683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:23.453683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:23.453683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:23.453683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:23.453683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:23.453683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:23.454626 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:23.454626 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:23.454626 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:23.459844 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 274/560] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:23.463606 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3320602-c309-405a-a8cd-5d377e28ebc3 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:23.585738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334b15a-cbe7-4053-a673-79f679a22a8a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:23.602433 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3320602-c309-405a-a8cd-5d377e28ebc3 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:23.622247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1db5f-dddc-4dc4-9252-d3150cc31801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:23.622860 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1db5f-dddc-4dc4-9252-d3150cc31801 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:23.623139 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1db5f-dddc-4dc4-9252-d3150cc31801 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:23.623414 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1db5f-dddc-4dc4-9252-d3150cc31801 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:23.626274 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:23.648981 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76101c-56d3-4d70-be32-12e8becb295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:23.649595 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76101c-56d3-4d70-be32-12e8becb295c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:23.649873 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76101c-56d3-4d70-be32-12e8becb295c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:23.650142 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76101c-56d3-4d70-be32-12e8becb295c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:23.662528 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76101c-56d3-4d70-be32-12e8becb295c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:23.663997 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76101c-56d3-4d70-be32-12e8becb295c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:23.678986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-ab76101c-56d3-4d70-be32-12e8becb295c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:23.678986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:23.678986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:23.678986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:23.678986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:23.678986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:23.678986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:23.678986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:23.678986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:23.678986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:23.678986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:23.678986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:23.678986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:23.678986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:23.678986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:23.678986 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:23.680182 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:23.680182 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:23.680182 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:23.680182 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:23.680182 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:23.680182 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:23.680182 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:23.680182 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:23.680182 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:23.680182 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:23.680182 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:23.680182 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:23.680182 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:23.680182 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:23.680182 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:23.680182 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:23.680182 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:23.681325 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:23.681325 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:23.681325 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:23.681325 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 275/561] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:23.681325 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76101c-56d3-4d70-be32-12e8becb295c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:23.699939 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:23.717353 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1db5f-dddc-4dc4-9252-d3150cc31801 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:23.720117 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1db5f-dddc-4dc4-9252-d3150cc31801 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:23.794740 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76101c-56d3-4d70-be32-12e8becb295c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:23.834502 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83c1fe-1f71-4214-8704-a797188ac2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:23.835109 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83c1fe-1f71-4214-8704-a797188ac2ef None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:23.835383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83c1fe-1f71-4214-8704-a797188ac2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:23.835654 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83c1fe-1f71-4214-8704-a797188ac2ef None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:23.836379 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83c1fe-1f71-4214-8704-a797188ac2ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:23.836603 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83c1fe-1f71-4214-8704-a797188ac2ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:23.838048 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83c1fe-1f71-4214-8704-a797188ac2ef None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:23.852352 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 287/562] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:42:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:42:23.859950 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 276/563] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:23.860193 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff5104-eac1-445d-8ff7-4d7e84b98f38 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:23.860193 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff5104-eac1-445d-8ff7-4d7e84b98f38 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:23.860193 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff5104-eac1-445d-8ff7-4d7e84b98f38 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:23.860620 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83c1fe-1f71-4214-8704-a797188ac2ef None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:23.860752 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 288/564] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:23.860752 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff5104-eac1-445d-8ff7-4d7e84b98f38 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:23.908344 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:23.964277 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:23.992700 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83c1fe-1f71-4214-8704-a797188ac2ef None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:23.999241 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff5104-eac1-445d-8ff7-4d7e84b98f38 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:24.038816 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79505687-26e0-454b-9759-a3ae6adcca90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:24.039622 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79505687-26e0-454b-9759-a3ae6adcca90 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:24.039981 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79505687-26e0-454b-9759-a3ae6adcca90 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:24.040400 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79505687-26e0-454b-9759-a3ae6adcca90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:24.041918 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9bd97-8195-4f5d-b596-966e90ba8b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:24.042556 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9bd97-8195-4f5d-b596-966e90ba8b8c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:24.042843 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9bd97-8195-4f5d-b596-966e90ba8b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:24.043733 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9bd97-8195-4f5d-b596-966e90ba8b8c None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:24.044756 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9bd97-8195-4f5d-b596-966e90ba8b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:24.045110 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9bd97-8195-4f5d-b596-966e90ba8b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:24.046570 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9bd97-8195-4f5d-b596-966e90ba8b8c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:24.059454 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 289/565] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:24.060344 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9bd97-8195-4f5d-b596-966e90ba8b8c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:24.060807 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79505687-26e0-454b-9759-a3ae6adcca90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:24.070562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-79505687-26e0-454b-9759-a3ae6adcca90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:24.070562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:24.070562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:24.070562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:24.070562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:24.070562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:24.070562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:24.070562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:24.070562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:24.070562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:24.070562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:24.070562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:24.070562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:24.070562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:24.070562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:24.070562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:24.072462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:24.072462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:24.072462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:24.072462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:24.072462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:24.072462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:24.072462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:24.072462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:24.072462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:24.072462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:24.072462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:24.072462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:24.072462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:24.072462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:24.072462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:24.072462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:24.074982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:24.074982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:24.074982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:24.074982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:24.074982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:24.074982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:24.074982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:24.074982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:24.074982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:24.074982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:24.074982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:24.074982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:24.074982 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 277/566] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:24.076500 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79505687-26e0-454b-9759-a3ae6adcca90 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:24.180892 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:24.193231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9bd97-8195-4f5d-b596-966e90ba8b8c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:24.236142 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79505687-26e0-454b-9759-a3ae6adcca90 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:24.237422 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f011e-9e32-436b-b570-7ac6d141e0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:24.238194 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f011e-9e32-436b-b570-7ac6d141e0be None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:24.238569 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f011e-9e32-436b-b570-7ac6d141e0be None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:24.238953 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f011e-9e32-436b-b570-7ac6d141e0be None admin] PATH_INFO: `/v3/users/nova` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:24.248617 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f011e-9e32-436b-b570-7ac6d141e0be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:24.250521 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f011e-9e32-436b-b570-7ac6d141e0be None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:24.265400 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-178f011e-9e32-436b-b570-7ac6d141e0be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:42:24.265400 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:24.265400 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:24.265400 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:24.265400 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:24.265400 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:24.265400 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:24.265400 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:24.265400 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:24.265400 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:24.265400 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:24.265400 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:24.265400 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:24.265400 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:24.265400 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:24.265400 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:24.267130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:24.267130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:24.267130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:24.267130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:24.267130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:24.267130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:24.267130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:24.267130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:24.267130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:24.267130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:24.267130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:24.267130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:24.267130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:24.267130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:24.267130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:24.267130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:24.267130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:24.267130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:24.268177 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:24.268177 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:24.268177 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:24.268177 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:24.268177 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:24.268177 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:24.268177 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:24.268177 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:24.268177 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:42:24.268177 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:24.268177 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 290/567] 10.222.0.26 () {56 vars in 1093 bytes} [Sun Oct 2 00:42:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:24.268795 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13910203-e7cb-4ab7-9cd3-c7d79a94a763 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:24.268795 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13910203-e7cb-4ab7-9cd3-c7d79a94a763 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:24.268917 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13910203-e7cb-4ab7-9cd3-c7d79a94a763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:24.283712 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84993f1-96ff-4af4-b057-3dd6dd51ab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:24.284353 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84993f1-96ff-4af4-b057-3dd6dd51ab17 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:24.284631 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84993f1-96ff-4af4-b057-3dd6dd51ab17 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:24.284905 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84993f1-96ff-4af4-b057-3dd6dd51ab17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:24.287210 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:24.296410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-13910203-e7cb-4ab7-9cd3-c7d79a94a763 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:24.298482 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-13910203-e7cb-4ab7-9cd3-c7d79a94a763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:24.299403 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84993f1-96ff-4af4-b057-3dd6dd51ab17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:24.300918 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84993f1-96ff-4af4-b057-3dd6dd51ab17 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:24.316788 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e84993f1-96ff-4af4-b057-3dd6dd51ab17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:24.316788 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:24.316788 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:24.316788 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:24.316788 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:24.316788 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:24.316788 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:24.316788 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:24.316788 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:24.316788 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:24.316788 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:24.316788 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:24.316788 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:24.316788 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:24.316788 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:24.316788 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:24.318734 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:24.318734 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:24.318734 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:24.318734 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:24.318734 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:24.318734 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:24.318734 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:24.318734 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:24.318734 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:24.318734 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:24.318734 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:24.318734 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:24.318734 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:24.318734 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:24.318734 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:24.318734 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:24.318734 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:24.320446 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:24.320446 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:24.320446 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:24.320446 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 278/568] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:24.320446 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84993f1-96ff-4af4-b057-3dd6dd51ab17 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:24.388451 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 291/569] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:24.390351 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13910203-e7cb-4ab7-9cd3-c7d79a94a763 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:24.475862 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84993f1-96ff-4af4-b057-3dd6dd51ab17 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:24.542220 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:24.544690 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f01c3-bec3-488c-a46d-6679d766f41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:24.545936 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f01c3-bec3-488c-a46d-6679d766f41e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:24.546602 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f01c3-bec3-488c-a46d-6679d766f41e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:24.547102 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f01c3-bec3-488c-a46d-6679d766f41e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:24.560155 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f01c3-bec3-488c-a46d-6679d766f41e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:24.562434 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f01c3-bec3-488c-a46d-6679d766f41e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:24.574371 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13910203-e7cb-4ab7-9cd3-c7d79a94a763 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:24.588016 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-735f01c3-bec3-488c-a46d-6679d766f41e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 02 00:42:24.588016 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:24.588016 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:24.588016 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:24.588016 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:24.588016 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:24.588016 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:24.588016 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:24.588016 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:24.588016 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:24.588016 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:24.588016 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:24.588016 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:24.588016 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:24.588016 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:24.588016 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:24.589095 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:24.589095 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:24.589095 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:24.589095 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:24.589095 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:24.589095 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:24.589095 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:24.589095 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:24.589095 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:24.589095 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:24.589095 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:24.589095 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:24.589095 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:24.589095 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:24.589095 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:24.589095 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:24.589095 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:24.589095 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:24.590170 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:24.590170 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:24.590170 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:24.590170 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:24.590170 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:24.590170 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:24.590170 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:24.590170 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:24.590170 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 02 00:42:24.590170 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:24.593314 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 279/570] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:42:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:24.594501 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f01c3-bec3-488c-a46d-6679d766f41e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:24.646853 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d82206-920a-4589-adf1-781e223a0b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:24.647981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d82206-920a-4589-adf1-781e223a0b9b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:24.649275 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d82206-920a-4589-adf1-781e223a0b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:24.649275 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d82206-920a-4589-adf1-781e223a0b9b None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:24.650292 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d82206-920a-4589-adf1-781e223a0b9b None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:24.650826 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d82206-920a-4589-adf1-781e223a0b9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:24.653505 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d82206-920a-4589-adf1-781e223a0b9b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:24.669810 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 292/571] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:42:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:24.670506 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:24.671163 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d82206-920a-4589-adf1-781e223a0b9b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:24.740718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f01c3-bec3-488c-a46d-6679d766f41e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:24.780833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeedf7-b095-422e-bfe1-5546742bbe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:24.781498 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeedf7-b095-422e-bfe1-5546742bbe1c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:24.781773 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeedf7-b095-422e-bfe1-5546742bbe1c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:24.782048 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeedf7-b095-422e-bfe1-5546742bbe1c None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:24.782802 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeedf7-b095-422e-bfe1-5546742bbe1c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:24.783106 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeedf7-b095-422e-bfe1-5546742bbe1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:24.784583 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeedf7-b095-422e-bfe1-5546742bbe1c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:24.804761 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 280/572] 10.222.0.26 () {56 vars in 1133 bytes} [Sun Oct 2 00:42:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:24.805709 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeedf7-b095-422e-bfe1-5546742bbe1c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:24.821464 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d82206-920a-4589-adf1-781e223a0b9b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:24.867479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92942e42-46b5-44bd-8a06-d830bd89ac9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:24.868095 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92942e42-46b5-44bd-8a06-d830bd89ac9d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:24.868375 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92942e42-46b5-44bd-8a06-d830bd89ac9d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:24.868647 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92942e42-46b5-44bd-8a06-d830bd89ac9d None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:24.869372 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92942e42-46b5-44bd-8a06-d830bd89ac9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:24.869640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92942e42-46b5-44bd-8a06-d830bd89ac9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:24.871073 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92942e42-46b5-44bd-8a06-d830bd89ac9d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:24.887370 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 293/573] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:24.889347 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92942e42-46b5-44bd-8a06-d830bd89ac9d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:24.902965 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:24.934844 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeedf7-b095-422e-bfe1-5546742bbe1c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:24.937729 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:24.981674 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c0bbc-95da-453f-babb-78e67901fb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:24.982494 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c0bbc-95da-453f-babb-78e67901fb5e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:24.982628 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c0bbc-95da-453f-babb-78e67901fb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:24.982850 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c0bbc-95da-453f-babb-78e67901fb5e None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:24.983627 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c0bbc-95da-453f-babb-78e67901fb5e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:24.983942 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c0bbc-95da-453f-babb-78e67901fb5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:24.985519 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c0bbc-95da-453f-babb-78e67901fb5e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:25.005717 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 281/574] 10.222.0.26 () {56 vars in 1137 bytes} [Sun Oct 2 00:42:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:25.006480 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c0bbc-95da-453f-babb-78e67901fb5e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:25.026213 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92942e42-46b5-44bd-8a06-d830bd89ac9d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:25.085461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c92ee-ca41-4069-ab85-c894d465e1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:25.086399 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c92ee-ca41-4069-ab85-c894d465e1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:25.086846 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c92ee-ca41-4069-ab85-c894d465e1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:25.087292 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c92ee-ca41-4069-ab85-c894d465e1a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:25.104832 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c92ee-ca41-4069-ab85-c894d465e1a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:25.114169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ad1c92ee-ca41-4069-ab85-c894d465e1a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:25.114169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:25.114169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:25.114169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:25.114169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:25.114169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:25.114169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:25.114169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:25.114169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:25.114169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:25.114169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:25.114169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:25.114169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:25.114169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:25.114169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:25.114169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:25.115997 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:25.115997 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:25.115997 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:25.115997 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:25.115997 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:25.115997 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:25.115997 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:25.115997 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:25.115997 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:25.115997 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:25.115997 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:25.115997 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:25.115997 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:25.115997 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:25.115997 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:25.115997 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:25.117646 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:25.117646 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:25.117646 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:25.117646 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:25.117646 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:25.117646 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:25.117646 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:25.117646 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:25.117646 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:25.117646 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:25.117646 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:25.117646 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:25.119544 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 294/575] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:25.120350 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c92ee-ca41-4069-ab85-c894d465e1a0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:25.170050 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c0bbc-95da-453f-babb-78e67901fb5e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:25.223255 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c66fd-68db-4b37-afa3-b34cba728180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:25.224046 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c66fd-68db-4b37-afa3-b34cba728180 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:25.224417 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c66fd-68db-4b37-afa3-b34cba728180 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:25.224778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c66fd-68db-4b37-afa3-b34cba728180 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:25.228100 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:25.238902 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c66fd-68db-4b37-afa3-b34cba728180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:25.240447 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c66fd-68db-4b37-afa3-b34cba728180 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:25.258128 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-f93c66fd-68db-4b37-afa3-b34cba728180 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:25.258128 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:25.258128 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:25.258128 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:25.258128 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:25.258128 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:25.258128 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:25.258128 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:25.258128 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:25.258128 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:25.258128 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:25.258128 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:25.258128 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:25.258128 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:25.258128 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:25.258128 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:25.259945 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:25.259945 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:25.259945 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:25.259945 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:25.259945 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:25.259945 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:25.259945 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:25.259945 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:25.259945 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:25.259945 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:25.259945 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:25.259945 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:25.259945 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:25.259945 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:25.259945 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:25.259945 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:25.259945 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:25.261198 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:25.261198 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:25.261198 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:25.261198 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 282/576] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:25.261198 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c66fd-68db-4b37-afa3-b34cba728180 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:25.279522 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:25.289511 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c92ee-ca41-4069-ab85-c894d465e1a0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:25.329107 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cff6c-cad4-4189-b4a7-84d3bf734c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:25.329751 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cff6c-cad4-4189-b4a7-84d3bf734c82 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:25.330042 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cff6c-cad4-4189-b4a7-84d3bf734c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:25.330315 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cff6c-cad4-4189-b4a7-84d3bf734c82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:25.342231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cff6c-cad4-4189-b4a7-84d3bf734c82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:25.343814 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cff6c-cad4-4189-b4a7-84d3bf734c82 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:25.362111 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c81cff6c-cad4-4189-b4a7-84d3bf734c82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:25.362111 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:25.362111 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:25.362111 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:25.362111 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:25.362111 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:25.362111 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:25.362111 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:25.362111 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:25.362111 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:25.362111 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:25.362111 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:25.362111 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:25.362111 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:25.362111 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:25.362111 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:25.364204 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:25.364204 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:25.364204 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:25.364204 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:25.364204 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:25.364204 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:25.364204 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:25.364204 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:25.364204 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:25.364204 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:25.364204 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:25.364204 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:25.364204 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:25.364204 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:25.364204 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:25.364204 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:25.364204 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:25.366352 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:25.366352 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:25.366352 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:25.370058 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 295/577] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:25.371732 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cff6c-cad4-4189-b4a7-84d3bf734c82 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:25.413356 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c66fd-68db-4b37-afa3-b34cba728180 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:25.454326 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075e25a-cf53-423e-895a-3b98fc4a8b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:25.454587 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075e25a-cf53-423e-895a-3b98fc4a8b3f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:25.454817 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075e25a-cf53-423e-895a-3b98fc4a8b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:25.455092 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075e25a-cf53-423e-895a-3b98fc4a8b3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:25.462369 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075e25a-cf53-423e-895a-3b98fc4a8b3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:25.463848 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075e25a-cf53-423e-895a-3b98fc4a8b3f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:25.476360 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-2075e25a-cf53-423e-895a-3b98fc4a8b3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:25.476360 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:25.476360 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:25.476360 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:25.476360 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:25.476360 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:25.476360 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:25.476360 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:25.476360 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:25.476360 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:25.476360 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:25.476360 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:25.476360 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:25.476360 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:25.476360 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:25.478284 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:25.478284 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:25.478284 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:25.478284 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:25.478284 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:25.478284 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:25.478284 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:25.478284 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:25.478284 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:25.478284 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:25.478284 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:25.478284 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:25.478284 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:25.478284 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:25.478284 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:25.478284 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:25.478284 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:25.480019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:25.480019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:25.480019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:25.480019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:25.480019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:25.480019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:25.480019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:25.480019 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:25.480019 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 283/578] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:25.483883 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075e25a-cf53-423e-895a-3b98fc4a8b3f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:25.515855 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cff6c-cad4-4189-b4a7-84d3bf734c82 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:25.534206 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:25.556708 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621716e3-c394-4c54-ba43-458046c0a8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:25.557372 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621716e3-c394-4c54-ba43-458046c0a8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:25.557686 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621716e3-c394-4c54-ba43-458046c0a8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:25.557923 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621716e3-c394-4c54-ba43-458046c0a8a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:25.576750 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621716e3-c394-4c54-ba43-458046c0a8a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:25.579526 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621716e3-c394-4c54-ba43-458046c0a8a2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:25.589924 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:25.606814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-621716e3-c394-4c54-ba43-458046c0a8a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:25.606814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:25.606814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:25.606814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:25.606814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:25.606814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:25.606814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:25.606814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:25.606814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:25.606814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:25.606814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:25.606814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:25.606814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:25.606814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:25.606814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:25.606814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:25.608453 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:25.608453 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:25.608453 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:25.608453 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:25.608453 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:25.608453 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:25.608453 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:25.608453 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:25.608453 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:25.608453 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:25.608453 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:25.608453 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:25.608453 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:25.608453 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:25.608453 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:25.608453 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:25.608453 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:25.610452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:25.610452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:25.610452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:25.610452 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 296/579] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:25.610452 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621716e3-c394-4c54-ba43-458046c0a8a2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:25.624885 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075e25a-cf53-423e-895a-3b98fc4a8b3f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:25.665975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e789912-b2a6-4ada-8fc7-2c2147f6a044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:25.666714 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e789912-b2a6-4ada-8fc7-2c2147f6a044 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:25.667189 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e789912-b2a6-4ada-8fc7-2c2147f6a044 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:25.667543 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e789912-b2a6-4ada-8fc7-2c2147f6a044 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:25.669679 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e789912-b2a6-4ada-8fc7-2c2147f6a044 None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:25.670057 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e789912-b2a6-4ada-8fc7-2c2147f6a044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:25.671720 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e789912-b2a6-4ada-8fc7-2c2147f6a044 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:25.689611 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 284/580] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:42:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:25.689611 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e789912-b2a6-4ada-8fc7-2c2147f6a044 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:25.754540 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621716e3-c394-4c54-ba43-458046c0a8a2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:25.801627 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455b21f-d1ee-41a4-be83-c6bdfc1f8ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:25.802153 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455b21f-d1ee-41a4-be83-c6bdfc1f8ebc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:25.802433 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455b21f-d1ee-41a4-be83-c6bdfc1f8ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:25.802724 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455b21f-d1ee-41a4-be83-c6bdfc1f8ebc None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:25.803369 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455b21f-d1ee-41a4-be83-c6bdfc1f8ebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:25.803670 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455b21f-d1ee-41a4-be83-c6bdfc1f8ebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:25.805102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455b21f-d1ee-41a4-be83-c6bdfc1f8ebc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:25.818119 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 297/581] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:25.818992 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455b21f-d1ee-41a4-be83-c6bdfc1f8ebc None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:25.826024 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e789912-b2a6-4ada-8fc7-2c2147f6a044 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:25.863958 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:25.873151 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3142630-6bd6-4df3-bef5-80edf6415376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:25.873784 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3142630-6bd6-4df3-bef5-80edf6415376 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:25.874057 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3142630-6bd6-4df3-bef5-80edf6415376 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:25.874329 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3142630-6bd6-4df3-bef5-80edf6415376 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:25.874989 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3142630-6bd6-4df3-bef5-80edf6415376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:25.875289 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3142630-6bd6-4df3-bef5-80edf6415376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:25.876695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3142630-6bd6-4df3-bef5-80edf6415376 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:25.879557 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:25.892298 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 285/582] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:25.893754 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3142630-6bd6-4df3-bef5-80edf6415376 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:25.958698 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455b21f-d1ee-41a4-be83-c6bdfc1f8ebc None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:25.999873 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bfcc7-c29c-4199-a4a8-855a94503fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:26.000482 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bfcc7-c29c-4199-a4a8-855a94503fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:26.000760 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bfcc7-c29c-4199-a4a8-855a94503fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:26.001059 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bfcc7-c29c-4199-a4a8-855a94503fd9 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:26.001753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bfcc7-c29c-4199-a4a8-855a94503fd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:26.002055 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bfcc7-c29c-4199-a4a8-855a94503fd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:26.003491 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bfcc7-c29c-4199-a4a8-855a94503fd9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:26.014743 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3142630-6bd6-4df3-bef5-80edf6415376 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:26.016825 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 298/583] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:26.017708 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bfcc7-c29c-4199-a4a8-855a94503fd9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:26.064041 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c8ecd-d6fb-4b07-902c-9e497b4ee471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:26.064549 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c8ecd-d6fb-4b07-902c-9e497b4ee471 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:26.064833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c8ecd-d6fb-4b07-902c-9e497b4ee471 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:26.065136 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c8ecd-d6fb-4b07-902c-9e497b4ee471 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:26.065795 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c8ecd-d6fb-4b07-902c-9e497b4ee471 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:26.066116 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c8ecd-d6fb-4b07-902c-9e497b4ee471 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:26.067533 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c8ecd-d6fb-4b07-902c-9e497b4ee471 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:26.088997 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 286/584] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:26.088997 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c8ecd-d6fb-4b07-902c-9e497b4ee471 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:26.123873 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:26.135501 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bfcc7-c29c-4199-a4a8-855a94503fd9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:26.160627 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:26.175611 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a733dd-7185-4d90-87d8-debf93ff0cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:26.176254 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a733dd-7185-4d90-87d8-debf93ff0cea None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:26.176530 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a733dd-7185-4d90-87d8-debf93ff0cea None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:26.176798 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a733dd-7185-4d90-87d8-debf93ff0cea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:26.191284 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a733dd-7185-4d90-87d8-debf93ff0cea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:26.193709 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a733dd-7185-4d90-87d8-debf93ff0cea None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:26.219754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-32a733dd-7185-4d90-87d8-debf93ff0cea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:26.219754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:26.219754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:26.219754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:26.219754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:26.219754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:26.219754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:26.219754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:26.219754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:26.219754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:26.219754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:26.219754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:26.219754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:26.219754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:26.219754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:26.219754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:26.221107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:26.221107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:26.221107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:26.221107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:26.221107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:26.221107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:26.221107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:26.221107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:26.221107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:26.221107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:26.221107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:26.221107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:26.221107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:26.221107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:26.221107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:26.221107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:26.221107 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:26.227156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:26.227156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:26.227156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:26.227156 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 299/585] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:26.227156 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a733dd-7185-4d90-87d8-debf93ff0cea None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:26.233919 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c8ecd-d6fb-4b07-902c-9e497b4ee471 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:26.287089 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d313d-9913-411c-b130-e06cf0718a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:26.287809 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d313d-9913-411c-b130-e06cf0718a71 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:26.288151 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d313d-9913-411c-b130-e06cf0718a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:26.288519 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d313d-9913-411c-b130-e06cf0718a71 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:26.298692 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d313d-9913-411c-b130-e06cf0718a71 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:26.300437 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d313d-9913-411c-b130-e06cf0718a71 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:26.316974 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-786d313d-9913-411c-b130-e06cf0718a71 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 02 00:42:26.316974 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:26.316974 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:26.316974 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:26.316974 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:26.316974 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:26.316974 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:26.316974 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:26.316974 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:26.316974 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:26.316974 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:26.316974 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:26.316974 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:26.316974 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:26.316974 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:26.316974 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:26.326918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:26.326918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:26.326918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:26.326918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:26.326918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:26.326918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:26.326918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:26.326918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:26.326918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:26.326918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:26.326918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:26.326918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:26.326918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:26.326918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:26.326918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:26.326918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:26.326918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:26.326918 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:26.328915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:26.328915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:26.328915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:26.328915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:26.328915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:26.328915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:26.328915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:26.328915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:26.328915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 02 00:42:26.328915 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:26.328915 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 287/586] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:42:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:26.328915 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d313d-9913-411c-b130-e06cf0718a71 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:26.366214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a733dd-7185-4d90-87d8-debf93ff0cea None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:26.429320 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3b0db-7e16-4d74-abae-854ec8dd855b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:26.430299 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3b0db-7e16-4d74-abae-854ec8dd855b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:26.430748 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3b0db-7e16-4d74-abae-854ec8dd855b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:26.431183 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3b0db-7e16-4d74-abae-854ec8dd855b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:26.441644 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3b0db-7e16-4d74-abae-854ec8dd855b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:26.443137 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3b0db-7e16-4d74-abae-854ec8dd855b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:26.456266 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-2de3b0db-7e16-4d74-abae-854ec8dd855b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:26.456266 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:26.456266 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:26.456266 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:26.456266 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:26.456266 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:26.456266 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:26.456266 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:26.456266 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:26.456266 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:26.456266 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:26.456266 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:26.456266 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:26.456266 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:26.456266 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:26.458248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:26.458248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:26.458248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:26.458248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:26.458248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:26.458248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:26.458248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:26.458248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:26.458248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:26.458248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:26.458248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:26.458248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:26.458248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:26.458248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:26.458248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:26.458248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:26.458248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:26.460187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:26.460187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:26.460187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:26.460187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:26.460187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:26.460187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:26.460187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:26.460187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:26.460187 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 300/587] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:26.460187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3b0db-7e16-4d74-abae-854ec8dd855b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:26.462489 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:26.469319 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d313d-9913-411c-b130-e06cf0718a71 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:26.490305 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:26.512272 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c961ce1-6479-40c4-a664-eafd9c7139c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:26.513222 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c961ce1-6479-40c4-a664-eafd9c7139c2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:26.513885 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c961ce1-6479-40c4-a664-eafd9c7139c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:26.514284 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c961ce1-6479-40c4-a664-eafd9c7139c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:26.515314 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c961ce1-6479-40c4-a664-eafd9c7139c2 None admin] RBAC: Adding query filter params (role.id=714239b608694824a75962d8cbb39f70, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=2784579d2ddf4cc99fe0e1d109e5cdda) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:26.515790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c961ce1-6479-40c4-a664-eafd9c7139c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:26.517589 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c961ce1-6479-40c4-a664-eafd9c7139c2 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:26.524415 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 288/588] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:42:26 2022] GET /identity/v3/role_assignments?user.id=2784579d2ddf4cc99fe0e1d109e5cdda&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=714239b608694824a75962d8cbb39f70 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:26.525448 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c961ce1-6479-40c4-a664-eafd9c7139c2 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:26.605171 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3b0db-7e16-4d74-abae-854ec8dd855b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:26.664306 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f1dd6-06dc-4bad-ad17-af196fb815bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:26.664986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f1dd6-06dc-4bad-ad17-af196fb815bc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:26.665269 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f1dd6-06dc-4bad-ad17-af196fb815bc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:26.665538 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f1dd6-06dc-4bad-ad17-af196fb815bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:26.674568 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f1dd6-06dc-4bad-ad17-af196fb815bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:26.676310 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f1dd6-06dc-4bad-ad17-af196fb815bc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:26.692020 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-711f1dd6-06dc-4bad-ad17-af196fb815bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:26.692020 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:26.692020 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:26.692020 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:26.692020 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:26.692020 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:26.692020 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:26.692020 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:26.692020 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:26.692020 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:26.692020 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:26.692020 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:26.692020 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:26.692020 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:26.692020 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:26.694059 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:26.694059 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:26.694059 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:26.694059 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:26.694059 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:26.694059 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:26.694059 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:26.694059 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:26.694059 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:26.694059 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:26.694059 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:26.694059 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:26.694059 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:26.694059 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:26.694059 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:26.694059 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:26.694059 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:26.696088 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:26.696088 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:26.696088 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:26.696088 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:26.696088 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:26.696088 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:26.696088 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:26.696088 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:26.701619 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 301/589] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:26.702634 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f1dd6-06dc-4bad-ad17-af196fb815bc None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:26.723491 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c961ce1-6479-40c4-a664-eafd9c7139c2 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:26.784859 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749929e6-d033-4e60-ac2e-dd91527b62aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:26.786655 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749929e6-d033-4e60-ac2e-dd91527b62aa None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:26.787294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749929e6-d033-4e60-ac2e-dd91527b62aa None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:26.788013 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749929e6-d033-4e60-ac2e-dd91527b62aa None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:26.790466 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749929e6-d033-4e60-ac2e-dd91527b62aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:26.791123 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749929e6-d033-4e60-ac2e-dd91527b62aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:26.797493 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749929e6-d033-4e60-ac2e-dd91527b62aa None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:26.799869 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:26.825628 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 289/590] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:26.827407 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749929e6-d033-4e60-ac2e-dd91527b62aa None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:26.859461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f1dd6-06dc-4bad-ad17-af196fb815bc None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:26.909580 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:26.910275 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421acc13-9661-4d8c-9340-eedcc41d6fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:26.911012 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421acc13-9661-4d8c-9340-eedcc41d6fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:26.911497 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421acc13-9661-4d8c-9340-eedcc41d6fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:26.911736 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421acc13-9661-4d8c-9340-eedcc41d6fd2 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:26.913092 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421acc13-9661-4d8c-9340-eedcc41d6fd2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:26.913092 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421acc13-9661-4d8c-9340-eedcc41d6fd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:26.914618 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421acc13-9661-4d8c-9340-eedcc41d6fd2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:26.945379 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 302/591] 10.222.0.26 () {56 vars in 1137 bytes} [Sun Oct 2 00:42:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:26.945379 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421acc13-9661-4d8c-9340-eedcc41d6fd2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:27.032561 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749929e6-d033-4e60-ac2e-dd91527b62aa None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:27.091807 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb3645-bc22-4e61-b7b5-905fa19b636c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:27.092760 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb3645-bc22-4e61-b7b5-905fa19b636c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:27.093207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb3645-bc22-4e61-b7b5-905fa19b636c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:27.096083 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb3645-bc22-4e61-b7b5-905fa19b636c None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:27.096083 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb3645-bc22-4e61-b7b5-905fa19b636c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:27.096083 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb3645-bc22-4e61-b7b5-905fa19b636c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:27.097573 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb3645-bc22-4e61-b7b5-905fa19b636c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:27.127894 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 290/592] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:27.127894 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb3645-bc22-4e61-b7b5-905fa19b636c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:27.136238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421acc13-9661-4d8c-9340-eedcc41d6fd2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:27.173260 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:27.193701 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00ebea-cde2-4aa3-830b-d096c755fc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:27.194541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00ebea-cde2-4aa3-830b-d096c755fc24 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:27.195011 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00ebea-cde2-4aa3-830b-d096c755fc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:27.195495 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00ebea-cde2-4aa3-830b-d096c755fc24 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:27.196793 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00ebea-cde2-4aa3-830b-d096c755fc24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:27.197306 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00ebea-cde2-4aa3-830b-d096c755fc24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:27.198920 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00ebea-cde2-4aa3-830b-d096c755fc24 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:27.220962 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 303/593] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:27.220962 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00ebea-cde2-4aa3-830b-d096c755fc24 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:27.303787 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:27.308061 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb3645-bc22-4e61-b7b5-905fa19b636c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:27.373296 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c9fb7-de82-48b5-86f0-fe0d63ef28fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:27.374390 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c9fb7-de82-48b5-86f0-fe0d63ef28fc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:27.374724 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00ebea-cde2-4aa3-830b-d096c755fc24 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:27.374899 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c9fb7-de82-48b5-86f0-fe0d63ef28fc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:27.375288 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c9fb7-de82-48b5-86f0-fe0d63ef28fc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:27.390190 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c9fb7-de82-48b5-86f0-fe0d63ef28fc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:27.392832 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c9fb7-de82-48b5-86f0-fe0d63ef28fc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:27.416544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-538c9fb7-de82-48b5-86f0-fe0d63ef28fc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 02 00:42:27.416544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:27.416544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:27.416544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:27.416544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:27.416544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:27.416544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:27.416544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:27.416544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:27.416544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:27.416544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:27.416544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:27.416544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:27.416544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:27.416544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:27.416544 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:27.417568 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:27.417568 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:27.417568 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:27.417568 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:27.417568 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:27.417568 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:27.417568 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:27.417568 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:27.417568 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:27.417568 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:27.417568 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:27.417568 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:27.417568 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:27.417568 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:27.417568 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:27.417568 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:27.417568 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:27.417568 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:27.419043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:27.419043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:27.419043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:27.419043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:27.419043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:27.419043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:27.419043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:27.419043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:27.419043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 02 00:42:27.419043 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:27.419595 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 291/594] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:27.420727 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c9fb7-de82-48b5-86f0-fe0d63ef28fc None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:27.436895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1aa54-c5ef-4c85-911d-4834306b056e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:27.438158 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1aa54-c5ef-4c85-911d-4834306b056e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:27.438675 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1aa54-c5ef-4c85-911d-4834306b056e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:27.439260 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1aa54-c5ef-4c85-911d-4834306b056e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:27.458709 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1aa54-c5ef-4c85-911d-4834306b056e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:27.461315 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1aa54-c5ef-4c85-911d-4834306b056e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:27.486510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-44b1aa54-c5ef-4c85-911d-4834306b056e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:27.486510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:27.486510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:27.486510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:27.486510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:27.486510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:27.486510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:27.486510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:27.486510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:27.486510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:27.486510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:27.486510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:27.486510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:27.486510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:27.486510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:27.486510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:27.488348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:27.488348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:27.488348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:27.488348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:27.488348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:27.488348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:27.488348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:27.488348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:27.488348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:27.488348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:27.488348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:27.488348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:27.488348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:27.488348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:27.488348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:27.488348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:27.488348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:27.498101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:27.498101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:27.498101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:27.498101 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 304/595] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:27.498101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1aa54-c5ef-4c85-911d-4834306b056e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:27.548924 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:27.631285 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c9fb7-de82-48b5-86f0-fe0d63ef28fc None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:27.662305 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1aa54-c5ef-4c85-911d-4834306b056e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:27.696237 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c27a7b-10ff-4ddc-ab27-5524e6f1780d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:27.701132 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c27a7b-10ff-4ddc-ab27-5524e6f1780d None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:27.701640 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c27a7b-10ff-4ddc-ab27-5524e6f1780d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:27.702122 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c27a7b-10ff-4ddc-ab27-5524e6f1780d None admin] PATH_INFO: `/v3/projects/7aec935005514f808eb735bfb01fee6e/users/81e0396b7ba341ce8d02b1a149786d95/roles/714239b608694824a75962d8cbb39f70` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:27.723719 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c27a7b-10ff-4ddc-ab27-5524e6f1780d None admin] RBAC: Authorizing `identity:create_grant(project_id=7aec935005514f808eb735bfb01fee6e, user_id=81e0396b7ba341ce8d02b1a149786d95, role_id=714239b608694824a75962d8cbb39f70)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:27.725777 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c27a7b-10ff-4ddc-ab27-5524e6f1780d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:27.740797 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08cd81-c231-4e51-9070-ecded4d4c64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:27.742044 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08cd81-c231-4e51-9070-ecded4d4c64f None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:27.742458 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08cd81-c231-4e51-9070-ecded4d4c64f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:27.742945 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08cd81-c231-4e51-9070-ecded4d4c64f None admin] PATH_INFO: `/v3/projects/7aec935005514f808eb735bfb01fee6e/users/2920ad41c61b401299ca5ae1714b4031/roles/714239b608694824a75962d8cbb39f70` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:27.757293 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 292/596] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:42:27 2022] PUT /identity/v3/projects/7aec935005514f808eb735bfb01fee6e/users/81e0396b7ba341ce8d02b1a149786d95/roles/714239b608694824a75962d8cbb39f70 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:42:27.757293 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c27a7b-10ff-4ddc-ab27-5524e6f1780d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:27.777626 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08cd81-c231-4e51-9070-ecded4d4c64f None admin] RBAC: Authorizing `identity:create_grant(project_id=7aec935005514f808eb735bfb01fee6e, user_id=2920ad41c61b401299ca5ae1714b4031, role_id=714239b608694824a75962d8cbb39f70)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:27.781166 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08cd81-c231-4e51-9070-ecded4d4c64f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:27.785903 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:27.813091 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 305/597] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:42:27 2022] PUT /identity/v3/projects/7aec935005514f808eb735bfb01fee6e/users/2920ad41c61b401299ca5ae1714b4031/roles/714239b608694824a75962d8cbb39f70 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:42:27.814597 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08cd81-c231-4e51-9070-ecded4d4c64f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:28.074272 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c27a7b-10ff-4ddc-ab27-5524e6f1780d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:28.076505 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:28.117152 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08cd81-c231-4e51-9070-ecded4d4c64f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:28.149394 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e701157-ed79-440f-8a09-3afbb9230ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:28.150031 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e701157-ed79-440f-8a09-3afbb9230ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:28.150310 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e701157-ed79-440f-8a09-3afbb9230ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:28.150577 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e701157-ed79-440f-8a09-3afbb9230ed6 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:28.151344 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e701157-ed79-440f-8a09-3afbb9230ed6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:28.151641 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e701157-ed79-440f-8a09-3afbb9230ed6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:28.153891 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e701157-ed79-440f-8a09-3afbb9230ed6 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:28.180110 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 293/598] 10.222.0.26 () {56 vars in 1139 bytes} [Sun Oct 2 00:42:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:28.189043 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a5509-ac4e-4cc2-adc4-3df4fe91761b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:28.192984 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e701157-ed79-440f-8a09-3afbb9230ed6 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:28.194134 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a5509-ac4e-4cc2-adc4-3df4fe91761b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:28.194432 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a5509-ac4e-4cc2-adc4-3df4fe91761b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:28.194682 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a5509-ac4e-4cc2-adc4-3df4fe91761b None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:28.197511 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a5509-ac4e-4cc2-adc4-3df4fe91761b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:28.198075 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a5509-ac4e-4cc2-adc4-3df4fe91761b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:28.202561 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a5509-ac4e-4cc2-adc4-3df4fe91761b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:28.234868 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 306/599] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:28.246273 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a5509-ac4e-4cc2-adc4-3df4fe91761b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:28.331647 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:28.361219 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a5509-ac4e-4cc2-adc4-3df4fe91761b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:28.399688 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94003f58-4de2-4537-9f92-0ee24f5cb542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:28.400370 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94003f58-4de2-4537-9f92-0ee24f5cb542 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:28.400650 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94003f58-4de2-4537-9f92-0ee24f5cb542 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:28.400915 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94003f58-4de2-4537-9f92-0ee24f5cb542 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:28.409350 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94003f58-4de2-4537-9f92-0ee24f5cb542 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:28.410807 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94003f58-4de2-4537-9f92-0ee24f5cb542 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:28.431286 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-94003f58-4de2-4537-9f92-0ee24f5cb542 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:28.431286 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:28.431286 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:28.431286 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:28.431286 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:28.431286 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:28.431286 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:28.431286 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:28.431286 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:28.431286 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:28.431286 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:28.431286 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:28.431286 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:28.431286 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:28.431286 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:28.433016 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:28.433016 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:28.433016 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:28.433016 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:28.433016 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:28.433016 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:28.433016 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:28.433016 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:28.433016 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:28.433016 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:28.433016 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:28.433016 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:28.433016 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:28.433016 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:28.433016 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:28.433016 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:28.433016 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:28.436207 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:28.436207 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:28.436207 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:28.436207 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:28.436207 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:28.436207 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:28.436207 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:28.436207 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:28.436207 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 307/600] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:28.441721 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94003f58-4de2-4537-9f92-0ee24f5cb542 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:28.444360 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e701157-ed79-440f-8a09-3afbb9230ed6 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:28.466461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:28.548525 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94569ef9-d1eb-4454-a5e2-08c22c258742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:28.553312 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569ef9-d1eb-4454-a5e2-08c22c258742 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:28.553663 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569ef9-d1eb-4454-a5e2-08c22c258742 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:28.553919 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569ef9-d1eb-4454-a5e2-08c22c258742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:28.582315 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94569ef9-d1eb-4454-a5e2-08c22c258742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:28.583716 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94569ef9-d1eb-4454-a5e2-08c22c258742 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:28.635013 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-94569ef9-d1eb-4454-a5e2-08c22c258742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:28.635013 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:28.635013 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:28.635013 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:28.635013 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:28.635013 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:28.635013 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:28.635013 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:28.635013 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:28.635013 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:28.635013 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:28.635013 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:28.635013 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:28.635013 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:28.635013 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:28.635013 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:28.637461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:28.637461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:28.637461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:28.637461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:28.637461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:28.637461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:28.637461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:28.637461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:28.637461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:28.637461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:28.637461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:28.637461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:28.637461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:28.637461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:28.637461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:28.637461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:28.637461 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:28.639507 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:28.639507 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:28.639507 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:28.643213 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 294/601] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:42:28.657967 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94569ef9-d1eb-4454-a5e2-08c22c258742 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:28.687314 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94003f58-4de2-4537-9f92-0ee24f5cb542 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:28.767376 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea1c4d-2361-468e-bf52-ff99974f6bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:28.768017 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea1c4d-2361-468e-bf52-ff99974f6bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:28.768321 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea1c4d-2361-468e-bf52-ff99974f6bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:28.768585 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea1c4d-2361-468e-bf52-ff99974f6bd3 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:28.769341 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea1c4d-2361-468e-bf52-ff99974f6bd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:28.769646 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea1c4d-2361-468e-bf52-ff99974f6bd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:28.771125 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea1c4d-2361-468e-bf52-ff99974f6bd3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:28.816052 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 308/602] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:28.822490 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea1c4d-2361-468e-bf52-ff99974f6bd3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:28.896254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94569ef9-d1eb-4454-a5e2-08c22c258742 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:28.965866 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:28.990636 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:29.001808 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49136642-aaf1-4db0-91e4-42b8d2a66d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:29.002476 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49136642-aaf1-4db0-91e4-42b8d2a66d16 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:29.002760 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49136642-aaf1-4db0-91e4-42b8d2a66d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:29.003049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49136642-aaf1-4db0-91e4-42b8d2a66d16 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:29.003696 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49136642-aaf1-4db0-91e4-42b8d2a66d16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:29.004008 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49136642-aaf1-4db0-91e4-42b8d2a66d16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:29.005460 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49136642-aaf1-4db0-91e4-42b8d2a66d16 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:29.038014 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 295/603] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:29.044801 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49136642-aaf1-4db0-91e4-42b8d2a66d16 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:29.065644 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea1c4d-2361-468e-bf52-ff99974f6bd3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:29.159540 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad75fa-25e9-4470-9272-b19dbb3e8144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:29.160278 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad75fa-25e9-4470-9272-b19dbb3e8144 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:29.161221 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad75fa-25e9-4470-9272-b19dbb3e8144 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:29.161221 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad75fa-25e9-4470-9272-b19dbb3e8144 None admin] PATH_INFO: `/v3/projects/7aec935005514f808eb735bfb01fee6e/users/3469f1e6a9bf47b58d208bffc3415014/roles/714239b608694824a75962d8cbb39f70` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:29.184175 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad75fa-25e9-4470-9272-b19dbb3e8144 None admin] RBAC: Authorizing `identity:create_grant(project_id=7aec935005514f808eb735bfb01fee6e, user_id=3469f1e6a9bf47b58d208bffc3415014, role_id=714239b608694824a75962d8cbb39f70)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:29.188147 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad75fa-25e9-4470-9272-b19dbb3e8144 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:29.213112 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 309/604] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:42:28 2022] PUT /identity/v3/projects/7aec935005514f808eb735bfb01fee6e/users/3469f1e6a9bf47b58d208bffc3415014/roles/714239b608694824a75962d8cbb39f70 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:42:29.266266 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49136642-aaf1-4db0-91e4-42b8d2a66d16 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:29.322875 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c3493-d661-4a5a-a608-076f982c1737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:29.323529 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c3493-d661-4a5a-a608-076f982c1737 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:29.323810 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c3493-d661-4a5a-a608-076f982c1737 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:29.324686 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c3493-d661-4a5a-a608-076f982c1737 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:29.337780 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c3493-d661-4a5a-a608-076f982c1737 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:29.339297 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c3493-d661-4a5a-a608-076f982c1737 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:29.355165 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-4e7c3493-d661-4a5a-a608-076f982c1737 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:29.355165 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:29.355165 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:29.355165 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:29.355165 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:29.355165 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:29.355165 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:29.355165 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:29.355165 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:29.355165 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:29.355165 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:29.355165 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:29.355165 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:29.355165 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:29.355165 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:29.358517 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:29.358517 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:29.358517 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:29.358517 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:29.358517 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:29.358517 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:29.358517 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:29.358517 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:29.358517 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:29.358517 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:29.358517 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:29.358517 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:29.358517 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:29.358517 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:29.358517 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:29.358517 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:29.358517 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:29.361604 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:29.361604 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:29.361604 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:29.361604 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:29.361604 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:29.361604 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:29.361604 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:29.361604 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:29.361604 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 296/605] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:42:29.364992 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad75fa-25e9-4470-9272-b19dbb3e8144 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:29.603596 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ef051-96f1-41a1-aca7-f986fbaec722 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:29.603830 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ef051-96f1-41a1-aca7-f986fbaec722 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:29.604039 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ef051-96f1-41a1-aca7-f986fbaec722 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:29.607179 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 297/606] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:29.607591 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad75fa-25e9-4470-9272-b19dbb3e8144 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:29.614166 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c86989-1dab-407f-8f07-5b3317e49f33 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:29.614533 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c86989-1dab-407f-8f07-5b3317e49f33 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:29.614786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c86989-1dab-407f-8f07-5b3317e49f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:29.636422 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:29.641003 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d7c86989-1dab-407f-8f07-5b3317e49f33 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:29.643056 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d7c86989-1dab-407f-8f07-5b3317e49f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:29.691306 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48580dc0-7eb4-4719-a2c9-7f0cdc74233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:29.692283 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48580dc0-7eb4-4719-a2c9-7f0cdc74233d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:29.692738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48580dc0-7eb4-4719-a2c9-7f0cdc74233d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:29.693217 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48580dc0-7eb4-4719-a2c9-7f0cdc74233d None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:29.694450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48580dc0-7eb4-4719-a2c9-7f0cdc74233d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:29.695728 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:29.695857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48580dc0-7eb4-4719-a2c9-7f0cdc74233d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:29.702021 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48580dc0-7eb4-4719-a2c9-7f0cdc74233d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:29.726914 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 310/607] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:42:29.738002 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48580dc0-7eb4-4719-a2c9-7f0cdc74233d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:29.777660 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 298/608] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:42:29.924732 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48580dc0-7eb4-4719-a2c9-7f0cdc74233d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:29.974275 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f90f1-6cac-497f-a659-24bdda27220d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:29.975105 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f90f1-6cac-497f-a659-24bdda27220d None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:29.975392 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f90f1-6cac-497f-a659-24bdda27220d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:29.975666 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f90f1-6cac-497f-a659-24bdda27220d None admin] PATH_INFO: `/v3/projects/7aec935005514f808eb735bfb01fee6e/users/5100db0c968c406fa89e117877604c50/roles/714239b608694824a75962d8cbb39f70` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:30.005291 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f90f1-6cac-497f-a659-24bdda27220d None admin] RBAC: Authorizing `identity:create_grant(project_id=7aec935005514f808eb735bfb01fee6e, user_id=5100db0c968c406fa89e117877604c50, role_id=714239b608694824a75962d8cbb39f70)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:30.006772 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f90f1-6cac-497f-a659-24bdda27220d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:30.033391 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 311/609] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:42:29 2022] PUT /identity/v3/projects/7aec935005514f808eb735bfb01fee6e/users/5100db0c968c406fa89e117877604c50/roles/714239b608694824a75962d8cbb39f70 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:42:30.188565 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c86989-1dab-407f-8f07-5b3317e49f33 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:30.350178 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c86989-1dab-407f-8f07-5b3317e49f33 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:30.399673 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3e6f4-7d32-4c8b-b090-07c1ecb9c102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:30.400720 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3e6f4-7d32-4c8b-b090-07c1ecb9c102 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:30.401287 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3e6f4-7d32-4c8b-b090-07c1ecb9c102 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:30.401761 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3e6f4-7d32-4c8b-b090-07c1ecb9c102 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:30.426045 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3e6f4-7d32-4c8b-b090-07c1ecb9c102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:30.431046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-07d3e6f4-7d32-4c8b-b090-07c1ecb9c102 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:30.431046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:30.431046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:30.431046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:30.431046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:30.431046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:30.431046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:30.431046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:30.431046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:30.431046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:30.431046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:30.431046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:30.431046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:30.431046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:30.431046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:30.431046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:30.432053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:30.432053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:30.432053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:30.432053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:30.432053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:30.432053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:30.432053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:30.432053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:30.432053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:30.432053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:30.432053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:30.432053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:30.432053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:30.432053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:30.432053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:30.432053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:30.432911 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:30.432911 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:30.432911 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:30.432911 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:30.432911 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:30.432911 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:30.432911 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:30.432911 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:30.432911 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:30.432911 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:30.432911 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:30.432911 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:30.432911 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 299/610] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:42:30.440137 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f90f1-6cac-497f-a659-24bdda27220d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:30.517507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:30.654947 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f90f1-6cac-497f-a659-24bdda27220d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:30.703363 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9b887-ab00-472f-ad0a-9e2ff40ce45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:30.704342 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9b887-ab00-472f-ad0a-9e2ff40ce45e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:30.704834 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9b887-ab00-472f-ad0a-9e2ff40ce45e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:30.705386 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9b887-ab00-472f-ad0a-9e2ff40ce45e None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:30.706293 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9b887-ab00-472f-ad0a-9e2ff40ce45e None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:30.706813 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9b887-ab00-472f-ad0a-9e2ff40ce45e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:30.708409 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9b887-ab00-472f-ad0a-9e2ff40ce45e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:30.721982 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 312/611] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:42:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:30.727497 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3e6f4-7d32-4c8b-b090-07c1ecb9c102 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:30.788565 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:30.947135 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3e6f4-7d32-4c8b-b090-07c1ecb9c102 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:31.037279 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ab34c-5111-4384-ab21-ea24d3e1bc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:31.037839 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ab34c-5111-4384-ab21-ea24d3e1bc55 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:31.038118 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ab34c-5111-4384-ab21-ea24d3e1bc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:31.038386 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ab34c-5111-4384-ab21-ea24d3e1bc55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:31.057704 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ab34c-5111-4384-ab21-ea24d3e1bc55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:31.060064 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ab34c-5111-4384-ab21-ea24d3e1bc55 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:31.088072 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-3b1ab34c-5111-4384-ab21-ea24d3e1bc55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:31.088072 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:31.088072 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:31.088072 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:31.088072 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:31.088072 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:31.088072 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:31.088072 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:31.088072 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:31.088072 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:31.088072 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:31.088072 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:31.088072 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:31.088072 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:31.088072 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:31.088072 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:31.089144 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:31.089144 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:31.089144 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:31.089144 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:31.089144 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:31.089144 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:31.089144 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:31.089144 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:31.089144 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:31.089144 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:31.089144 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:31.089144 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:31.089144 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:31.089144 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:31.089144 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:31.089144 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:31.089144 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:31.090602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:31.090602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:31.090602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:31.092081 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 300/612] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:42:31.099062 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9b887-ab00-472f-ad0a-9e2ff40ce45e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:31.118893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70197247-9ce1-434b-9c5f-95ccd5cdfb1c None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:31.119372 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70197247-9ce1-434b-9c5f-95ccd5cdfb1c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:31.119853 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70197247-9ce1-434b-9c5f-95ccd5cdfb1c None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:31.126976 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 301/613] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:31.129051 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f942eef-9ea5-4bd7-9ff8-d32a6f829d23 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:31.129341 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f942eef-9ea5-4bd7-9ff8-d32a6f829d23 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:31.129618 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f942eef-9ea5-4bd7-9ff8-d32a6f829d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:31.171054 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-2f942eef-9ea5-4bd7-9ff8-d32a6f829d23 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:31.172738 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2f942eef-9ea5-4bd7-9ff8-d32a6f829d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:31.254664 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:31.285337 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9b887-ab00-472f-ad0a-9e2ff40ce45e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:31.328585 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 302/614] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:42:31.358658 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c394b1-60de-4145-9263-2c877464d42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:31.359289 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c394b1-60de-4145-9263-2c877464d42b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:31.359571 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c394b1-60de-4145-9263-2c877464d42b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:31.359845 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c394b1-60de-4145-9263-2c877464d42b None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:31.360499 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c394b1-60de-4145-9263-2c877464d42b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:31.360805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c394b1-60de-4145-9263-2c877464d42b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:31.362224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c394b1-60de-4145-9263-2c877464d42b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:31.386437 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 313/615] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:42:31.392620 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f942eef-9ea5-4bd7-9ff8-d32a6f829d23 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:31.416980 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:31.572595 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f942eef-9ea5-4bd7-9ff8-d32a6f829d23 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:31.620314 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e6741-f1f0-4315-9a9b-4e1699d46764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:31.620963 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e6741-f1f0-4315-9a9b-4e1699d46764 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:31.621906 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e6741-f1f0-4315-9a9b-4e1699d46764 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:31.622193 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e6741-f1f0-4315-9a9b-4e1699d46764 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:31.625711 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c394b1-60de-4145-9263-2c877464d42b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:31.634165 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e6741-f1f0-4315-9a9b-4e1699d46764 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:31.634165 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e6741-f1f0-4315-9a9b-4e1699d46764 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:31.648357 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-623e6741-f1f0-4315-9a9b-4e1699d46764 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:42:31.648357 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:31.648357 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:31.648357 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:31.648357 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:31.648357 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:31.648357 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:31.648357 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:31.648357 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:31.648357 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:31.648357 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:31.648357 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:31.648357 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:31.648357 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:31.648357 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:31.648357 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:31.649452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:31.649452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:31.649452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:31.649452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:31.649452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:31.649452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:31.649452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:31.649452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:31.649452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:31.649452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:31.649452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:31.649452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:31.649452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:31.649452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:31.649452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:31.649452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:31.649452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:31.649452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:31.650419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:31.650419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:31.650419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:31.650419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:31.650419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:31.650419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:31.650419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:31.650419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:31.650419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:42:31.650419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:31.650419 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 303/616] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:42:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:31.657257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0af1f-a5da-4b72-8965-5e451d0a09ea None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:31.657257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0af1f-a5da-4b72-8965-5e451d0a09ea None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:31.657257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0af1f-a5da-4b72-8965-5e451d0a09ea None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:31.657257 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 304/617] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:31.657257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0af1f-a5da-4b72-8965-5e451d0a09ea None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:31.759991 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:31.761401 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c394b1-60de-4145-9263-2c877464d42b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:31.797949 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0af1f-a5da-4b72-8965-5e451d0a09ea None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:31.816522 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f8852-f13d-41bb-adee-2dfb5a693a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:31.817592 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f8852-f13d-41bb-adee-2dfb5a693a45 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:31.818084 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f8852-f13d-41bb-adee-2dfb5a693a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:31.818574 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f8852-f13d-41bb-adee-2dfb5a693a45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:31.835417 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f8852-f13d-41bb-adee-2dfb5a693a45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:31.844165 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d05f8852-f13d-41bb-adee-2dfb5a693a45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:31.844165 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:31.844165 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:31.844165 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:31.844165 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:31.844165 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:31.844165 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:31.844165 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:31.844165 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:31.844165 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:31.844165 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:31.844165 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:31.844165 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:31.844165 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:31.844165 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:31.844165 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:31.845486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:31.845486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:31.845486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:31.845486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:31.845486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:31.845486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:31.845486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:31.845486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:31.845486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:31.845486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:31.845486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:31.845486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:31.845486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:31.845486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:31.845486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:31.845486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:31.846936 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:31.846936 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:31.846936 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:31.846936 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:31.846936 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:31.846936 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:31.846936 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:31.846936 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:31.846936 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:31.846936 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:31.846936 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:31.846936 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:31.850900 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 314/618] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:31.852618 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2a037-30ae-44cf-b726-fae745d7429e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:31.853328 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2a037-30ae-44cf-b726-fae745d7429e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:31.853978 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2a037-30ae-44cf-b726-fae745d7429e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:31.868327 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:31.879056 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d87e1-3079-4d0f-89f3-c58a196f1112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:31.880106 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d87e1-3079-4d0f-89f3-c58a196f1112 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:31.880668 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d87e1-3079-4d0f-89f3-c58a196f1112 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:31.881317 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d87e1-3079-4d0f-89f3-c58a196f1112 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:31.882600 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d87e1-3079-4d0f-89f3-c58a196f1112 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:31.883526 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d87e1-3079-4d0f-89f3-c58a196f1112 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:31.886217 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d87e1-3079-4d0f-89f3-c58a196f1112 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:31.896081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8bd2a037-30ae-44cf-b726-fae745d7429e None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:31.897789 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8bd2a037-30ae-44cf-b726-fae745d7429e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:31.933022 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 305/619] 10.222.0.26 () {56 vars in 1135 bytes} [Sun Oct 2 00:42:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:31.933022 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d87e1-3079-4d0f-89f3-c58a196f1112 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:32.048385 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 315/620] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:32.049914 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2a037-30ae-44cf-b726-fae745d7429e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:32.186290 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d87e1-3079-4d0f-89f3-c58a196f1112 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:32.256356 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc7e94-cca4-4f43-9f15-54f0d3490aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:32.257499 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc7e94-cca4-4f43-9f15-54f0d3490aad None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:32.258626 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc7e94-cca4-4f43-9f15-54f0d3490aad None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:32.259508 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc7e94-cca4-4f43-9f15-54f0d3490aad None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:32.260805 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc7e94-cca4-4f43-9f15-54f0d3490aad None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:32.261973 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc7e94-cca4-4f43-9f15-54f0d3490aad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:32.264858 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc7e94-cca4-4f43-9f15-54f0d3490aad None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:32.267365 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2a037-30ae-44cf-b726-fae745d7429e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:32.284237 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 306/621] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:42:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:32.284591 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:32.292454 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc7e94-cca4-4f43-9f15-54f0d3490aad None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:32.403136 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd297fb0-3d6b-462f-a73c-f80bd36c47f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:32.403785 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd297fb0-3d6b-462f-a73c-f80bd36c47f7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:32.404064 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd297fb0-3d6b-462f-a73c-f80bd36c47f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:32.404346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd297fb0-3d6b-462f-a73c-f80bd36c47f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:32.414918 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:32.445993 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd297fb0-3d6b-462f-a73c-f80bd36c47f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:32.447371 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd297fb0-3d6b-462f-a73c-f80bd36c47f7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:32.495918 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-fd297fb0-3d6b-462f-a73c-f80bd36c47f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:32.495918 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:32.495918 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:32.495918 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:32.495918 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:32.495918 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:32.495918 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:32.495918 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:32.495918 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:32.495918 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:32.495918 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:32.495918 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:32.495918 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:32.495918 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:32.495918 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:32.495918 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:32.497901 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:32.497901 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:32.497901 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:32.497901 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:32.497901 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:32.497901 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:32.497901 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:32.497901 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:32.497901 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:32.497901 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:32.497901 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:32.497901 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:32.497901 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:32.497901 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:32.497901 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:32.497901 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:32.497901 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:32.499652 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:32.499652 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:32.499652 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:32.499652 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 316/622] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:32.499652 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0464b-2e9e-4c66-88c0-12146e231cd9 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:32.499652 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0464b-2e9e-4c66-88c0-12146e231cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:32.499652 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0464b-2e9e-4c66-88c0-12146e231cd9 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:32.505383 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 317/623] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:32.506791 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aefcd-8e7d-4740-aebb-e2225209f352 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:32.507094 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aefcd-8e7d-4740-aebb-e2225209f352 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:32.507335 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aefcd-8e7d-4740-aebb-e2225209f352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:32.529758 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-387aefcd-8e7d-4740-aebb-e2225209f352 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:32.531049 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-387aefcd-8e7d-4740-aebb-e2225209f352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:32.551198 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc7e94-cca4-4f43-9f15-54f0d3490aad None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:32.620753 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217850a-e36b-469c-a1e6-3192348165bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:32.622229 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217850a-e36b-469c-a1e6-3192348165bd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:32.622609 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217850a-e36b-469c-a1e6-3192348165bd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:32.623074 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217850a-e36b-469c-a1e6-3192348165bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:32.624890 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 318/624] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:32.626519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aefcd-8e7d-4740-aebb-e2225209f352 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:32.651274 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217850a-e36b-469c-a1e6-3192348165bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:32.655058 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217850a-e36b-469c-a1e6-3192348165bd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:32.677246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-1217850a-e36b-469c-a1e6-3192348165bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:32.677246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:32.677246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:32.677246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:32.677246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:32.677246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:32.677246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:32.677246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:32.677246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:32.677246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:32.677246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:32.677246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:32.677246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:32.677246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:32.677246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:32.677246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:32.678858 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:32.678858 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:32.678858 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:32.678858 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:32.678858 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:32.678858 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:32.678858 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:32.678858 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:32.678858 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:32.678858 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:32.678858 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:32.678858 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:32.678858 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:32.678858 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:32.678858 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:32.678858 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:32.678858 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:32.680647 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:32.680647 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:32.680647 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:32.688176 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 307/625] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:32.689391 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217850a-e36b-469c-a1e6-3192348165bd None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:32.768060 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:32.849511 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aefcd-8e7d-4740-aebb-e2225209f352 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:32.873638 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:32.876424 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217850a-e36b-469c-a1e6-3192348165bd None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:32.912620 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffb6f5-3c7f-4f55-b09b-33ec2291087d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:32.913870 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffb6f5-3c7f-4f55-b09b-33ec2291087d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:32.914417 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffb6f5-3c7f-4f55-b09b-33ec2291087d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:32.914635 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffb6f5-3c7f-4f55-b09b-33ec2291087d None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:32.915680 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffb6f5-3c7f-4f55-b09b-33ec2291087d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:32.916226 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffb6f5-3c7f-4f55-b09b-33ec2291087d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:32.918600 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffb6f5-3c7f-4f55-b09b-33ec2291087d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:32.938551 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698eb763-6a10-4836-ace1-62707b18adff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:32.939270 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eb763-6a10-4836-ace1-62707b18adff None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:32.940213 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eb763-6a10-4836-ace1-62707b18adff None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:32.940500 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eb763-6a10-4836-ace1-62707b18adff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:32.953597 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698eb763-6a10-4836-ace1-62707b18adff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:32.954281 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 319/626] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:32.955616 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffb6f5-3c7f-4f55-b09b-33ec2291087d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:32.960395 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-698eb763-6a10-4836-ace1-62707b18adff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:32.960395 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:32.960395 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:32.960395 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:32.960395 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:32.960395 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:32.960395 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:32.960395 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:32.960395 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:32.960395 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:32.960395 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:32.960395 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:32.960395 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:32.960395 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:32.960395 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:32.960395 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:32.962353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:32.962353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:32.962353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:32.962353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:32.962353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:32.962353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:32.962353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:32.962353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:32.962353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:32.962353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:32.962353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:32.962353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:32.962353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:32.962353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:32.962353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:32.962353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:32.963982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:32.963982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:32.963982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:32.963982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:32.963982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:32.963982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:32.963982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:32.963982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:32.963982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:32.963982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:32.963982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:32.963982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:32.963982 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 308/627] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:32.963982 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698eb763-6a10-4836-ace1-62707b18adff None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:33.086515 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698eb763-6a10-4836-ace1-62707b18adff None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:33.090195 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:33.097901 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffb6f5-3c7f-4f55-b09b-33ec2291087d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:33.135215 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42fb5f-ba10-4484-9edf-e3ea448c1977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:33.136055 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42fb5f-ba10-4484-9edf-e3ea448c1977 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:33.137082 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42fb5f-ba10-4484-9edf-e3ea448c1977 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:33.137520 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42fb5f-ba10-4484-9edf-e3ea448c1977 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:33.155528 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42fb5f-ba10-4484-9edf-e3ea448c1977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:33.159708 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe99aa-081f-4bf8-aaf0-2e05434d5a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:33.160493 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe99aa-081f-4bf8-aaf0-2e05434d5a3c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:33.160983 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe99aa-081f-4bf8-aaf0-2e05434d5a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:33.161367 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe99aa-081f-4bf8-aaf0-2e05434d5a3c None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:33.161830 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-4f42fb5f-ba10-4484-9edf-e3ea448c1977 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:33.161830 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:33.161830 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:33.161830 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:33.161830 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:33.161830 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:33.161830 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:33.161830 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:33.161830 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:33.161830 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:33.161830 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:33.161830 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:33.161830 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:33.161830 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:33.161830 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:33.161830 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:33.163605 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:33.163605 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:33.163605 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:33.163605 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:33.163605 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:33.163605 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:33.163605 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:33.163605 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:33.163605 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:33.163605 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:33.163605 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:33.163605 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:33.163605 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:33.163605 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:33.163605 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:33.163605 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:33.171226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:33.171226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:33.171226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:33.171226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:33.171226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:33.171226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:33.171226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:33.171226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:33.171226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:33.171226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:33.171226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:33.171226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:33.172425 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe99aa-081f-4bf8-aaf0-2e05434d5a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:33.172425 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe99aa-081f-4bf8-aaf0-2e05434d5a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:33.172425 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe99aa-081f-4bf8-aaf0-2e05434d5a3c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:33.172799 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 309/628] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:33.172799 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42fb5f-ba10-4484-9edf-e3ea448c1977 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:33.193367 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 320/629] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:33.194115 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe99aa-081f-4bf8-aaf0-2e05434d5a3c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:33.251095 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:33.332823 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42fb5f-ba10-4484-9edf-e3ea448c1977 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:33.354640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe99aa-081f-4bf8-aaf0-2e05434d5a3c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:33.390187 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bb065-2518-48e9-b508-755e4556e9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:33.391138 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bb065-2518-48e9-b508-755e4556e9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:33.391585 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bb065-2518-48e9-b508-755e4556e9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:33.392015 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bb065-2518-48e9-b508-755e4556e9e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:33.405555 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc19d0-579f-4dc6-9121-458d6fbdd9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:33.405555 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc19d0-579f-4dc6-9121-458d6fbdd9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:33.405952 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc19d0-579f-4dc6-9121-458d6fbdd9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:33.406277 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc19d0-579f-4dc6-9121-458d6fbdd9b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:33.407346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc19d0-579f-4dc6-9121-458d6fbdd9b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:33.407799 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bb065-2518-48e9-b508-755e4556e9e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:33.407965 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc19d0-579f-4dc6-9121-458d6fbdd9b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:33.410026 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc19d0-579f-4dc6-9121-458d6fbdd9b6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:33.410674 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bb065-2518-48e9-b508-755e4556e9e7 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:33.423194 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 321/630] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:42:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:33.424637 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc19d0-579f-4dc6-9121-458d6fbdd9b6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:33.425838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-3d6bb065-2518-48e9-b508-755e4556e9e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:33.425838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:33.425838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:33.425838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:33.425838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:33.425838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:33.425838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:33.425838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:33.425838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:33.425838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:33.425838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:33.425838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:33.425838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:33.425838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:33.425838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:33.427561 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:33.427561 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:33.427561 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:33.427561 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:33.427561 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:33.427561 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:33.427561 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:33.427561 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:33.427561 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:33.427561 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:33.427561 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:33.427561 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:33.427561 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:33.427561 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:33.427561 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:33.427561 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:33.427561 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:33.429384 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:33.429384 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:33.429384 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:33.429384 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:33.429384 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:33.429384 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:33.429384 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:33.429384 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:33.429384 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 310/631] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:33.429384 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bb065-2518-48e9-b508-755e4556e9e7 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:33.459826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:33.563496 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:33.569523 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc19d0-579f-4dc6-9121-458d6fbdd9b6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:33.578499 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bb065-2518-48e9-b508-755e4556e9e7 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:33.619308 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045cb94-adbc-413e-9ed5-2aa8518787ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:33.620045 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045cb94-adbc-413e-9ed5-2aa8518787ac None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:33.620432 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045cb94-adbc-413e-9ed5-2aa8518787ac None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:33.621479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045cb94-adbc-413e-9ed5-2aa8518787ac None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:33.622485 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045cb94-adbc-413e-9ed5-2aa8518787ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:33.622692 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d705fe-2bb2-40af-b820-e98a228d90fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:33.622892 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045cb94-adbc-413e-9ed5-2aa8518787ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:33.623339 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d705fe-2bb2-40af-b820-e98a228d90fc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:33.623619 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d705fe-2bb2-40af-b820-e98a228d90fc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:33.623893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d705fe-2bb2-40af-b820-e98a228d90fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:33.624561 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045cb94-adbc-413e-9ed5-2aa8518787ac None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:33.632501 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d705fe-2bb2-40af-b820-e98a228d90fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:33.634009 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d705fe-2bb2-40af-b820-e98a228d90fc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:33.635250 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 322/632] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:42:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:33.637603 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08271172-d0ca-4e07-828b-9830a9a24469 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:33.638083 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08271172-d0ca-4e07-828b-9830a9a24469 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:33.638809 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08271172-d0ca-4e07-828b-9830a9a24469 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:33.641278 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 323/633] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:33.642630 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08271172-d0ca-4e07-828b-9830a9a24469 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:33.656435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-64d705fe-2bb2-40af-b820-e98a228d90fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:42:33.656435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:33.656435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:33.656435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:33.656435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:33.656435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:33.656435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:33.656435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:33.656435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:33.656435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:33.656435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:33.656435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:33.656435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:33.656435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:33.656435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:33.656435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:33.658411 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:33.658411 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:33.658411 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:33.658411 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:33.658411 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:33.658411 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:33.658411 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:33.658411 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:33.658411 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:33.658411 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:33.658411 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:33.658411 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:33.658411 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:33.658411 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:33.658411 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:33.658411 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:33.658411 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:33.658411 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:33.660471 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:33.660471 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:33.660471 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:33.660471 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:33.660471 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:33.660471 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:33.660471 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:33.660471 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:33.660471 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:42:33.660471 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:33.660471 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 311/634] 10.222.0.26 () {56 vars in 1093 bytes} [Sun Oct 2 00:42:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:33.660471 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d705fe-2bb2-40af-b820-e98a228d90fc None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:33.784352 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:33.803075 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08271172-d0ca-4e07-828b-9830a9a24469 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:33.811021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d705fe-2bb2-40af-b820-e98a228d90fc None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:33.857209 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1647541-6c28-456b-8bf5-a75277ec3de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:33.858185 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1647541-6c28-456b-8bf5-a75277ec3de0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:33.858630 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1647541-6c28-456b-8bf5-a75277ec3de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:33.859046 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1647541-6c28-456b-8bf5-a75277ec3de0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:33.867679 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c23b9-6e59-4e53-8eee-37c40d3cdda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:33.868677 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c23b9-6e59-4e53-8eee-37c40d3cdda4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:33.869181 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c23b9-6e59-4e53-8eee-37c40d3cdda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:33.869670 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c23b9-6e59-4e53-8eee-37c40d3cdda4 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:33.870801 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c23b9-6e59-4e53-8eee-37c40d3cdda4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:33.871157 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c23b9-6e59-4e53-8eee-37c40d3cdda4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:33.873701 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c23b9-6e59-4e53-8eee-37c40d3cdda4 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:33.877479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1647541-6c28-456b-8bf5-a75277ec3de0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:33.879858 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1647541-6c28-456b-8bf5-a75277ec3de0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:33.894646 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 312/635] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:33.895885 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c23b9-6e59-4e53-8eee-37c40d3cdda4 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:33.907328 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-b1647541-6c28-456b-8bf5-a75277ec3de0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:33.907328 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:33.907328 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:33.907328 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:33.907328 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:33.907328 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:33.907328 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:33.907328 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:33.907328 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:33.907328 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:33.907328 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:33.907328 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:33.907328 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:33.907328 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:33.907328 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:33.907328 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:33.909532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:33.909532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:33.909532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:33.909532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:33.909532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:33.909532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:33.909532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:33.909532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:33.909532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:33.909532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:33.909532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:33.909532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:33.909532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:33.909532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:33.909532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:33.909532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:33.909532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:33.911274 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:33.911274 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:33.911274 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:33.911274 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 324/636] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:33.911730 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9e47b-8594-4518-a1ff-1fd650f5fbc7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:33.911988 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9e47b-8594-4518-a1ff-1fd650f5fbc7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:33.912410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9e47b-8594-4518-a1ff-1fd650f5fbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:33.932784 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-fda9e47b-8594-4518-a1ff-1fd650f5fbc7 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:33.934124 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fda9e47b-8594-4518-a1ff-1fd650f5fbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:33.942607 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:34.027903 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 325/637] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:34.029175 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9e47b-8594-4518-a1ff-1fd650f5fbc7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:34.057947 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c23b9-6e59-4e53-8eee-37c40d3cdda4 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:34.125279 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760db9c-3c02-4b28-b06a-2134419a5f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:34.126224 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760db9c-3c02-4b28-b06a-2134419a5f29 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:34.126690 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760db9c-3c02-4b28-b06a-2134419a5f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:34.127306 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760db9c-3c02-4b28-b06a-2134419a5f29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:34.145286 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760db9c-3c02-4b28-b06a-2134419a5f29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:34.147011 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760db9c-3c02-4b28-b06a-2134419a5f29 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:34.151147 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:34.166046 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9e47b-8594-4518-a1ff-1fd650f5fbc7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:34.169331 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-5760db9c-3c02-4b28-b06a-2134419a5f29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:34.169331 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:34.169331 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:34.169331 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:34.169331 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:34.169331 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:34.169331 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:34.169331 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:34.169331 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:34.169331 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:34.169331 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:34.169331 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:34.169331 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:34.169331 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:34.169331 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:34.169331 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:34.171175 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:34.171175 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:34.171175 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:34.171175 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:34.171175 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:34.171175 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:34.171175 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:34.171175 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:34.171175 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:34.171175 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:34.171175 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:34.171175 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:34.171175 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:34.171175 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:34.171175 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:34.171175 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:34.171175 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:34.172922 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:34.172922 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:34.172922 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:34.174362 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 313/638] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:34.174592 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760db9c-3c02-4b28-b06a-2134419a5f29 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:34.238486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950b1b7-82d5-42f1-8335-29c6f8c35dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:34.239511 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950b1b7-82d5-42f1-8335-29c6f8c35dce None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:34.239994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950b1b7-82d5-42f1-8335-29c6f8c35dce None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:34.240476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950b1b7-82d5-42f1-8335-29c6f8c35dce None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:34.241895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950b1b7-82d5-42f1-8335-29c6f8c35dce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:34.242447 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950b1b7-82d5-42f1-8335-29c6f8c35dce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:34.245234 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950b1b7-82d5-42f1-8335-29c6f8c35dce None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:34.273642 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:34.283155 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 326/639] 10.222.0.26 () {56 vars in 1133 bytes} [Sun Oct 2 00:42:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:34.284762 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950b1b7-82d5-42f1-8335-29c6f8c35dce None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:34.316960 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760db9c-3c02-4b28-b06a-2134419a5f29 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:34.361580 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a760953-ef46-4e44-bdab-c34f7e57957f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:34.362397 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a760953-ef46-4e44-bdab-c34f7e57957f None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:34.362788 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a760953-ef46-4e44-bdab-c34f7e57957f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:34.363194 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a760953-ef46-4e44-bdab-c34f7e57957f None admin] PATH_INFO: `/v3/projects/7aec935005514f808eb735bfb01fee6e/users/2784579d2ddf4cc99fe0e1d109e5cdda/roles/714239b608694824a75962d8cbb39f70` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:34.385558 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a760953-ef46-4e44-bdab-c34f7e57957f None admin] RBAC: Authorizing `identity:create_grant(project_id=7aec935005514f808eb735bfb01fee6e, user_id=2784579d2ddf4cc99fe0e1d109e5cdda, role_id=714239b608694824a75962d8cbb39f70)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:34.387171 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a760953-ef46-4e44-bdab-c34f7e57957f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:34.404804 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 314/640] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:42:34 2022] PUT /identity/v3/projects/7aec935005514f808eb735bfb01fee6e/users/2784579d2ddf4cc99fe0e1d109e5cdda/roles/714239b608694824a75962d8cbb39f70 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:42:34.405928 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a760953-ef46-4e44-bdab-c34f7e57957f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:34.454229 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950b1b7-82d5-42f1-8335-29c6f8c35dce None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:34.483607 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:34.495435 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89f86e-cb27-47d7-b7e4-6b3f549aa2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:34.496179 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89f86e-cb27-47d7-b7e4-6b3f549aa2dc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:34.496458 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89f86e-cb27-47d7-b7e4-6b3f549aa2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:34.496872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89f86e-cb27-47d7-b7e4-6b3f549aa2dc None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:34.497586 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89f86e-cb27-47d7-b7e4-6b3f549aa2dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:34.498749 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89f86e-cb27-47d7-b7e4-6b3f549aa2dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:34.500038 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89f86e-cb27-47d7-b7e4-6b3f549aa2dc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:34.521586 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 327/641] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:34.521586 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89f86e-cb27-47d7-b7e4-6b3f549aa2dc None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:34.602179 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a760953-ef46-4e44-bdab-c34f7e57957f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:34.606892 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:34.647968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c390be8-7216-4e30-b406-ef718d7aac24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:34.648697 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c390be8-7216-4e30-b406-ef718d7aac24 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:34.649094 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c390be8-7216-4e30-b406-ef718d7aac24 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:34.649431 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c390be8-7216-4e30-b406-ef718d7aac24 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:34.650195 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c390be8-7216-4e30-b406-ef718d7aac24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:34.650557 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c390be8-7216-4e30-b406-ef718d7aac24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:34.652500 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c390be8-7216-4e30-b406-ef718d7aac24 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:34.665571 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 315/642] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:34.666286 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c390be8-7216-4e30-b406-ef718d7aac24 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:34.690306 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89f86e-cb27-47d7-b7e4-6b3f549aa2dc None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:34.739164 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a3278-47b4-4700-9f6f-1cbd6abd3a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:34.739951 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a3278-47b4-4700-9f6f-1cbd6abd3a30 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:34.740337 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a3278-47b4-4700-9f6f-1cbd6abd3a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:34.740735 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a3278-47b4-4700-9f6f-1cbd6abd3a30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:34.848979 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a3278-47b4-4700-9f6f-1cbd6abd3a30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:34.851629 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a3278-47b4-4700-9f6f-1cbd6abd3a30 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:34.858030 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c390be8-7216-4e30-b406-ef718d7aac24 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:34.873160 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:34.923062 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da35da-65d8-4fb2-b6d7-6774e2d0fdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:34.923686 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da35da-65d8-4fb2-b6d7-6774e2d0fdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:34.923975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da35da-65d8-4fb2-b6d7-6774e2d0fdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:34.924303 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da35da-65d8-4fb2-b6d7-6774e2d0fdd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:34.942119 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da35da-65d8-4fb2-b6d7-6774e2d0fdd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:34.950159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-b5da35da-65d8-4fb2-b6d7-6774e2d0fdd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:34.950159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:34.950159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:34.950159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:34.950159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:34.950159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:34.950159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:34.950159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:34.950159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:34.950159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:34.950159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:34.950159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:34.950159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:34.950159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:34.950159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:34.950159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:34.952109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:34.952109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:34.952109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:34.952109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:34.952109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:34.952109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:34.952109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:34.952109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:34.952109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:34.952109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:34.952109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:34.952109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:34.952109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:34.952109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:34.952109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:34.952109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:34.954543 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:34.954543 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:34.954543 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:34.954543 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:34.954543 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:34.954543 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:34.954543 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:34.954543 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:34.954543 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:34.954543 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:34.954543 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:34.954543 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:34.954543 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 316/643] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:34.954543 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da35da-65d8-4fb2-b6d7-6774e2d0fdd2 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:34.965268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:35.047589 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 328/644] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:42:35.055019 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a3278-47b4-4700-9f6f-1cbd6abd3a30 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:35.110399 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da35da-65d8-4fb2-b6d7-6774e2d0fdd2 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:35.153632 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668fdda-9394-42bb-aca0-7aaaba4f4dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:35.154270 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668fdda-9394-42bb-aca0-7aaaba4f4dea None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:35.154547 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668fdda-9394-42bb-aca0-7aaaba4f4dea None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:35.154821 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668fdda-9394-42bb-aca0-7aaaba4f4dea None admin] PATH_INFO: `/v3/users/glance` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:35.163290 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668fdda-9394-42bb-aca0-7aaaba4f4dea None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:35.164838 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668fdda-9394-42bb-aca0-7aaaba4f4dea None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:35.178290 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-0668fdda-9394-42bb-aca0-7aaaba4f4dea None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 02 00:42:35.178290 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:35.178290 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:35.178290 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:35.178290 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:35.178290 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:35.178290 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:35.178290 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:35.178290 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:35.178290 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:35.178290 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:35.178290 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:35.178290 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:35.178290 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:35.178290 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:35.178290 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:35.180589 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:35.180589 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:35.180589 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:35.180589 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:35.180589 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:35.180589 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:35.180589 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:35.180589 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:35.180589 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:35.180589 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:35.180589 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:35.180589 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:35.180589 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:35.180589 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:35.180589 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:35.180589 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:35.180589 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:35.180589 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:35.183141 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:35.183141 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:35.183141 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:35.183141 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:35.183141 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:35.183141 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:35.183141 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:35.183141 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:35.183141 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 02 00:42:35.183141 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:35.183141 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 317/645] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:42:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:35.183141 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668fdda-9394-42bb-aca0-7aaaba4f4dea None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:35.216429 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:35.272386 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a3278-47b4-4700-9f6f-1cbd6abd3a30 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:35.316207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668fdda-9394-42bb-aca0-7aaaba4f4dea None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:35.351050 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9371ffd-a358-47e8-b7a4-4645c27d5938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:35.352140 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9371ffd-a358-47e8-b7a4-4645c27d5938 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:35.352625 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9371ffd-a358-47e8-b7a4-4645c27d5938 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:35.353293 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9371ffd-a358-47e8-b7a4-4645c27d5938 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:35.363386 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf15172-bfe7-4da1-a951-4dc56f4167b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:35.364009 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf15172-bfe7-4da1-a951-4dc56f4167b2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:35.364290 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf15172-bfe7-4da1-a951-4dc56f4167b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:35.364565 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf15172-bfe7-4da1-a951-4dc56f4167b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:35.365272 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf15172-bfe7-4da1-a951-4dc56f4167b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:35.365585 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf15172-bfe7-4da1-a951-4dc56f4167b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:35.366986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf15172-bfe7-4da1-a951-4dc56f4167b2 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:35.367989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9371ffd-a358-47e8-b7a4-4645c27d5938 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:35.370944 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9371ffd-a358-47e8-b7a4-4645c27d5938 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:35.376991 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 318/646] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:42:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:35.377761 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf15172-bfe7-4da1-a951-4dc56f4167b2 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:35.404382 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-b9371ffd-a358-47e8-b7a4-4645c27d5938 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 02 00:42:35.404382 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:35.404382 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:35.404382 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:35.404382 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:35.404382 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:35.404382 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:35.404382 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:35.404382 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:35.404382 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:35.404382 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:35.404382 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:35.404382 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:35.404382 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:35.404382 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:35.404382 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:35.406243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:35.406243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:35.406243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:35.406243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:35.406243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:35.406243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:35.406243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:35.406243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:35.406243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:35.406243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:35.406243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:35.406243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:35.406243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:35.406243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:35.406243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:35.406243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:35.406243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:35.406243 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:35.408879 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:35.408879 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:35.408879 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:35.408879 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:35.408879 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:35.408879 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:35.408879 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:35.408879 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:35.408879 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 02 00:42:35.408879 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:35.414342 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 329/647] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:42:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:35.415895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9371ffd-a358-47e8-b7a4-4645c27d5938 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:35.462157 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:35.506304 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:35.533094 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf15172-bfe7-4da1-a951-4dc56f4167b2 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:35.574111 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc3ce0-0cea-490a-8f9b-86536c6c093f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:35.574759 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc3ce0-0cea-490a-8f9b-86536c6c093f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:35.575040 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc3ce0-0cea-490a-8f9b-86536c6c093f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:35.575318 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc3ce0-0cea-490a-8f9b-86536c6c093f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:35.588183 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc3ce0-0cea-490a-8f9b-86536c6c093f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:35.590366 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc3ce0-0cea-490a-8f9b-86536c6c093f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:35.608612 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-f3bc3ce0-0cea-490a-8f9b-86536c6c093f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:35.608612 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:35.608612 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:35.608612 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:35.608612 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:35.608612 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:35.608612 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:35.608612 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:35.608612 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:35.608612 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:35.608612 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:35.608612 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:35.608612 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:35.608612 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:35.608612 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:35.608612 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:35.611246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:35.611246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:35.611246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:35.611246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:35.611246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:35.611246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:35.611246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:35.611246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:35.611246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:35.611246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:35.611246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:35.611246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:35.611246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:35.611246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:35.611246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:35.611246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:35.611246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:35.614173 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:35.614173 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:35.614173 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:35.614708 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9371ffd-a358-47e8-b7a4-4645c27d5938 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:35.617160 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 319/648] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:35.618633 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc3ce0-0cea-490a-8f9b-86536c6c093f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:35.686758 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a191ab3-72b7-4f7a-995e-00483d82cf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:35.687828 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a191ab3-72b7-4f7a-995e-00483d82cf39 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:35.688330 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a191ab3-72b7-4f7a-995e-00483d82cf39 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:35.688826 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a191ab3-72b7-4f7a-995e-00483d82cf39 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:35.691131 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a191ab3-72b7-4f7a-995e-00483d82cf39 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:35.692165 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a191ab3-72b7-4f7a-995e-00483d82cf39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:35.694957 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a191ab3-72b7-4f7a-995e-00483d82cf39 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:35.736869 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 330/649] 10.222.0.26 () {56 vars in 1137 bytes} [Sun Oct 2 00:42:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:35.736869 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a191ab3-72b7-4f7a-995e-00483d82cf39 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:35.756529 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc3ce0-0cea-490a-8f9b-86536c6c093f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:35.797256 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31513370-8290-4195-b555-7b9f48480e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:35.797908 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31513370-8290-4195-b555-7b9f48480e1b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:35.798258 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31513370-8290-4195-b555-7b9f48480e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:35.798613 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31513370-8290-4195-b555-7b9f48480e1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:35.809375 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:35.812118 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31513370-8290-4195-b555-7b9f48480e1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:35.814516 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31513370-8290-4195-b555-7b9f48480e1b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:35.833676 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-31513370-8290-4195-b555-7b9f48480e1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:35.833676 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:35.833676 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:35.833676 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:35.833676 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:35.833676 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:35.833676 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:35.833676 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:35.833676 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:35.833676 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:35.833676 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:35.833676 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:35.833676 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:35.833676 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:35.833676 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:35.833676 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:35.835603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:35.835603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:35.835603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:35.835603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:35.835603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:35.835603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:35.835603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:35.835603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:35.835603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:35.835603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:35.835603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:35.835603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:35.835603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:35.835603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:35.835603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:35.835603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:35.835603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:35.837433 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:35.837433 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:35.837433 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:35.837433 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 320/650] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:35.837433 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31513370-8290-4195-b555-7b9f48480e1b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:35.857534 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:35.887990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a191ab3-72b7-4f7a-995e-00483d82cf39 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:35.945106 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36386a54-3662-48d0-885b-5f3b7f15187c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:35.946420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36386a54-3662-48d0-885b-5f3b7f15187c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:35.946999 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36386a54-3662-48d0-885b-5f3b7f15187c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:35.947303 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36386a54-3662-48d0-885b-5f3b7f15187c None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:35.948661 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36386a54-3662-48d0-885b-5f3b7f15187c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:35.949306 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36386a54-3662-48d0-885b-5f3b7f15187c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:35.952102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36386a54-3662-48d0-885b-5f3b7f15187c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:35.967415 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31513370-8290-4195-b555-7b9f48480e1b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:35.983021 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 331/651] 10.222.0.26 () {56 vars in 1137 bytes} [Sun Oct 2 00:42:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:35.983021 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36386a54-3662-48d0-885b-5f3b7f15187c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:36.019861 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac5629-96fc-44e4-b6cf-c8c1b5161084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:36.020399 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac5629-96fc-44e4-b6cf-c8c1b5161084 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:36.020989 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac5629-96fc-44e4-b6cf-c8c1b5161084 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:36.021190 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac5629-96fc-44e4-b6cf-c8c1b5161084 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:36.021828 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac5629-96fc-44e4-b6cf-c8c1b5161084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:36.022129 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac5629-96fc-44e4-b6cf-c8c1b5161084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:36.023528 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac5629-96fc-44e4-b6cf-c8c1b5161084 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:36.042067 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 321/652] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:36.042067 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac5629-96fc-44e4-b6cf-c8c1b5161084 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:36.123746 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36386a54-3662-48d0-885b-5f3b7f15187c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:36.130174 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:36.174798 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364aa89-fff3-47f1-ac8e-b22edddc56ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:36.175839 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364aa89-fff3-47f1-ac8e-b22edddc56ed None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:36.176345 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364aa89-fff3-47f1-ac8e-b22edddc56ed None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:36.176833 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364aa89-fff3-47f1-ac8e-b22edddc56ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:36.184300 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:36.203643 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac5629-96fc-44e4-b6cf-c8c1b5161084 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:36.250639 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37063960-6698-4794-9203-4c537c386927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:36.251272 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37063960-6698-4794-9203-4c537c386927 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:36.251606 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37063960-6698-4794-9203-4c537c386927 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:36.251892 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37063960-6698-4794-9203-4c537c386927 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:36.252574 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37063960-6698-4794-9203-4c537c386927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:36.252920 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37063960-6698-4794-9203-4c537c386927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:36.254418 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37063960-6698-4794-9203-4c537c386927 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:36.268873 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 322/653] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:36.269814 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37063960-6698-4794-9203-4c537c386927 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:36.287684 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364aa89-fff3-47f1-ac8e-b22edddc56ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:36.293138 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364aa89-fff3-47f1-ac8e-b22edddc56ed None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:36.436377 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37063960-6698-4794-9203-4c537c386927 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:36.465033 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:36.474581 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 332/654] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:42:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:42:36.474581 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364aa89-fff3-47f1-ac8e-b22edddc56ed None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:36.513115 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ece42-bcb9-4924-9cdc-679785cb7fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:36.514417 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ece42-bcb9-4924-9cdc-679785cb7fdd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:36.514417 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ece42-bcb9-4924-9cdc-679785cb7fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:36.514938 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ece42-bcb9-4924-9cdc-679785cb7fdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:36.541137 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:36.642997 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ece42-bcb9-4924-9cdc-679785cb7fdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:36.646025 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ece42-bcb9-4924-9cdc-679785cb7fdd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:36.656061 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364aa89-fff3-47f1-ac8e-b22edddc56ed None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:36.709531 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145ccf0-f67f-4ea8-90aa-db172dee6ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:36.710614 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145ccf0-f67f-4ea8-90aa-db172dee6ffd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:36.711099 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145ccf0-f67f-4ea8-90aa-db172dee6ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:36.711591 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145ccf0-f67f-4ea8-90aa-db172dee6ffd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:36.724351 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145ccf0-f67f-4ea8-90aa-db172dee6ffd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:36.727165 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145ccf0-f67f-4ea8-90aa-db172dee6ffd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:36.750479 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0145ccf0-f67f-4ea8-90aa-db172dee6ffd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:36.750479 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:36.750479 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:36.750479 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:36.750479 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:36.750479 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:36.750479 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:36.750479 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:36.750479 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:36.750479 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:36.750479 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:36.750479 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:36.750479 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:36.750479 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:36.750479 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:36.751659 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:36.751659 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:36.751659 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:36.751659 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:36.751659 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:36.751659 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:36.751659 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:36.751659 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:36.751659 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:36.751659 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:36.751659 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:36.751659 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:36.751659 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:36.751659 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:36.751659 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:36.751659 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:36.751659 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:36.752810 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:36.752810 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:36.752810 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:36.752810 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:36.752810 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:36.752810 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:36.752810 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:36.752810 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:36.752810 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 333/655] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:36.754272 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145ccf0-f67f-4ea8-90aa-db172dee6ffd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:36.793697 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 323/656] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:42:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:42:36.794670 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ece42-bcb9-4924-9cdc-679785cb7fdd None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:36.810558 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:36.906589 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ece42-bcb9-4924-9cdc-679785cb7fdd None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:36.924704 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:36.935451 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145ccf0-f67f-4ea8-90aa-db172dee6ffd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:36.943708 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffeac1c-1dc5-46a5-841b-dd01957f4e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:36.944345 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeac1c-1dc5-46a5-841b-dd01957f4e75 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:36.944620 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeac1c-1dc5-46a5-841b-dd01957f4e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:36.944884 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeac1c-1dc5-46a5-841b-dd01957f4e75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:36.957633 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffeac1c-1dc5-46a5-841b-dd01957f4e75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:36.959124 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffeac1c-1dc5-46a5-841b-dd01957f4e75 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:36.978114 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba1009-4e2a-4527-b2f1-e6c05d3b3d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:36.978751 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba1009-4e2a-4527-b2f1-e6c05d3b3d5b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:36.979030 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba1009-4e2a-4527-b2f1-e6c05d3b3d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:36.979299 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba1009-4e2a-4527-b2f1-e6c05d3b3d5b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:36.987061 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-cffeac1c-1dc5-46a5-841b-dd01957f4e75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:36.987061 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:36.987061 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:36.987061 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:36.987061 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:36.987061 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:36.987061 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:36.987061 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:36.987061 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:36.987061 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:36.987061 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:36.987061 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:36.987061 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:36.987061 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:36.987061 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:36.987061 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:36.988999 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:36.988999 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:36.988999 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:36.988999 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:36.988999 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:36.988999 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:36.988999 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:36.988999 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:36.988999 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:36.988999 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:36.988999 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:36.988999 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:36.988999 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:36.988999 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:36.988999 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:36.988999 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:36.988999 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:36.991957 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:36.991957 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:36.991957 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:36.992543 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba1009-4e2a-4527-b2f1-e6c05d3b3d5b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:36.992714 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 324/657] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:36.992714 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffeac1c-1dc5-46a5-841b-dd01957f4e75 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:36.993046 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba1009-4e2a-4527-b2f1-e6c05d3b3d5b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:37.006101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-44ba1009-4e2a-4527-b2f1-e6c05d3b3d5b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 02 00:42:37.006101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:37.006101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:37.006101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:37.006101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:37.006101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:37.006101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:37.006101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:37.006101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:37.006101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:37.006101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:37.006101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:37.006101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:37.006101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:37.006101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:37.006101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:37.007775 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:37.007775 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:37.007775 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:37.007775 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:37.007775 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:37.007775 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:37.007775 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:37.007775 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:37.007775 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:37.007775 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:37.007775 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:37.007775 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:37.007775 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:37.007775 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:37.007775 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:37.007775 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:37.007775 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:37.007775 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:37.009172 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:37.009172 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:37.009172 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:37.009172 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:37.009172 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:37.009172 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:37.009172 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:37.009172 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:37.009172 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 02 00:42:37.009172 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:37.009172 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 334/658] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:37.009172 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132434fd-6ebc-4a34-a5a8-20f640ad84bb None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:37.010231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132434fd-6ebc-4a34-a5a8-20f640ad84bb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:37.010231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132434fd-6ebc-4a34-a5a8-20f640ad84bb None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:37.010730 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 335/659] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:37.012420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132434fd-6ebc-4a34-a5a8-20f640ad84bb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:37.082831 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:37.132150 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132434fd-6ebc-4a34-a5a8-20f640ad84bb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:37.145361 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffeac1c-1dc5-46a5-841b-dd01957f4e75 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:37.175570 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcca77a-67d0-4f57-b4fa-245fd851ed27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:37.176539 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcca77a-67d0-4f57-b4fa-245fd851ed27 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:37.176930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcca77a-67d0-4f57-b4fa-245fd851ed27 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:37.177443 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcca77a-67d0-4f57-b4fa-245fd851ed27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:37.188223 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32429bb-baae-40b9-8191-95ca850622f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:37.188841 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32429bb-baae-40b9-8191-95ca850622f3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:37.189152 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32429bb-baae-40b9-8191-95ca850622f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:37.189416 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32429bb-baae-40b9-8191-95ca850622f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:37.190105 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32429bb-baae-40b9-8191-95ca850622f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:37.190404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32429bb-baae-40b9-8191-95ca850622f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:37.190797 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcca77a-67d0-4f57-b4fa-245fd851ed27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:37.191846 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32429bb-baae-40b9-8191-95ca850622f3 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:37.192426 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcca77a-67d0-4f57-b4fa-245fd851ed27 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:37.204792 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 325/660] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:37.205685 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32429bb-baae-40b9-8191-95ca850622f3 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:37.219571 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ebcca77a-67d0-4f57-b4fa-245fd851ed27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:37.219571 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:37.219571 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:37.219571 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:37.219571 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:37.219571 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:37.219571 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:37.219571 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:37.219571 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:37.219571 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:37.219571 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:37.219571 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:37.219571 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:37.219571 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:37.219571 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:37.219571 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:37.220639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:37.220639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:37.220639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:37.220639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:37.220639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:37.220639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:37.220639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:37.220639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:37.220639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:37.220639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:37.220639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:37.220639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:37.220639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:37.220639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:37.220639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:37.220639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:37.220639 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:37.221665 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:37.221665 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:37.221665 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:37.221665 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 336/661] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:37.221665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcca77a-67d0-4f57-b4fa-245fd851ed27 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:37.238378 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:37.341000 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32429bb-baae-40b9-8191-95ca850622f3 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:37.359645 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcca77a-67d0-4f57-b4fa-245fd851ed27 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:37.367929 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:37.381371 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafe127-3559-4ae0-b423-22d53270b8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:37.382226 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafe127-3559-4ae0-b423-22d53270b8bd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:37.382638 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafe127-3559-4ae0-b423-22d53270b8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:37.383044 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafe127-3559-4ae0-b423-22d53270b8bd None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:37.383823 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafe127-3559-4ae0-b423-22d53270b8bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:37.384250 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafe127-3559-4ae0-b423-22d53270b8bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:37.385872 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafe127-3559-4ae0-b423-22d53270b8bd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:37.398989 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 326/662] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:37.400272 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a00ad-469a-47dd-a082-1dee8093358f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:37.400559 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a00ad-469a-47dd-a082-1dee8093358f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:37.400859 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a00ad-469a-47dd-a082-1dee8093358f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:37.401492 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba361933-a563-4965-a320-c2da5068be25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:37.402743 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba361933-a563-4965-a320-c2da5068be25 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:37.403225 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba361933-a563-4965-a320-c2da5068be25 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:37.403718 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba361933-a563-4965-a320-c2da5068be25 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:37.406087 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba361933-a563-4965-a320-c2da5068be25 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:37.406087 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba361933-a563-4965-a320-c2da5068be25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:37.408921 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba361933-a563-4965-a320-c2da5068be25 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:37.428862 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-312a00ad-469a-47dd-a082-1dee8093358f None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:37.430152 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-312a00ad-469a-47dd-a082-1dee8093358f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:37.434251 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 337/663] 10.222.0.26 () {56 vars in 1139 bytes} [Sun Oct 2 00:42:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:37.435274 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba361933-a563-4965-a320-c2da5068be25 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:37.505726 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 327/664] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:37.507013 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a00ad-469a-47dd-a082-1dee8093358f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:37.519994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:37.570151 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba361933-a563-4965-a320-c2da5068be25 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:37.618535 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf4a3b-d1db-42b9-ba05-324fcefbae55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:37.619046 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf4a3b-d1db-42b9-ba05-324fcefbae55 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:37.619325 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf4a3b-d1db-42b9-ba05-324fcefbae55 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:37.619600 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf4a3b-d1db-42b9-ba05-324fcefbae55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:37.620329 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf4a3b-d1db-42b9-ba05-324fcefbae55 None admin] RBAC: Adding query filter params (role.id=714239b608694824a75962d8cbb39f70, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=81e0396b7ba341ce8d02b1a149786d95) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:37.620708 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf4a3b-d1db-42b9-ba05-324fcefbae55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:37.622198 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf4a3b-d1db-42b9-ba05-324fcefbae55 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:37.633129 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 338/665] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:42:37 2022] GET /identity/v3/role_assignments?user.id=81e0396b7ba341ce8d02b1a149786d95&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=714239b608694824a75962d8cbb39f70 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:37.634080 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf4a3b-d1db-42b9-ba05-324fcefbae55 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:37.733308 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a00ad-469a-47dd-a082-1dee8093358f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:37.760203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:37.793330 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf4a3b-d1db-42b9-ba05-324fcefbae55 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:37.801200 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338a0b6-3b2a-40d5-b7bc-859ab4e61e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:37.801824 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338a0b6-3b2a-40d5-b7bc-859ab4e61e4d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:37.802102 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338a0b6-3b2a-40d5-b7bc-859ab4e61e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:37.802375 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338a0b6-3b2a-40d5-b7bc-859ab4e61e4d None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:37.803040 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338a0b6-3b2a-40d5-b7bc-859ab4e61e4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:37.803343 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338a0b6-3b2a-40d5-b7bc-859ab4e61e4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:37.804804 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338a0b6-3b2a-40d5-b7bc-859ab4e61e4d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:37.822682 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 328/666] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:37.823910 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338a0b6-3b2a-40d5-b7bc-859ab4e61e4d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:37.847817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:37.855705 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba3f79-44a3-42a8-a502-9086ad591da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:37.856343 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba3f79-44a3-42a8-a502-9086ad591da1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:37.856615 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba3f79-44a3-42a8-a502-9086ad591da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:37.856882 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba3f79-44a3-42a8-a502-9086ad591da1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:37.866149 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba3f79-44a3-42a8-a502-9086ad591da1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:37.867616 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba3f79-44a3-42a8-a502-9086ad591da1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:37.880657 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-aaba3f79-44a3-42a8-a502-9086ad591da1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:37.880657 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:37.880657 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:37.880657 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:37.880657 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:37.880657 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:37.880657 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:37.880657 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:37.880657 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:37.880657 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:37.880657 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:37.880657 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:37.880657 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:37.880657 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:37.880657 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:37.881836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:37.881836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:37.881836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:37.881836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:37.881836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:37.881836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:37.881836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:37.881836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:37.881836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:37.881836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:37.881836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:37.881836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:37.881836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:37.881836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:37.881836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:37.881836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:37.881836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:37.882925 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:37.882925 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:37.882925 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:37.882925 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:37.882925 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:37.882925 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:37.882925 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:37.882925 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:37.882925 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 339/667] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:37.882925 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba3f79-44a3-42a8-a502-9086ad591da1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:37.998838 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338a0b6-3b2a-40d5-b7bc-859ab4e61e4d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:38.020400 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba3f79-44a3-42a8-a502-9086ad591da1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:38.038082 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585c24d-fa40-441b-b552-ed030fbf38e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:38.038710 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585c24d-fa40-441b-b552-ed030fbf38e3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:38.038994 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585c24d-fa40-441b-b552-ed030fbf38e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:38.039269 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585c24d-fa40-441b-b552-ed030fbf38e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:38.066668 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91f453-ecdf-4fb8-add9-0b6b977fab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:38.068390 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91f453-ecdf-4fb8-add9-0b6b977fab3d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:38.069172 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91f453-ecdf-4fb8-add9-0b6b977fab3d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:38.069869 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91f453-ecdf-4fb8-add9-0b6b977fab3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:38.090456 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:38.091177 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91f453-ecdf-4fb8-add9-0b6b977fab3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:38.102403 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-3e91f453-ecdf-4fb8-add9-0b6b977fab3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:38.102403 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:38.102403 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:38.102403 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:38.102403 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:38.102403 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:38.102403 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:38.102403 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:38.102403 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:38.102403 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:38.102403 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:38.102403 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:38.102403 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:38.102403 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:38.102403 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:38.102403 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:38.104510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:38.104510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:38.104510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:38.104510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:38.104510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:38.104510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:38.104510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:38.104510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:38.104510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:38.104510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:38.104510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:38.104510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:38.104510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:38.104510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:38.104510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:38.104510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:38.106352 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:38.106352 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:38.106352 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:38.106352 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:38.106352 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:38.106352 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:38.106352 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:38.106352 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:38.106352 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:38.106352 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:38.106352 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:38.106352 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:38.109118 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 340/668] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:38.110861 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91f453-ecdf-4fb8-add9-0b6b977fab3d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:38.132444 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585c24d-fa40-441b-b552-ed030fbf38e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:38.133755 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585c24d-fa40-441b-b552-ed030fbf38e3 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:38.191058 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:38.262564 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 329/669] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:42:38.264686 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585c24d-fa40-441b-b552-ed030fbf38e3 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:38.279002 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91f453-ecdf-4fb8-add9-0b6b977fab3d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:38.331591 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a86bc-7a7f-487f-9aff-05d4d51e2f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:38.333603 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a86bc-7a7f-487f-9aff-05d4d51e2f0c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:38.334532 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a86bc-7a7f-487f-9aff-05d4d51e2f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:38.335040 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a86bc-7a7f-487f-9aff-05d4d51e2f0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:38.350011 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a86bc-7a7f-487f-9aff-05d4d51e2f0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:38.352742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a86bc-7a7f-487f-9aff-05d4d51e2f0c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:38.376130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-db1a86bc-7a7f-487f-9aff-05d4d51e2f0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:38.376130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:38.376130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:38.376130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:38.376130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:38.376130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:38.376130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:38.376130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:38.376130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:38.376130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:38.376130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:38.376130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:38.376130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:38.376130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:38.376130 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:38.377341 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:38.377341 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:38.377341 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:38.377341 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:38.377341 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:38.377341 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:38.377341 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:38.377341 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:38.377341 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:38.377341 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:38.377341 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:38.377341 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:38.377341 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:38.377341 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:38.377341 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:38.377341 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:38.377341 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:38.378394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:38.378394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:38.378394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:38.378394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:38.378394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:38.378394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:38.378394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:38.378394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:38.383064 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:38.385398 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 341/670] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:38.386094 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a86bc-7a7f-487f-9aff-05d4d51e2f0c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:38.430526 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585c24d-fa40-441b-b552-ed030fbf38e3 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:38.487167 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc35c4c-1617-4dfc-9965-4280a45bde46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:38.488203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc35c4c-1617-4dfc-9965-4280a45bde46 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:38.488709 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc35c4c-1617-4dfc-9965-4280a45bde46 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:38.489233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc35c4c-1617-4dfc-9965-4280a45bde46 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:38.490539 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc35c4c-1617-4dfc-9965-4280a45bde46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:38.490944 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc35c4c-1617-4dfc-9965-4280a45bde46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:38.493497 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc35c4c-1617-4dfc-9965-4280a45bde46 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:38.514654 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a86bc-7a7f-487f-9aff-05d4d51e2f0c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:38.515216 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 330/671] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:38.516830 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc35c4c-1617-4dfc-9965-4280a45bde46 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:38.535519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:38.571036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f4daa-ef34-4635-a95a-a4fb6c604b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:38.571928 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f4daa-ef34-4635-a95a-a4fb6c604b05 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:38.572216 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f4daa-ef34-4635-a95a-a4fb6c604b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:38.572494 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f4daa-ef34-4635-a95a-a4fb6c604b05 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:38.573205 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f4daa-ef34-4635-a95a-a4fb6c604b05 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:38.573746 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f4daa-ef34-4635-a95a-a4fb6c604b05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:38.575974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f4daa-ef34-4635-a95a-a4fb6c604b05 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:38.594037 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 342/672] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:42:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:38.594037 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f4daa-ef34-4635-a95a-a4fb6c604b05 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:38.663000 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc35c4c-1617-4dfc-9965-4280a45bde46 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:38.731315 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b345af-e40e-43d2-a450-00ac529e569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:38.732423 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b345af-e40e-43d2-a450-00ac529e569b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:38.733279 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b345af-e40e-43d2-a450-00ac529e569b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:38.733788 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b345af-e40e-43d2-a450-00ac529e569b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:38.739908 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:38.758560 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b345af-e40e-43d2-a450-00ac529e569b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:38.760920 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b345af-e40e-43d2-a450-00ac529e569b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:38.766445 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f4daa-ef34-4635-a95a-a4fb6c604b05 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:38.787429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-d0b345af-e40e-43d2-a450-00ac529e569b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:38.787429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:38.787429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:38.787429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:38.787429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:38.787429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:38.787429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:38.787429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:38.787429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:38.787429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:38.787429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:38.787429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:38.787429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:38.787429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:38.787429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:38.787429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:38.788500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:38.788500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:38.788500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:38.788500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:38.788500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:38.788500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:38.788500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:38.788500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:38.788500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:38.788500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:38.788500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:38.788500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:38.788500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:38.788500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:38.788500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:38.788500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:38.788500 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:38.789470 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:38.789470 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:38.789470 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:38.796435 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 331/673] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:38.797979 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b345af-e40e-43d2-a450-00ac529e569b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:38.825426 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb095c9-73d7-4f1c-a994-0b41f1801dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:38.826404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb095c9-73d7-4f1c-a994-0b41f1801dba None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:38.826971 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb095c9-73d7-4f1c-a994-0b41f1801dba None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:38.827275 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb095c9-73d7-4f1c-a994-0b41f1801dba None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:38.828297 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb095c9-73d7-4f1c-a994-0b41f1801dba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:38.828814 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb095c9-73d7-4f1c-a994-0b41f1801dba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:38.830725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb095c9-73d7-4f1c-a994-0b41f1801dba None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:38.852998 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 343/674] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:38.853912 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb095c9-73d7-4f1c-a994-0b41f1801dba None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:38.904142 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:38.977068 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b345af-e40e-43d2-a450-00ac529e569b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:39.017485 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb095c9-73d7-4f1c-a994-0b41f1801dba None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:39.035844 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33497ac2-939d-43d3-b7e9-8fc36c3b89e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:39.037149 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33497ac2-939d-43d3-b7e9-8fc36c3b89e6 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:39.037285 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33497ac2-939d-43d3-b7e9-8fc36c3b89e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:39.037529 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33497ac2-939d-43d3-b7e9-8fc36c3b89e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:39.038881 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33497ac2-939d-43d3-b7e9-8fc36c3b89e6 None admin] RBAC: Adding query filter params (role.id=714239b608694824a75962d8cbb39f70, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=2920ad41c61b401299ca5ae1714b4031) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:39.039431 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33497ac2-939d-43d3-b7e9-8fc36c3b89e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:39.041951 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33497ac2-939d-43d3-b7e9-8fc36c3b89e6 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:39.053276 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 332/675] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:42:38 2022] GET /identity/v3/role_assignments?user.id=2920ad41c61b401299ca5ae1714b4031&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=714239b608694824a75962d8cbb39f70 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:39.054714 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33497ac2-939d-43d3-b7e9-8fc36c3b89e6 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:39.079850 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b1bef-f4f3-4c78-820c-d48b1efd5af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:39.081640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b1bef-f4f3-4c78-820c-d48b1efd5af7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:39.082419 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b1bef-f4f3-4c78-820c-d48b1efd5af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:39.083626 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b1bef-f4f3-4c78-820c-d48b1efd5af7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:39.109737 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b1bef-f4f3-4c78-820c-d48b1efd5af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:39.112331 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b1bef-f4f3-4c78-820c-d48b1efd5af7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:39.142156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e80b1bef-f4f3-4c78-820c-d48b1efd5af7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:39.142156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:39.142156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:39.142156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:39.142156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:39.142156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:39.142156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:39.142156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:39.142156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:39.142156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:39.142156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:39.142156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:39.142156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:39.142156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:39.142156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:39.142156 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:39.143973 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:39.143973 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:39.143973 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:39.143973 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:39.143973 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:39.143973 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:39.143973 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:39.143973 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:39.143973 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:39.143973 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:39.143973 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:39.143973 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:39.143973 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:39.143973 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:39.143973 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:39.143973 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:39.143973 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:39.145754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:39.145754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:39.145754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:39.145754 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 344/676] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:39.146160 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b1bef-f4f3-4c78-820c-d48b1efd5af7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:39.171301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:39.298865 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33497ac2-939d-43d3-b7e9-8fc36c3b89e6 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:39.313632 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:39.343174 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b1bef-f4f3-4c78-820c-d48b1efd5af7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:39.377875 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b52e8-571a-49c1-8a97-b7f622cc4ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:39.379283 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b52e8-571a-49c1-8a97-b7f622cc4ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:39.380010 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b52e8-571a-49c1-8a97-b7f622cc4ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:39.380707 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b52e8-571a-49c1-8a97-b7f622cc4ff1 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:39.382111 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b52e8-571a-49c1-8a97-b7f622cc4ff1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:39.382660 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b52e8-571a-49c1-8a97-b7f622cc4ff1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:39.385330 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b52e8-571a-49c1-8a97-b7f622cc4ff1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:39.414196 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9bdda-3402-4ecd-82ac-0ac1bc193c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:39.415588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9bdda-3402-4ecd-82ac-0ac1bc193c6b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:39.415728 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9bdda-3402-4ecd-82ac-0ac1bc193c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:39.418136 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9bdda-3402-4ecd-82ac-0ac1bc193c6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:39.418136 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9bdda-3402-4ecd-82ac-0ac1bc193c6b None admin] RBAC: Adding query filter params (role.id=714239b608694824a75962d8cbb39f70, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=3469f1e6a9bf47b58d208bffc3415014) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:39.418668 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9bdda-3402-4ecd-82ac-0ac1bc193c6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:39.422811 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9bdda-3402-4ecd-82ac-0ac1bc193c6b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:39.423045 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 333/677] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:39.423640 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b52e8-571a-49c1-8a97-b7f622cc4ff1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:39.432231 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 345/678] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:42:39 2022] GET /identity/v3/role_assignments?user.id=3469f1e6a9bf47b58d208bffc3415014&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=714239b608694824a75962d8cbb39f70 => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:39.433790 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9bdda-3402-4ecd-82ac-0ac1bc193c6b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:39.630380 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9bdda-3402-4ecd-82ac-0ac1bc193c6b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:39.657579 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b52e8-571a-49c1-8a97-b7f622cc4ff1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:39.673041 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:39.687173 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0177f75-e035-4e7a-9c5c-419f45a6802b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:39.687834 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0177f75-e035-4e7a-9c5c-419f45a6802b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:39.688125 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0177f75-e035-4e7a-9c5c-419f45a6802b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:39.688584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0177f75-e035-4e7a-9c5c-419f45a6802b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:39.699251 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0177f75-e035-4e7a-9c5c-419f45a6802b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:39.701102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0177f75-e035-4e7a-9c5c-419f45a6802b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:39.704860 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad28ba-1ed6-4141-970c-56a8651676af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:39.705520 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad28ba-1ed6-4141-970c-56a8651676af None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:39.705796 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad28ba-1ed6-4141-970c-56a8651676af None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:39.706062 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad28ba-1ed6-4141-970c-56a8651676af None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:39.706722 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad28ba-1ed6-4141-970c-56a8651676af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:39.707024 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad28ba-1ed6-4141-970c-56a8651676af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:39.708451 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad28ba-1ed6-4141-970c-56a8651676af None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:39.717378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a0177f75-e035-4e7a-9c5c-419f45a6802b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:39.717378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:39.717378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:39.717378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:39.717378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:39.717378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:39.717378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:39.717378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:39.717378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:39.717378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:39.717378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:39.717378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:39.717378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:39.717378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:39.717378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:39.718371 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:39.718371 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:39.718371 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:39.718371 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:39.718371 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:39.718371 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:39.718371 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:39.718371 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:39.718371 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:39.718371 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:39.718371 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:39.718371 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:39.718371 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:39.718371 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:39.718371 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:39.718371 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:39.718371 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:39.719295 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:39.719295 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:39.719295 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:39.719295 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:39.719295 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:39.719295 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:39.719295 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:39.719295 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:39.719295 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 346/679] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:39.725444 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0177f75-e035-4e7a-9c5c-419f45a6802b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:39.737302 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 334/680] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:39.743562 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad28ba-1ed6-4141-970c-56a8651676af None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:39.777480 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:39.922178 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad28ba-1ed6-4141-970c-56a8651676af None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:39.961584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0177f75-e035-4e7a-9c5c-419f45a6802b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:40.008153 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e622ae5-f946-4672-bd54-6cd9acac00a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:40.009230 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e622ae5-f946-4672-bd54-6cd9acac00a6 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:40.009707 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e622ae5-f946-4672-bd54-6cd9acac00a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:40.010193 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e622ae5-f946-4672-bd54-6cd9acac00a6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:40.037891 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e622ae5-f946-4672-bd54-6cd9acac00a6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:40.039806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e622ae5-f946-4672-bd54-6cd9acac00a6 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:40.044882 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028eff77-1a8d-4aa9-96bf-272f65fa8358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:40.045549 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eff77-1a8d-4aa9-96bf-272f65fa8358 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:40.045829 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eff77-1a8d-4aa9-96bf-272f65fa8358 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:40.046096 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eff77-1a8d-4aa9-96bf-272f65fa8358 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:40.046835 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028eff77-1a8d-4aa9-96bf-272f65fa8358 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:40.047137 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028eff77-1a8d-4aa9-96bf-272f65fa8358 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:40.050364 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028eff77-1a8d-4aa9-96bf-272f65fa8358 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:40.063832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-1e622ae5-f946-4672-bd54-6cd9acac00a6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:42:40.063832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:40.063832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:40.063832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:40.063832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:40.063832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:40.063832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:40.063832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:40.063832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:40.063832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:40.063832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:40.063832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:40.063832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:40.063832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:40.063832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:40.063832 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:40.064900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:40.064900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:40.064900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:40.064900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:40.064900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:40.064900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:40.064900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:40.064900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:40.064900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:40.064900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:40.064900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:40.064900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:40.064900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:40.064900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:40.064900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:40.064900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:40.064900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:40.064900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:40.065883 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:40.065883 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:40.065883 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:40.065883 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:40.065883 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:40.065883 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:40.065883 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:40.065883 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:40.065883 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:42:40.065883 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:40.069129 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 335/681] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:42:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:42:40.072898 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e622ae5-f946-4672-bd54-6cd9acac00a6 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:40.076698 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 347/682] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:42:40.083279 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028eff77-1a8d-4aa9-96bf-272f65fa8358 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:40.139788 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:40.239745 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:40.284287 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e622ae5-f946-4672-bd54-6cd9acac00a6 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:40.288825 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028eff77-1a8d-4aa9-96bf-272f65fa8358 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:40.335924 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cfa95-14d5-44c0-ace6-fd6434fdd268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:40.336551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cfa95-14d5-44c0-ace6-fd6434fdd268 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:40.336824 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cfa95-14d5-44c0-ace6-fd6434fdd268 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:40.337238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cfa95-14d5-44c0-ace6-fd6434fdd268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:40.338024 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cfa95-14d5-44c0-ace6-fd6434fdd268 None admin] RBAC: Adding query filter params (role.id=714239b608694824a75962d8cbb39f70, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=5100db0c968c406fa89e117877604c50) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:40.338533 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cfa95-14d5-44c0-ace6-fd6434fdd268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:40.340804 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cfa95-14d5-44c0-ace6-fd6434fdd268 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:40.352989 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 348/683] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:42:40 2022] GET /identity/v3/role_assignments?user.id=5100db0c968c406fa89e117877604c50&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=714239b608694824a75962d8cbb39f70 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:40.352989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bf078-2396-4ac8-876c-e393dcd46934 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:40.352989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bf078-2396-4ac8-876c-e393dcd46934 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:40.352989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bf078-2396-4ac8-876c-e393dcd46934 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:40.357967 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 349/684] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:40.360990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33634c9f-9628-441d-bbf4-62c55f806f8e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:40.360990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33634c9f-9628-441d-bbf4-62c55f806f8e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:40.360990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33634c9f-9628-441d-bbf4-62c55f806f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:40.377070 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68620d-30be-4827-a9b0-b4f3ccfca33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:40.378728 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68620d-30be-4827-a9b0-b4f3ccfca33c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:40.379602 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68620d-30be-4827-a9b0-b4f3ccfca33c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:40.380358 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68620d-30be-4827-a9b0-b4f3ccfca33c None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:40.382095 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-33634c9f-9628-441d-bbf4-62c55f806f8e None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:40.382492 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68620d-30be-4827-a9b0-b4f3ccfca33c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:40.383320 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68620d-30be-4827-a9b0-b4f3ccfca33c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:40.383493 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-33634c9f-9628-441d-bbf4-62c55f806f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:40.393724 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68620d-30be-4827-a9b0-b4f3ccfca33c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:40.459234 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 336/685] 10.222.0.26 () {56 vars in 1135 bytes} [Sun Oct 2 00:42:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:42:40.475522 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68620d-30be-4827-a9b0-b4f3ccfca33c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:40.481849 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 350/686] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:40.672845 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:40.691004 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68620d-30be-4827-a9b0-b4f3ccfca33c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:40.740568 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df85fb4-5a51-447c-bbc2-64c4cd979cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:40.741309 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df85fb4-5a51-447c-bbc2-64c4cd979cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:40.741557 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df85fb4-5a51-447c-bbc2-64c4cd979cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:40.741724 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df85fb4-5a51-447c-bbc2-64c4cd979cb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:40.843865 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df85fb4-5a51-447c-bbc2-64c4cd979cb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:40.846831 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df85fb4-5a51-447c-bbc2-64c4cd979cb6 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:41.016167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33634c9f-9628-441d-bbf4-62c55f806f8e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:41.047990 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:41.080890 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 337/687] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:42:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 02 00:42:41.092038 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df85fb4-5a51-447c-bbc2-64c4cd979cb6 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:41.171221 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:41.250294 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33634c9f-9628-441d-bbf4-62c55f806f8e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:41.308378 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e45a0-e473-4c34-82eb-ac1b5bc8d72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:41.308928 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e45a0-e473-4c34-82eb-ac1b5bc8d72d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:41.309313 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e45a0-e473-4c34-82eb-ac1b5bc8d72d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:41.309729 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e45a0-e473-4c34-82eb-ac1b5bc8d72d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:41.324553 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e45a0-e473-4c34-82eb-ac1b5bc8d72d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:41.332249 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-845e45a0-e473-4c34-82eb-ac1b5bc8d72d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:42:41.332249 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:41.332249 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:41.332249 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:41.332249 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:41.332249 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:41.332249 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:41.332249 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:41.332249 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:41.332249 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:41.332249 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:41.332249 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:41.332249 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:41.332249 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:41.332249 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:41.332249 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:41.333452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:41.333452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:41.333452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:41.333452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:41.333452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:41.333452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:41.333452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:41.333452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:41.333452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:41.333452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:41.333452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:41.333452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:41.333452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:41.333452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:41.333452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:41.333452 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:41.334395 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:41.334395 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:41.334395 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:41.334395 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:41.334395 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:41.334395 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:41.334395 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:41.334395 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:41.334395 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:41.334395 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:41.334395 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:42:41.334395 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:41.337191 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 351/688] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:42:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:41.347448 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e45a0-e473-4c34-82eb-ac1b5bc8d72d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:41.376502 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df85fb4-5a51-447c-bbc2-64c4cd979cb6 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:41.479350 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825324e-4b4e-4cae-9244-7150f46895f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:41.481342 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825324e-4b4e-4cae-9244-7150f46895f3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:41.482402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825324e-4b4e-4cae-9244-7150f46895f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:41.483082 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825324e-4b4e-4cae-9244-7150f46895f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:41.504836 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825324e-4b4e-4cae-9244-7150f46895f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:41.507327 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825324e-4b4e-4cae-9244-7150f46895f3 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:41.529114 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-7825324e-4b4e-4cae-9244-7150f46895f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:41.529114 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:41.529114 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:41.529114 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:41.529114 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:41.529114 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:41.529114 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:41.529114 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:41.529114 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:41.529114 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:41.529114 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:41.529114 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:41.529114 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:41.529114 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:41.529114 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:41.529114 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:41.530666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:41.530666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:41.530666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:41.530666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:41.530666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:41.530666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:41.530666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:41.530666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:41.530666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:41.530666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:41.530666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:41.530666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:41.530666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:41.530666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:41.530666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:41.530666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:41.530666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:41.532088 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:41.532088 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:41.532088 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:41.534161 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 338/689] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:42:41.545743 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825324e-4b4e-4cae-9244-7150f46895f3 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:41.631118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e45a0-e473-4c34-82eb-ac1b5bc8d72d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:41.636515 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:41.688519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:41.715401 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e3f02-634b-4f3d-9dfa-4aecf696d22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:41.716396 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e3f02-634b-4f3d-9dfa-4aecf696d22b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:41.716828 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e3f02-634b-4f3d-9dfa-4aecf696d22b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:41.717283 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e3f02-634b-4f3d-9dfa-4aecf696d22b None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:41.718113 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e3f02-634b-4f3d-9dfa-4aecf696d22b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:41.718569 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e3f02-634b-4f3d-9dfa-4aecf696d22b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:41.721720 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e3f02-634b-4f3d-9dfa-4aecf696d22b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:41.738191 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 352/690] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:42:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:42:41.744446 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e3f02-634b-4f3d-9dfa-4aecf696d22b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:41.773042 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825324e-4b4e-4cae-9244-7150f46895f3 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:41.885853 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5574863-4509-4bfa-b92d-82a2d07e753c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:41.886418 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5574863-4509-4bfa-b92d-82a2d07e753c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:41.886694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5574863-4509-4bfa-b92d-82a2d07e753c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:41.886971 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5574863-4509-4bfa-b92d-82a2d07e753c None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:41.887856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5574863-4509-4bfa-b92d-82a2d07e753c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:41.888118 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5574863-4509-4bfa-b92d-82a2d07e753c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:41.889818 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5574863-4509-4bfa-b92d-82a2d07e753c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:41.911784 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 339/691] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:41.917593 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5574863-4509-4bfa-b92d-82a2d07e753c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:41.927956 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e3f02-634b-4f3d-9dfa-4aecf696d22b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:41.972267 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8b819-0f4e-41a1-a8e7-6705bfc7738d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:41.972958 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8b819-0f4e-41a1-a8e7-6705bfc7738d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:41.973230 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8b819-0f4e-41a1-a8e7-6705bfc7738d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:41.973505 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8b819-0f4e-41a1-a8e7-6705bfc7738d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:41.991546 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8b819-0f4e-41a1-a8e7-6705bfc7738d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:41.993067 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8b819-0f4e-41a1-a8e7-6705bfc7738d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:42.016990 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-89c8b819-0f4e-41a1-a8e7-6705bfc7738d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:42.016990 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:42.016990 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:42.016990 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:42.016990 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:42.016990 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:42.016990 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:42.016990 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:42.016990 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:42.016990 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:42.016990 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:42.016990 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:42.016990 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:42.016990 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:42.016990 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:42.016990 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:42.019539 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:42.019539 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:42.019539 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:42.019539 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:42.019539 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:42.019539 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:42.019539 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:42.019539 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:42.019539 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:42.019539 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:42.019539 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:42.019539 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:42.019539 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:42.019539 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:42.019539 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:42.019539 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:42.019539 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:42.022517 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:42.022517 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:42.022517 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:42.022517 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 353/692] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:42.022517 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8b819-0f4e-41a1-a8e7-6705bfc7738d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:42.094920 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:42.146755 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:42.150960 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5574863-4509-4bfa-b92d-82a2d07e753c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:42.235006 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fda37-edb9-4faf-891a-cfc3b3052be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:42.237632 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fda37-edb9-4faf-891a-cfc3b3052be9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:42.237911 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fda37-edb9-4faf-891a-cfc3b3052be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:42.238182 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fda37-edb9-4faf-891a-cfc3b3052be9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:42.244844 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8b819-0f4e-41a1-a8e7-6705bfc7738d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:42.256704 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fda37-edb9-4faf-891a-cfc3b3052be9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:42.258297 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fda37-edb9-4faf-891a-cfc3b3052be9 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:42.281895 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-be7fda37-edb9-4faf-891a-cfc3b3052be9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:42.281895 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:42.281895 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:42.281895 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:42.281895 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:42.281895 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:42.281895 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:42.281895 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:42.281895 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:42.281895 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:42.281895 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:42.281895 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:42.281895 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:42.281895 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:42.281895 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:42.282896 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:42.282896 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:42.282896 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:42.282896 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:42.282896 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:42.282896 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:42.282896 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:42.282896 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:42.282896 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:42.282896 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:42.282896 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:42.282896 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:42.282896 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:42.282896 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:42.282896 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:42.282896 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:42.282896 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:42.283833 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:42.283833 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:42.283833 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:42.283833 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:42.283833 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:42.283833 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:42.283833 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:42.283833 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:42.294612 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 340/693] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:42:42.295688 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fda37-edb9-4faf-891a-cfc3b3052be9 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:42.331312 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b9102-c14b-47fc-a427-47ccc775915d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:42.331927 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b9102-c14b-47fc-a427-47ccc775915d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:42.332211 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b9102-c14b-47fc-a427-47ccc775915d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:42.332485 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b9102-c14b-47fc-a427-47ccc775915d None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:42.333183 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b9102-c14b-47fc-a427-47ccc775915d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:42.333491 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b9102-c14b-47fc-a427-47ccc775915d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:42.334906 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b9102-c14b-47fc-a427-47ccc775915d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:42.376716 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 354/694] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:42:42.385591 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b9102-c14b-47fc-a427-47ccc775915d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:42.509341 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fda37-edb9-4faf-891a-cfc3b3052be9 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:42.545088 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:42.554274 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b9102-c14b-47fc-a427-47ccc775915d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:42.566242 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaad14-9386-4e7c-826a-1e9804439ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:42.567327 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaad14-9386-4e7c-826a-1e9804439ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:42.567800 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaad14-9386-4e7c-826a-1e9804439ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:42.568281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaad14-9386-4e7c-826a-1e9804439ae3 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:42.569458 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aaad14-9386-4e7c-826a-1e9804439ae3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:42.569986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aaad14-9386-4e7c-826a-1e9804439ae3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:42.572612 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aaad14-9386-4e7c-826a-1e9804439ae3 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:42.589881 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 341/695] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:42.595647 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99401d-f453-4e13-aee9-19ee168395e8 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:42.595941 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99401d-f453-4e13-aee9-19ee168395e8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:42.596434 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99401d-f453-4e13-aee9-19ee168395e8 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:42.600104 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 342/696] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:42.603089 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de055111-ea1b-4a86-88da-5aebc8195787 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:42.603089 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de055111-ea1b-4a86-88da-5aebc8195787 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:42.603089 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de055111-ea1b-4a86-88da-5aebc8195787 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:42.603964 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 343/697] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:42.604974 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de055111-ea1b-4a86-88da-5aebc8195787 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:42.611144 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe2054-2fef-4ff5-9d58-d870417f37a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:42.612196 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe2054-2fef-4ff5-9d58-d870417f37a1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:42.612692 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe2054-2fef-4ff5-9d58-d870417f37a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:42.613156 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe2054-2fef-4ff5-9d58-d870417f37a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:42.626208 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe2054-2fef-4ff5-9d58-d870417f37a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:42.628963 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe2054-2fef-4ff5-9d58-d870417f37a1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:42.631478 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:42.645362 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-cdbe2054-2fef-4ff5-9d58-d870417f37a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:42:42.645362 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:42.645362 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:42.645362 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:42.645362 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:42.645362 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:42.645362 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:42.645362 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:42.645362 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:42.645362 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:42.645362 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:42.645362 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:42.645362 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:42.645362 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:42.645362 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:42.645362 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:42.647320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:42.647320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:42.647320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:42.647320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:42.647320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:42.647320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:42.647320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:42.647320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:42.647320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:42.647320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:42.647320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:42.647320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:42.647320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:42.647320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:42.647320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:42.647320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:42.647320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:42.647320 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:42.650157 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:42.650157 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:42.650157 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:42.650157 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:42.650157 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:42.650157 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:42.650157 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:42.650157 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:42.650157 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:42:42.650157 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:42.652871 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 355/698] 10.222.0.26 () {56 vars in 1093 bytes} [Sun Oct 2 00:42:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:42.654499 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca706d6-b8c4-4f6b-bb8b-cc371a054b90 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:42.655032 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca706d6-b8c4-4f6b-bb8b-cc371a054b90 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:42.655032 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca706d6-b8c4-4f6b-bb8b-cc371a054b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:42.675394 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8ca706d6-b8c4-4f6b-bb8b-cc371a054b90 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:42.676510 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8ca706d6-b8c4-4f6b-bb8b-cc371a054b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:42.760792 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 356/699] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:42.763814 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aae6c5-a796-4a92-9e4e-9f575488c8e0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:42.764120 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aae6c5-a796-4a92-9e4e-9f575488c8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:42.764362 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aae6c5-a796-4a92-9e4e-9f575488c8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:42.787983 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d7aae6c5-a796-4a92-9e4e-9f575488c8e0 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:42.790015 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d7aae6c5-a796-4a92-9e4e-9f575488c8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:42.793347 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de055111-ea1b-4a86-88da-5aebc8195787 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:42.842908 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f38760-eb34-4656-9ed4-6d93c999f11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:42.843922 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f38760-eb34-4656-9ed4-6d93c999f11a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:42.844587 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f38760-eb34-4656-9ed4-6d93c999f11a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:42.845077 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f38760-eb34-4656-9ed4-6d93c999f11a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:42.846506 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f38760-eb34-4656-9ed4-6d93c999f11a None admin] RBAC: Adding query filter params (role.id=714239b608694824a75962d8cbb39f70, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=2784579d2ddf4cc99fe0e1d109e5cdda) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:42.847086 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f38760-eb34-4656-9ed4-6d93c999f11a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:42.849230 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f38760-eb34-4656-9ed4-6d93c999f11a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:42.858762 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 344/700] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:42:42 2022] GET /identity/v3/role_assignments?user.id=2784579d2ddf4cc99fe0e1d109e5cdda&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=714239b608694824a75962d8cbb39f70 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:42.860079 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f38760-eb34-4656-9ed4-6d93c999f11a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:42.926015 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 357/701] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:43.044809 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:43.072682 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f38760-eb34-4656-9ed4-6d93c999f11a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:43.151180 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc8654-39e9-4df6-926f-0ef87165098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:43.152790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc8654-39e9-4df6-926f-0ef87165098b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:43.153314 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc8654-39e9-4df6-926f-0ef87165098b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:43.153760 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc8654-39e9-4df6-926f-0ef87165098b None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:43.155207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc8654-39e9-4df6-926f-0ef87165098b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:43.155768 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc8654-39e9-4df6-926f-0ef87165098b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:43.158410 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc8654-39e9-4df6-926f-0ef87165098b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:43.190979 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 345/702] 10.222.0.26 () {56 vars in 1133 bytes} [Sun Oct 2 00:42:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:43.201240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aae6c5-a796-4a92-9e4e-9f575488c8e0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:43.242472 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:43.294554 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc8654-39e9-4df6-926f-0ef87165098b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:43.364285 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aae6c5-a796-4a92-9e4e-9f575488c8e0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:43.423121 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22e51f-797f-49dc-b0b4-977c65eae789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:43.423751 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22e51f-797f-49dc-b0b4-977c65eae789 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:43.424512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22e51f-797f-49dc-b0b4-977c65eae789 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:43.424796 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22e51f-797f-49dc-b0b4-977c65eae789 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:43.445439 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc8654-39e9-4df6-926f-0ef87165098b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:43.489292 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769bb09-8475-469e-97fa-f7f61d98c9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:43.489933 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769bb09-8475-469e-97fa-f7f61d98c9cf None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:43.490211 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769bb09-8475-469e-97fa-f7f61d98c9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:43.490466 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769bb09-8475-469e-97fa-f7f61d98c9cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:43.503108 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769bb09-8475-469e-97fa-f7f61d98c9cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:43.504617 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769bb09-8475-469e-97fa-f7f61d98c9cf None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:43.506957 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:43.526229 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-1769bb09-8475-469e-97fa-f7f61d98c9cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:43.526229 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:43.526229 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:43.526229 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:43.526229 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:43.526229 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:43.526229 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:43.526229 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:43.526229 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:43.526229 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:43.526229 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:43.526229 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:43.526229 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:43.526229 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:43.526229 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:43.526229 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:43.528187 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:43.528187 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:43.528187 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:43.528187 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:43.528187 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:43.528187 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:43.528187 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:43.528187 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:43.528187 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:43.528187 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:43.528187 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:43.528187 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:43.528187 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:43.528187 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:43.528187 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:43.528187 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:43.528187 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:43.529881 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:43.529881 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:43.529881 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:43.529881 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 346/703] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:42:43.529881 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b64967-66b8-4a3f-8ff4-1db254354681 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:43.529881 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b64967-66b8-4a3f-8ff4-1db254354681 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:43.529881 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b64967-66b8-4a3f-8ff4-1db254354681 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:43.537212 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 347/704] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:43.537212 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b64967-66b8-4a3f-8ff4-1db254354681 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:43.554342 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22e51f-797f-49dc-b0b4-977c65eae789 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:43.556764 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22e51f-797f-49dc-b0b4-977c65eae789 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:43.591899 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:43.713951 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 358/705] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:42:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 02 00:42:43.716031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22e51f-797f-49dc-b0b4-977c65eae789 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:43.740786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b64967-66b8-4a3f-8ff4-1db254354681 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:43.808566 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53772ecc-fdd0-4bf3-ad9b-7581b6237b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:43.809644 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53772ecc-fdd0-4bf3-ad9b-7581b6237b71 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:43.810103 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53772ecc-fdd0-4bf3-ad9b-7581b6237b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:43.810570 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53772ecc-fdd0-4bf3-ad9b-7581b6237b71 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:43.811602 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53772ecc-fdd0-4bf3-ad9b-7581b6237b71 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:43.814026 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53772ecc-fdd0-4bf3-ad9b-7581b6237b71 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:43.834159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-53772ecc-fdd0-4bf3-ad9b-7581b6237b71 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 02 00:42:43.834159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:43.834159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:42:43.834159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:42:43.834159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:42:43.834159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:42:43.834159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:42:43.834159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:42:43.834159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 02 00:42:43.834159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:43.834159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:42:43.834159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:43.834159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:43.834159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:43.834159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:43.834159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:43.834159 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:43.836418 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:43.836418 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:43.836418 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:43.836418 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:43.836418 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:43.836418 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:43.836418 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:42:43.836418 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:42:43.836418 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:42:43.836418 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:42:43.836418 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:43.836418 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:43.836418 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:43.836418 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:43.836418 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:43.836418 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:43.838572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:43.838572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:43.838572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:43.838572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:43.838572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:43.838572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:43.838572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:43.838572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:43.838572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:43.838572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:43.838572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:42:43.838572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:42:43.838572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 02 00:42:43.838572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:43.838572 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 348/706] 10.222.0.26 () {56 vars in 1129 bytes} [Sun Oct 2 00:42:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:43.840702 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153e836-5f82-45b1-923d-843a65cce578 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:43.840702 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153e836-5f82-45b1-923d-843a65cce578 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:43.840702 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153e836-5f82-45b1-923d-843a65cce578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:43.871032 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b153e836-5f82-45b1-923d-843a65cce578 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:43.871405 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22e51f-797f-49dc-b0b4-977c65eae789 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:43.873073 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b153e836-5f82-45b1-923d-843a65cce578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:43.904284 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:43.930652 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef52d6-4baa-45dd-bffc-d99045793586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:43.931281 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef52d6-4baa-45dd-bffc-d99045793586 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:43.931655 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef52d6-4baa-45dd-bffc-d99045793586 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:43.931930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef52d6-4baa-45dd-bffc-d99045793586 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:43.932597 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef52d6-4baa-45dd-bffc-d99045793586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:43.933059 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef52d6-4baa-45dd-bffc-d99045793586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:43.936083 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef52d6-4baa-45dd-bffc-d99045793586 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:43.956928 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 359/707] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:43.957852 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef52d6-4baa-45dd-bffc-d99045793586 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:43.967928 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:43.988464 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 349/708] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:43.997349 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153e836-5f82-45b1-923d-843a65cce578 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:44.144431 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153e836-5f82-45b1-923d-843a65cce578 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:44.159098 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef52d6-4baa-45dd-bffc-d99045793586 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:44.196488 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccb855-c471-405d-8d76-c97d0c3f771f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:44.198017 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccb855-c471-405d-8d76-c97d0c3f771f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:44.198318 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccb855-c471-405d-8d76-c97d0c3f771f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:44.198835 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccb855-c471-405d-8d76-c97d0c3f771f None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:44.199646 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccb855-c471-405d-8d76-c97d0c3f771f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:44.199964 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccb855-c471-405d-8d76-c97d0c3f771f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:44.201844 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccb855-c471-405d-8d76-c97d0c3f771f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:44.217671 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 350/709] 10.222.0.26 () {56 vars in 1124 bytes} [Sun Oct 2 00:42:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:44.219558 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccb855-c471-405d-8d76-c97d0c3f771f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:44.221000 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b2174-ab5e-4ef8-813e-23675ff2bdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:44.221663 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b2174-ab5e-4ef8-813e-23675ff2bdf0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:44.221944 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b2174-ab5e-4ef8-813e-23675ff2bdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:44.222218 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b2174-ab5e-4ef8-813e-23675ff2bdf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:44.236519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b2174-ab5e-4ef8-813e-23675ff2bdf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:44.238040 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b2174-ab5e-4ef8-813e-23675ff2bdf0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:44.257850 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-787b2174-ab5e-4ef8-813e-23675ff2bdf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:44.257850 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:44.257850 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:44.257850 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:44.257850 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:44.257850 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:44.257850 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:44.257850 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:44.257850 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:44.257850 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:44.257850 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:44.257850 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:44.257850 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:44.257850 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:44.257850 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:44.257850 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:44.258915 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:44.258915 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:44.258915 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:44.258915 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:44.258915 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:44.258915 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:44.258915 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:44.258915 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:44.258915 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:44.258915 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:44.258915 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:44.258915 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:44.258915 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:44.258915 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:44.258915 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:44.258915 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:44.258915 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:44.261409 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:44.261409 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:44.261409 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:44.261409 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 360/710] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:44.261409 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b2174-ab5e-4ef8-813e-23675ff2bdf0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:44.300027 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:44.318159 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:44.392083 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccb855-c471-405d-8d76-c97d0c3f771f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:44.419139 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b2174-ab5e-4ef8-813e-23675ff2bdf0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:44.452221 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0764a-e15a-464e-add2-2d85c8d1b747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:44.453073 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0764a-e15a-464e-add2-2d85c8d1b747 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:44.453421 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0764a-e15a-464e-add2-2d85c8d1b747 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:44.453794 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0764a-e15a-464e-add2-2d85c8d1b747 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:44.454697 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0764a-e15a-464e-add2-2d85c8d1b747 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:44.456629 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0764a-e15a-464e-add2-2d85c8d1b747 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:44.459677 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6b8fa-255b-4fcc-af56-a61e4f026329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:44.460546 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6b8fa-255b-4fcc-af56-a61e4f026329 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:44.461047 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6b8fa-255b-4fcc-af56-a61e4f026329 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:44.461525 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6b8fa-255b-4fcc-af56-a61e4f026329 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:44.462359 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6b8fa-255b-4fcc-af56-a61e4f026329 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:44.462848 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6b8fa-255b-4fcc-af56-a61e4f026329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:44.464493 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6b8fa-255b-4fcc-af56-a61e4f026329 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:44.480475 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 361/711] 10.222.0.26 () {56 vars in 1124 bytes} [Sun Oct 2 00:42:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:44.482255 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6b8fa-255b-4fcc-af56-a61e4f026329 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:44.500977 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 351/712] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Oct 2 00:42:44 2022] POST /identity/v3/users => generated 254 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:42:44.500977 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0764a-e15a-464e-add2-2d85c8d1b747 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:44.700007 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0764a-e15a-464e-add2-2d85c8d1b747 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:44.712591 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:44.751898 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92760b-bb57-4aba-883b-e89ec1a356b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:44.752546 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92760b-bb57-4aba-883b-e89ec1a356b5 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:44.752832 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92760b-bb57-4aba-883b-e89ec1a356b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:44.753133 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92760b-bb57-4aba-883b-e89ec1a356b5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:44.754329 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92760b-bb57-4aba-883b-e89ec1a356b5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:44.756174 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92760b-bb57-4aba-883b-e89ec1a356b5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:44.769930 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-ef92760b-bb57-4aba-883b-e89ec1a356b5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 02 00:42:44.769930 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:44.769930 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:42:44.769930 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:42:44.769930 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:42:44.769930 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:42:44.769930 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:42:44.769930 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:42:44.769930 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 02 00:42:44.769930 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:44.769930 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:42:44.769930 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:44.769930 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:44.769930 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:44.769930 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:44.769930 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:44.769930 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:44.771093 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:44.771093 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:44.771093 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:44.771093 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:44.771093 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:44.771093 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:44.771093 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:42:44.771093 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:42:44.771093 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:42:44.771093 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:42:44.771093 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:44.771093 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:44.771093 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:44.771093 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:44.771093 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:44.771093 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:44.771958 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:44.771958 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:44.771958 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:44.771958 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:44.771958 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:44.771958 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:44.771958 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:44.771958 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:44.771958 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:44.771958 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:44.771958 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:42:44.771958 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:42:44.771958 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 02 00:42:44.771958 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:44.771958 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 352/713] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:44 2022] GET /identity/v3/services/network => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:44.782109 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92760b-bb57-4aba-883b-e89ec1a356b5 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:44.787729 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:44.808886 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6b8fa-255b-4fcc-af56-a61e4f026329 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:44.873523 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccff91-ade6-4e19-90e0-3fb120fa6525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:44.874565 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccff91-ade6-4e19-90e0-3fb120fa6525 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:44.875040 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccff91-ade6-4e19-90e0-3fb120fa6525 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:44.875647 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccff91-ade6-4e19-90e0-3fb120fa6525 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:44.876974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccff91-ade6-4e19-90e0-3fb120fa6525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:44.878473 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccff91-ade6-4e19-90e0-3fb120fa6525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:44.881197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccff91-ade6-4e19-90e0-3fb120fa6525 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:44.916035 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 362/714] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:44.926288 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccff91-ade6-4e19-90e0-3fb120fa6525 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:44.928897 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92760b-bb57-4aba-883b-e89ec1a356b5 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:44.980730 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e929d-862a-4162-a0ce-558a0ca56a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:44.982357 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e929d-862a-4162-a0ce-558a0ca56a04 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:44.982885 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e929d-862a-4162-a0ce-558a0ca56a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:44.983402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e929d-862a-4162-a0ce-558a0ca56a04 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:44.984827 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e929d-862a-4162-a0ce-558a0ca56a04 None admin] RBAC: Adding query filter params (name=network) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:44.985417 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e929d-862a-4162-a0ce-558a0ca56a04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:44.987516 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e929d-862a-4162-a0ce-558a0ca56a04 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:44.994563 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 353/715] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Oct 2 00:42:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:45.007252 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e929d-862a-4162-a0ce-558a0ca56a04 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:45.124724 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:45.193992 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccff91-ade6-4e19-90e0-3fb120fa6525 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:45.255414 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e929d-862a-4162-a0ce-558a0ca56a04 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:45.279608 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617d65f-9797-448c-a4b6-62ed8feff265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:45.280189 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617d65f-9797-448c-a4b6-62ed8feff265 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:45.280461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617d65f-9797-448c-a4b6-62ed8feff265 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:45.280733 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617d65f-9797-448c-a4b6-62ed8feff265 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:45.304094 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921801b4-b0d1-4179-8bea-4cd83062b1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:45.305140 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921801b4-b0d1-4179-8bea-4cd83062b1fb None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:45.305650 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921801b4-b0d1-4179-8bea-4cd83062b1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:45.305831 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617d65f-9797-448c-a4b6-62ed8feff265 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:45.306307 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921801b4-b0d1-4179-8bea-4cd83062b1fb None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:45.307148 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921801b4-b0d1-4179-8bea-4cd83062b1fb None admin] RBAC: Adding query filter params (type=network) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:45.307330 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617d65f-9797-448c-a4b6-62ed8feff265 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:45.308158 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921801b4-b0d1-4179-8bea-4cd83062b1fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:45.309819 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921801b4-b0d1-4179-8bea-4cd83062b1fb None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:45.323756 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f617d65f-9797-448c-a4b6-62ed8feff265 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:45.323756 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:45.323756 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:45.323756 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:45.323756 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:45.323756 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:45.323756 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:45.323756 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:45.323756 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:45.323756 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:45.323756 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:45.323756 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:45.323756 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:45.323756 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:45.323756 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:45.324813 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:45.324813 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:45.324813 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:45.324813 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:45.324813 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:45.324813 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:45.324813 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:45.324813 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:45.324813 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:45.324813 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:45.324813 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:45.324813 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:45.324813 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:45.324813 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:45.324813 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:45.324813 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:45.324813 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:45.326166 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:45.326166 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:45.326166 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:45.326166 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:45.326166 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:45.326166 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:45.326166 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:45.326166 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:45.326166 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 363/716] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:45.327068 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 354/717] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Oct 2 00:42:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:45.334194 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617d65f-9797-448c-a4b6-62ed8feff265 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:45.367910 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:45.507474 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617d65f-9797-448c-a4b6-62ed8feff265 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:45.548521 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f8020-9031-4f93-844e-4a4d41db59c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:45.549106 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f8020-9031-4f93-844e-4a4d41db59c7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:45.549389 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f8020-9031-4f93-844e-4a4d41db59c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:45.549665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f8020-9031-4f93-844e-4a4d41db59c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:45.550410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f8020-9031-4f93-844e-4a4d41db59c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:45.550720 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f8020-9031-4f93-844e-4a4d41db59c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:45.552310 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f8020-9031-4f93-844e-4a4d41db59c7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:45.567947 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 364/718] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:45.576500 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921801b4-b0d1-4179-8bea-4cd83062b1fb None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:45.755218 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:45.760369 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921801b4-b0d1-4179-8bea-4cd83062b1fb None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:45.808327 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2781ee9-6532-446a-abd5-ac98a163d667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:45.808885 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2781ee9-6532-446a-abd5-ac98a163d667 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:45.809267 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2781ee9-6532-446a-abd5-ac98a163d667 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:45.809546 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2781ee9-6532-446a-abd5-ac98a163d667 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:45.810316 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2781ee9-6532-446a-abd5-ac98a163d667 None admin] RBAC: Adding query filter params (role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=81e0396b7ba341ce8d02b1a149786d95) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:45.810631 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2781ee9-6532-446a-abd5-ac98a163d667 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:45.812153 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2781ee9-6532-446a-abd5-ac98a163d667 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:45.819465 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 355/719] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:42:45 2022] GET /identity/v3/role_assignments?user.id=81e0396b7ba341ce8d02b1a149786d95&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:45.971009 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5649e-4cc5-4af5-bcd0-239122f694a7 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:45.971273 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5649e-4cc5-4af5-bcd0-239122f694a7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:45.971718 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5649e-4cc5-4af5-bcd0-239122f694a7 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:45.973348 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 365/720] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:45.979264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7879824-db8d-47d1-bb39-282476972153 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:45.980570 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7879824-db8d-47d1-bb39-282476972153 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:45.980570 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7879824-db8d-47d1-bb39-282476972153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:46.008863 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e7879824-db8d-47d1-bb39-282476972153 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:46.014955 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e7879824-db8d-47d1-bb39-282476972153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:46.124570 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 356/721] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:42:46.555628 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5649e-4cc5-4af5-bcd0-239122f694a7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:46.654045 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:46.701711 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5649e-4cc5-4af5-bcd0-239122f694a7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:46.753234 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1928c9-ce7f-4695-bff2-63000a9c8046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:46.753878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1928c9-ce7f-4695-bff2-63000a9c8046 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:46.754153 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1928c9-ce7f-4695-bff2-63000a9c8046 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:46.754421 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1928c9-ce7f-4695-bff2-63000a9c8046 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:46.777754 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1928c9-ce7f-4695-bff2-63000a9c8046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:46.782664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-bb1928c9-ce7f-4695-bff2-63000a9c8046 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:42:46.782664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:46.782664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:46.782664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:46.782664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:46.782664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:46.782664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:46.782664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:46.782664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:46.782664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:46.782664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:46.782664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:46.782664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:46.782664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:46.782664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:46.782664 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:46.783655 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:46.783655 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:46.783655 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:46.783655 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:46.783655 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:46.783655 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:46.783655 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:46.783655 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:46.783655 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:46.783655 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:46.783655 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:46.783655 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:46.783655 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:46.783655 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:46.783655 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:46.783655 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:46.784532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:46.784532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:46.784532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:46.784532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:46.784532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:46.784532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:46.784532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:46.784532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:46.784532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:46.784532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:46.784532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:42:46.784532 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:46.784532 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 366/722] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:42:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:46.791812 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7879824-db8d-47d1-bb39-282476972153 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:46.966641 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:46.979090 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7879824-db8d-47d1-bb39-282476972153 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:47.031642 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59cd50-a47d-4e11-a1e3-0ae13412a0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:47.032270 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59cd50-a47d-4e11-a1e3-0ae13412a0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:47.032542 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59cd50-a47d-4e11-a1e3-0ae13412a0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:47.032804 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59cd50-a47d-4e11-a1e3-0ae13412a0c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:47.033524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59cd50-a47d-4e11-a1e3-0ae13412a0c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:47.033830 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59cd50-a47d-4e11-a1e3-0ae13412a0c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:47.035245 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59cd50-a47d-4e11-a1e3-0ae13412a0c5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:47.050038 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 357/723] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:42:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:47.057002 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1928c9-ce7f-4695-bff2-63000a9c8046 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:47.298987 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1928c9-ce7f-4695-bff2-63000a9c8046 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:47.373730 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:47.382302 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320603c7-a9c9-4d72-a445-232aa302c394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:47.382952 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320603c7-a9c9-4d72-a445-232aa302c394 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:47.383238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320603c7-a9c9-4d72-a445-232aa302c394 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:47.383512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320603c7-a9c9-4d72-a445-232aa302c394 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:47.396729 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320603c7-a9c9-4d72-a445-232aa302c394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:47.398299 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320603c7-a9c9-4d72-a445-232aa302c394 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:47.422666 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-320603c7-a9c9-4d72-a445-232aa302c394 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:47.422666 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:47.422666 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:47.422666 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:47.422666 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:47.422666 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:47.422666 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:47.422666 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:47.422666 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:47.422666 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:47.422666 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:47.422666 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:47.422666 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:47.422666 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:47.422666 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:47.422666 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:47.423630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:47.423630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:47.423630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:47.423630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:47.423630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:47.423630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:47.423630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:47.423630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:47.423630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:47.423630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:47.423630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:47.423630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:47.423630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:47.423630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:47.423630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:47.423630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:47.423630 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:47.424536 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:47.424536 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:47.424536 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:47.424536 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 367/724] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:47.432220 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59cd50-a47d-4e11-a1e3-0ae13412a0c5 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:47.610757 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873119-5f94-431e-8b34-a6e3fa40bd23 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:47.611570 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873119-5f94-431e-8b34-a6e3fa40bd23 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:47.611570 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873119-5f94-431e-8b34-a6e3fa40bd23 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:47.613010 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 368/725] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:47.633865 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944f1ee-51c2-469c-a861-9781880ddce7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:47.634137 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944f1ee-51c2-469c-a861-9781880ddce7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:47.634407 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944f1ee-51c2-469c-a861-9781880ddce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:47.656991 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3944f1ee-51c2-469c-a861-9781880ddce7 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:47.656991 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3944f1ee-51c2-469c-a861-9781880ddce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:47.774633 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 369/726] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:47.776067 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce860a-3f6d-4e2e-82c5-1dc650af97ec None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:47.776875 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce860a-3f6d-4e2e-82c5-1dc650af97ec None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:47.777177 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce860a-3f6d-4e2e-82c5-1dc650af97ec None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:47.778857 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 370/727] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:47.783960 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59cd50-a47d-4e11-a1e3-0ae13412a0c5 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:47.784438 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7eb43-07c9-43c6-87f1-d70cf73026d0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:47.784600 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7eb43-07c9-43c6-87f1-d70cf73026d0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:47.784849 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7eb43-07c9-43c6-87f1-d70cf73026d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:47.840729 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4ea7eb43-07c9-43c6-87f1-d70cf73026d0 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:47.850512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4ea7eb43-07c9-43c6-87f1-d70cf73026d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:47.884542 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c3602-a7e5-4929-8128-d349047dcc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:47.886391 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c3602-a7e5-4929-8128-d349047dcc7a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:47.887465 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c3602-a7e5-4929-8128-d349047dcc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:47.888518 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c3602-a7e5-4929-8128-d349047dcc7a None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:47.889931 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c3602-a7e5-4929-8128-d349047dcc7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:47.890914 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c3602-a7e5-4929-8128-d349047dcc7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:47.894004 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c3602-a7e5-4929-8128-d349047dcc7a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:47.935056 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 358/728] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 504 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:47.940810 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c3602-a7e5-4929-8128-d349047dcc7a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:47.997665 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:48.042664 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 371/729] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:48.141854 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7eb43-07c9-43c6-87f1-d70cf73026d0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:48.162777 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c3602-a7e5-4929-8128-d349047dcc7a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:48.231419 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42f16c-d5cf-47b7-95f1-f8403d2eed81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:48.232114 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42f16c-d5cf-47b7-95f1-f8403d2eed81 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:48.232348 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42f16c-d5cf-47b7-95f1-f8403d2eed81 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:48.232596 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42f16c-d5cf-47b7-95f1-f8403d2eed81 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:48.245894 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42f16c-d5cf-47b7-95f1-f8403d2eed81 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:48.246282 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:48.247383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42f16c-d5cf-47b7-95f1-f8403d2eed81 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:48.269679 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-cb42f16c-d5cf-47b7-95f1-f8403d2eed81 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:42:48.269679 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:48.269679 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:48.269679 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:48.269679 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:48.269679 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:48.269679 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:48.269679 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:48.269679 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:48.269679 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:48.269679 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:48.269679 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:48.269679 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:48.269679 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:48.269679 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:48.269679 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:48.270704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:48.270704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:48.270704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:48.270704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:48.270704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:48.270704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:48.270704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:48.270704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:48.270704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:48.270704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:48.270704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:48.270704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:48.270704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:48.270704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:48.270704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:48.270704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:48.270704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:48.270704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:48.271646 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:48.271646 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:48.271646 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:48.271646 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:48.271646 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:48.271646 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:48.271646 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:48.271646 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:48.271646 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:42:48.271646 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:48.273824 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 359/730] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:42:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:48.282212 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42f16c-d5cf-47b7-95f1-f8403d2eed81 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:48.325315 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7eb43-07c9-43c6-87f1-d70cf73026d0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:48.363125 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccf159-9967-4434-8599-4bf307756fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:48.363783 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccf159-9967-4434-8599-4bf307756fba None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:48.364072 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccf159-9967-4434-8599-4bf307756fba None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:48.364355 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccf159-9967-4434-8599-4bf307756fba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:48.376627 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccf159-9967-4434-8599-4bf307756fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:48.381814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-73ccf159-9967-4434-8599-4bf307756fba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:48.381814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:48.381814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:48.381814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:48.381814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:48.381814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:48.381814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:48.381814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:48.381814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:48.381814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:48.381814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:48.381814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:48.381814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:48.381814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:48.381814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:48.381814 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:48.382768 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:48.382768 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:48.382768 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:48.382768 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:48.382768 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:48.382768 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:48.382768 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:48.382768 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:48.382768 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:48.382768 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:48.382768 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:48.382768 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:48.382768 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:48.382768 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:48.382768 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:48.382768 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:48.383650 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:48.383650 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:48.383650 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:48.383650 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:48.383650 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:48.383650 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:48.383650 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:48.383650 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:48.383650 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:48.383650 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:48.383650 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:48.383650 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:48.383650 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 372/731] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:48.394078 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccf159-9967-4434-8599-4bf307756fba None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:48.565404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:48.580819 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccf159-9967-4434-8599-4bf307756fba None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:48.591894 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:48.656523 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42f16c-d5cf-47b7-95f1-f8403d2eed81 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:48.660924 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538166a4-f005-4758-b847-c4e3ea6a7d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:48.662293 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538166a4-f005-4758-b847-c4e3ea6a7d7d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:48.662772 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538166a4-f005-4758-b847-c4e3ea6a7d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:48.663242 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538166a4-f005-4758-b847-c4e3ea6a7d7d None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:48.664141 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538166a4-f005-4758-b847-c4e3ea6a7d7d None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:48.664647 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538166a4-f005-4758-b847-c4e3ea6a7d7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:48.666311 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538166a4-f005-4758-b847-c4e3ea6a7d7d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:48.676319 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 373/732] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:42:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:48.687367 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538166a4-f005-4758-b847-c4e3ea6a7d7d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:48.752819 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce39a8-54a2-43e5-8669-00706b600a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:48.754219 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce39a8-54a2-43e5-8669-00706b600a31 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:48.754638 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce39a8-54a2-43e5-8669-00706b600a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:48.755055 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce39a8-54a2-43e5-8669-00706b600a31 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:48.756371 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce39a8-54a2-43e5-8669-00706b600a31 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:48.757043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce39a8-54a2-43e5-8669-00706b600a31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:48.759188 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce39a8-54a2-43e5-8669-00706b600a31 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:48.799470 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 360/733] 10.222.0.26 () {56 vars in 1135 bytes} [Sun Oct 2 00:42:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:48.799470 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f479a1a-6aca-40d4-a548-83b6fa0f650d None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:48.799470 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f479a1a-6aca-40d4-a548-83b6fa0f650d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:48.799470 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f479a1a-6aca-40d4-a548-83b6fa0f650d None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:48.801636 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 361/734] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:48.805069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f479a1a-6aca-40d4-a548-83b6fa0f650d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:48.874733 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538166a4-f005-4758-b847-c4e3ea6a7d7d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:48.913217 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003427af-31f6-44a3-8f87-cf8fe75c446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:48.913767 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003427af-31f6-44a3-8f87-cf8fe75c446a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:48.914059 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003427af-31f6-44a3-8f87-cf8fe75c446a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:48.914313 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003427af-31f6-44a3-8f87-cf8fe75c446a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:48.925570 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003427af-31f6-44a3-8f87-cf8fe75c446a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:48.927025 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003427af-31f6-44a3-8f87-cf8fe75c446a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:48.940874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f479a1a-6aca-40d4-a548-83b6fa0f650d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:48.941764 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-003427af-31f6-44a3-8f87-cf8fe75c446a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:48.941764 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:48.941764 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:48.941764 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:48.941764 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:48.941764 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:48.941764 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:48.941764 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:48.941764 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:48.941764 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:48.941764 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:48.941764 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:48.941764 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:48.941764 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:48.941764 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:48.941764 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:48.943645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:48.943645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:48.943645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:48.943645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:48.943645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:48.943645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:48.943645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:48.943645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:48.943645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:48.943645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:48.943645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:48.943645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:48.943645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:48.943645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:48.943645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:48.943645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:48.943645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:48.945558 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:48.945558 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:48.945558 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:48.945558 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 374/735] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:48.945558 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003427af-31f6-44a3-8f87-cf8fe75c446a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:48.968676 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:48.986035 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236e9e5-6eae-40dc-9af0-26a1f16c3d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:48.986664 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236e9e5-6eae-40dc-9af0-26a1f16c3d46 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:48.986940 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236e9e5-6eae-40dc-9af0-26a1f16c3d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:48.987210 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236e9e5-6eae-40dc-9af0-26a1f16c3d46 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:48.987872 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236e9e5-6eae-40dc-9af0-26a1f16c3d46 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:48.989307 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236e9e5-6eae-40dc-9af0-26a1f16c3d46 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:48.993311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:49.008694 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 362/736] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Oct 2 00:42:48 2022] POST /identity/v3/services => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:42:49.011604 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3e111-8c2e-4b2e-893f-e29993c15d1a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:49.012148 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3e111-8c2e-4b2e-893f-e29993c15d1a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:49.012671 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3e111-8c2e-4b2e-893f-e29993c15d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:49.041194 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e6f3e111-8c2e-4b2e-893f-e29993c15d1a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:49.043127 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e6f3e111-8c2e-4b2e-893f-e29993c15d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:49.068593 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003427af-31f6-44a3-8f87-cf8fe75c446a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:49.130167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3274fc-e024-40a9-b925-a9b827127e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:49.130834 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3274fc-e024-40a9-b925-a9b827127e68 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:49.131103 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3274fc-e024-40a9-b925-a9b827127e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:49.131384 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3274fc-e024-40a9-b925-a9b827127e68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:49.169072 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 363/737] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:49.169072 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed0bbe-eb90-4da2-8b0d-47b1e2c1be91 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:49.169072 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed0bbe-eb90-4da2-8b0d-47b1e2c1be91 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:49.169072 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed0bbe-eb90-4da2-8b0d-47b1e2c1be91 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:49.169072 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 364/738] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:49.169072 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed0bbe-eb90-4da2-8b0d-47b1e2c1be91 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:49.237830 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3274fc-e024-40a9-b925-a9b827127e68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:49.239609 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3274fc-e024-40a9-b925-a9b827127e68 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:49.258219 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:49.327874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed0bbe-eb90-4da2-8b0d-47b1e2c1be91 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:49.365353 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:49.373657 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 375/739] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:42:48 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:42:49.375505 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071165cb-363f-4b7e-a726-7d15ba0d50ed None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:49.375850 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071165cb-363f-4b7e-a726-7d15ba0d50ed None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:49.376135 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071165cb-363f-4b7e-a726-7d15ba0d50ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:49.377526 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dbf46-f0c9-41cf-8154-a474908c045b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:49.378169 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dbf46-f0c9-41cf-8154-a474908c045b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:49.378456 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dbf46-f0c9-41cf-8154-a474908c045b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:49.378736 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dbf46-f0c9-41cf-8154-a474908c045b None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:49.379486 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dbf46-f0c9-41cf-8154-a474908c045b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:49.379801 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dbf46-f0c9-41cf-8154-a474908c045b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:49.381672 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dbf46-f0c9-41cf-8154-a474908c045b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:49.397257 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-071165cb-363f-4b7e-a726-7d15ba0d50ed None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:49.398600 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-071165cb-363f-4b7e-a726-7d15ba0d50ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:49.413624 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 365/740] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:49.416515 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dbf46-f0c9-41cf-8154-a474908c045b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:49.499024 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 376/741] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:42:49.499843 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071165cb-363f-4b7e-a726-7d15ba0d50ed None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:49.630471 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dbf46-f0c9-41cf-8154-a474908c045b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:49.726036 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d9639-873e-43f9-99d8-c11181e3014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:49.733056 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d9639-873e-43f9-99d8-c11181e3014c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:49.733056 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d9639-873e-43f9-99d8-c11181e3014c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:49.733056 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d9639-873e-43f9-99d8-c11181e3014c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:49.753063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d9639-873e-43f9-99d8-c11181e3014c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:49.753349 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d9639-873e-43f9-99d8-c11181e3014c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:49.774802 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:49.782020 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e09d9639-873e-43f9-99d8-c11181e3014c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:49.782020 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:49.782020 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:49.782020 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:49.782020 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:49.782020 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:49.782020 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:49.782020 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:49.782020 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:49.782020 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:49.782020 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:49.782020 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:49.782020 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:49.782020 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:49.782020 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:49.782020 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:49.783021 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:49.783021 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:49.783021 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:49.783021 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:49.783021 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:49.783021 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:49.783021 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:49.783021 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:49.783021 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:49.783021 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:49.783021 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:49.783021 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:49.783021 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:49.783021 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:49.783021 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:49.783021 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:49.783021 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:49.783906 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:49.783906 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:49.783906 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:49.784529 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 366/742] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:49.785896 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d9639-873e-43f9-99d8-c11181e3014c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:49.842260 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071165cb-363f-4b7e-a726-7d15ba0d50ed None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:49.850878 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:49.880442 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99801d-e633-4340-8cf0-f36b2e67deca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:49.881293 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99801d-e633-4340-8cf0-f36b2e67deca None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:49.881793 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99801d-e633-4340-8cf0-f36b2e67deca None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:49.882074 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99801d-e633-4340-8cf0-f36b2e67deca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:49.891526 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99801d-e633-4340-8cf0-f36b2e67deca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:49.893051 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99801d-e633-4340-8cf0-f36b2e67deca None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:49.906348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ac99801d-e633-4340-8cf0-f36b2e67deca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:42:49.906348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:49.906348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:49.906348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:49.906348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:49.906348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:49.906348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:49.906348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:49.906348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:49.906348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:49.906348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:49.906348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:49.906348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:49.906348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:49.906348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:49.906348 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:49.908257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:49.908257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:49.908257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:49.908257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:49.908257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:49.908257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:49.908257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:49.908257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:49.908257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:49.908257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:49.908257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:49.908257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:49.908257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:49.908257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:49.908257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:49.908257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:49.908257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:49.908257 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:49.910180 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:49.910180 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:49.910180 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:49.910180 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:49.910180 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:49.910180 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:49.910180 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:49.910180 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:49.910180 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:42:49.910180 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:49.910180 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 377/743] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Oct 2 00:42:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:49.910180 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99801d-e633-4340-8cf0-f36b2e67deca None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:49.983123 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d9639-873e-43f9-99d8-c11181e3014c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:50.022109 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99801d-e633-4340-8cf0-f36b2e67deca None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:50.027030 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:50.034611 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e272288-0eb9-4c3a-921d-215c29ceb03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:50.035238 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e272288-0eb9-4c3a-921d-215c29ceb03d None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:50.035514 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e272288-0eb9-4c3a-921d-215c29ceb03d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:50.035779 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e272288-0eb9-4c3a-921d-215c29ceb03d None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:50.036583 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e272288-0eb9-4c3a-921d-215c29ceb03d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:50.038039 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e272288-0eb9-4c3a-921d-215c29ceb03d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:50.061037 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 367/744] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Oct 2 00:42:49 2022] POST /identity/v3/services => generated 240 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:42:50.061037 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e272288-0eb9-4c3a-921d-215c29ceb03d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:50.091432 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d67d9-b286-49f2-9770-96f1051169f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:50.092403 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d67d9-b286-49f2-9770-96f1051169f7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:50.092798 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d67d9-b286-49f2-9770-96f1051169f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:50.093447 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d67d9-b286-49f2-9770-96f1051169f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:50.094581 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d67d9-b286-49f2-9770-96f1051169f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:50.095082 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d67d9-b286-49f2-9770-96f1051169f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:50.097589 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d67d9-b286-49f2-9770-96f1051169f7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:50.124109 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 378/745] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:50.124109 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d67d9-b286-49f2-9770-96f1051169f7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:50.269889 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:50.278565 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e272288-0eb9-4c3a-921d-215c29ceb03d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:50.318171 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d67d9-b286-49f2-9770-96f1051169f7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:50.351005 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df4b73-1015-49ad-b816-bb73d51b3097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:50.351665 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df4b73-1015-49ad-b816-bb73d51b3097 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:50.351964 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df4b73-1015-49ad-b816-bb73d51b3097 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:50.352656 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df4b73-1015-49ad-b816-bb73d51b3097 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:50.368378 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df4b73-1015-49ad-b816-bb73d51b3097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:50.374730 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-f4df4b73-1015-49ad-b816-bb73d51b3097 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:42:50.374730 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:50.374730 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:50.374730 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:50.374730 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:50.374730 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:50.374730 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:50.374730 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:50.374730 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:50.374730 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:50.374730 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:50.374730 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:50.374730 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:50.374730 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:50.374730 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:50.374730 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:50.376751 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:50.376751 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:50.376751 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:50.376751 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:50.376751 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:50.376751 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:50.376751 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:50.376751 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:50.376751 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:50.376751 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:50.376751 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:50.376751 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:50.376751 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:50.376751 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:50.376751 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:50.376751 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:50.378475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:50.378475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:50.378475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:50.378475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:50.378475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:50.378475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:50.378475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:50.378475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:50.378475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:50.378475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:50.378475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:42:50.378475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:50.378475 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 368/746] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:42:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:50.378475 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df4b73-1015-49ad-b816-bb73d51b3097 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:50.398437 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49810f-d696-4dd1-bb74-ac6652334d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:50.399061 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49810f-d696-4dd1-bb74-ac6652334d82 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:50.399335 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49810f-d696-4dd1-bb74-ac6652334d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:50.399607 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49810f-d696-4dd1-bb74-ac6652334d82 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:50.400361 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49810f-d696-4dd1-bb74-ac6652334d82 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:50.400703 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49810f-d696-4dd1-bb74-ac6652334d82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:50.403109 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49810f-d696-4dd1-bb74-ac6652334d82 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:50.429055 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 379/747] 10.222.0.26 () {56 vars in 1149 bytes} [Sun Oct 2 00:42:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:50.430983 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49810f-d696-4dd1-bb74-ac6652334d82 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:50.468516 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:50.589302 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df4b73-1015-49ad-b816-bb73d51b3097 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:50.657736 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4fe39-bf37-421d-9e73-db16d7bffbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:50.658406 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49810f-d696-4dd1-bb74-ac6652334d82 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:50.658764 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4fe39-bf37-421d-9e73-db16d7bffbce None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:50.659241 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4fe39-bf37-421d-9e73-db16d7bffbce None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:50.659717 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4fe39-bf37-421d-9e73-db16d7bffbce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:50.672854 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4fe39-bf37-421d-9e73-db16d7bffbce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:50.675632 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4fe39-bf37-421d-9e73-db16d7bffbce None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:50.698433 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-18f4fe39-bf37-421d-9e73-db16d7bffbce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:50.698433 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:50.698433 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:50.698433 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:50.698433 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:50.698433 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:50.698433 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:50.698433 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:50.698433 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:50.698433 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:50.698433 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:50.698433 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:50.698433 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:50.698433 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:50.698433 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:50.700259 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:50.700259 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:50.700259 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:50.700259 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:50.700259 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:50.700259 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:50.700259 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:50.700259 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:50.700259 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:50.700259 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:50.700259 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:50.700259 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:50.700259 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:50.700259 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:50.700259 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:50.700259 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:50.700259 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:50.702100 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:50.702100 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:50.702100 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:50.702100 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:50.702100 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:50.702100 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:50.702100 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:50.702100 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:50.702100 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 369/748] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:50.703069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4fe39-bf37-421d-9e73-db16d7bffbce None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:50.739025 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9748e3-ca6f-48df-9022-cf5b8ba3a2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:50.739799 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:50.740920 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9748e3-ca6f-48df-9022-cf5b8ba3a2fa None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:50.741741 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9748e3-ca6f-48df-9022-cf5b8ba3a2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:50.742484 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9748e3-ca6f-48df-9022-cf5b8ba3a2fa None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:50.744823 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9748e3-ca6f-48df-9022-cf5b8ba3a2fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:50.744823 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9748e3-ca6f-48df-9022-cf5b8ba3a2fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:50.748289 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9748e3-ca6f-48df-9022-cf5b8ba3a2fa None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:50.771629 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 380/749] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:42:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:50.771629 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9748e3-ca6f-48df-9022-cf5b8ba3a2fa None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:50.932361 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4fe39-bf37-421d-9e73-db16d7bffbce None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:50.948605 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:50.993185 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9748e3-ca6f-48df-9022-cf5b8ba3a2fa None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:51.003918 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe3921-9941-4dc9-8b41-725d45f6afb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:51.005298 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe3921-9941-4dc9-8b41-725d45f6afb2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:51.006888 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe3921-9941-4dc9-8b41-725d45f6afb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:51.007629 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe3921-9941-4dc9-8b41-725d45f6afb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:51.053196 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98aa0b-a918-477f-929f-365c27a00943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:51.054153 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98aa0b-a918-477f-929f-365c27a00943 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:51.054613 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98aa0b-a918-477f-929f-365c27a00943 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:51.055074 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98aa0b-a918-477f-929f-365c27a00943 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:51.056267 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98aa0b-a918-477f-929f-365c27a00943 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:51.056780 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98aa0b-a918-477f-929f-365c27a00943 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:51.059432 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98aa0b-a918-477f-929f-365c27a00943 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:51.083930 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 381/750] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:51.085567 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98aa0b-a918-477f-929f-365c27a00943 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:51.154279 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe3921-9941-4dc9-8b41-725d45f6afb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:51.156859 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe3921-9941-4dc9-8b41-725d45f6afb2 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:51.190643 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:51.294106 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98aa0b-a918-477f-929f-365c27a00943 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:51.357993 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114310c-7d6c-4f5f-bf2e-361feb2fa069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:51.359163 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114310c-7d6c-4f5f-bf2e-361feb2fa069 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:51.359623 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114310c-7d6c-4f5f-bf2e-361feb2fa069 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:51.360604 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114310c-7d6c-4f5f-bf2e-361feb2fa069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:51.377112 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:51.379208 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 370/751] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:42:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:42:51.380618 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe3921-9941-4dc9-8b41-725d45f6afb2 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:51.387506 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114310c-7d6c-4f5f-bf2e-361feb2fa069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:51.390240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114310c-7d6c-4f5f-bf2e-361feb2fa069 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:51.430510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c114310c-7d6c-4f5f-bf2e-361feb2fa069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:51.430510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:51.430510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:51.430510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:51.430510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:51.430510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:51.430510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:51.430510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:51.430510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:51.430510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:51.430510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:51.430510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:51.430510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:51.430510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:51.430510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:51.430510 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:51.433184 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:51.433184 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:51.433184 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:51.433184 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:51.433184 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:51.433184 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:51.433184 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:51.433184 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:51.433184 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:51.433184 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:51.433184 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:51.433184 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:51.433184 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:51.433184 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:51.433184 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:51.433184 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:51.433184 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:51.436132 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:51.436132 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:51.436132 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:51.439667 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 382/752] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:51.445062 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114310c-7d6c-4f5f-bf2e-361feb2fa069 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:51.580266 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe3921-9941-4dc9-8b41-725d45f6afb2 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:51.603963 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:51.629542 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114310c-7d6c-4f5f-bf2e-361feb2fa069 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:51.632265 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182ba5a-eea5-4661-9254-56098bc8683d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:51.633435 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182ba5a-eea5-4661-9254-56098bc8683d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:51.633921 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182ba5a-eea5-4661-9254-56098bc8683d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:51.634233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182ba5a-eea5-4661-9254-56098bc8683d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:51.635203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182ba5a-eea5-4661-9254-56098bc8683d None admin] RBAC: Adding query filter params (role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=2784579d2ddf4cc99fe0e1d109e5cdda) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:51.636219 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182ba5a-eea5-4661-9254-56098bc8683d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:51.637972 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182ba5a-eea5-4661-9254-56098bc8683d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:51.646411 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 371/753] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:42:51 2022] GET /identity/v3/role_assignments?user.id=2784579d2ddf4cc99fe0e1d109e5cdda&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:51.647684 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182ba5a-eea5-4661-9254-56098bc8683d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:51.738904 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b16cc-a0fc-4d65-b1b6-0d517c880e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:51.739514 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b16cc-a0fc-4d65-b1b6-0d517c880e9c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:51.739836 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b16cc-a0fc-4d65-b1b6-0d517c880e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:51.740261 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b16cc-a0fc-4d65-b1b6-0d517c880e9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:51.770118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b16cc-a0fc-4d65-b1b6-0d517c880e9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:51.771726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b16cc-a0fc-4d65-b1b6-0d517c880e9c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:51.828011 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4a8b16cc-a0fc-4d65-b1b6-0d517c880e9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:51.828011 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:51.828011 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:51.828011 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:51.828011 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:51.828011 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:51.828011 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:51.828011 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:51.828011 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:51.828011 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:51.828011 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:51.828011 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:51.828011 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:51.828011 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:51.828011 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:51.828011 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:51.829463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:51.829463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:51.829463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:51.829463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:51.829463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:51.829463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:51.829463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:51.829463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:51.829463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:51.829463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:51.829463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:51.829463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:51.829463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:51.829463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:51.829463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:51.829463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:51.829463 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:51.831237 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:51.831237 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:51.831237 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:51.833760 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 383/754] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:51.844891 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b16cc-a0fc-4d65-b1b6-0d517c880e9c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:51.885713 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182ba5a-eea5-4661-9254-56098bc8683d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:51.932189 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ccea0-02b3-4373-90f4-9686cfb3a08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:51.933660 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ccea0-02b3-4373-90f4-9686cfb3a08f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:51.934158 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ccea0-02b3-4373-90f4-9686cfb3a08f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:51.934443 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ccea0-02b3-4373-90f4-9686cfb3a08f None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:51.935112 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ccea0-02b3-4373-90f4-9686cfb3a08f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:51.935416 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ccea0-02b3-4373-90f4-9686cfb3a08f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:51.936814 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ccea0-02b3-4373-90f4-9686cfb3a08f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:51.944766 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:51.974291 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 372/755] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:51.981152 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ccea0-02b3-4373-90f4-9686cfb3a08f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:52.048544 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:52.081498 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b16cc-a0fc-4d65-b1b6-0d517c880e9c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:52.122624 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5fe35-e564-4e97-a75b-e62987f2dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:52.123250 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5fe35-e564-4e97-a75b-e62987f2dc31 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:52.123533 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5fe35-e564-4e97-a75b-e62987f2dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:52.123806 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5fe35-e564-4e97-a75b-e62987f2dc31 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:52.124459 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5fe35-e564-4e97-a75b-e62987f2dc31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:52.124763 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5fe35-e564-4e97-a75b-e62987f2dc31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:52.126461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5fe35-e564-4e97-a75b-e62987f2dc31 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:52.137453 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ccea0-02b3-4373-90f4-9686cfb3a08f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:52.142585 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 384/756] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:52.143920 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c941e5-aac4-433f-90cc-4260accefdad None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:52.144212 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c941e5-aac4-433f-90cc-4260accefdad None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:52.149410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c941e5-aac4-433f-90cc-4260accefdad None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:52.157115 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 385/757] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:52.158685 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c941e5-aac4-433f-90cc-4260accefdad None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:52.186516 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77357dcd-917d-4a13-92cd-e8412a40857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:52.187829 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77357dcd-917d-4a13-92cd-e8412a40857f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:52.188205 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77357dcd-917d-4a13-92cd-e8412a40857f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:52.188558 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77357dcd-917d-4a13-92cd-e8412a40857f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:52.199184 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77357dcd-917d-4a13-92cd-e8412a40857f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:52.201218 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77357dcd-917d-4a13-92cd-e8412a40857f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:52.218245 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-77357dcd-917d-4a13-92cd-e8412a40857f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:42:52.218245 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:52.218245 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:52.218245 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:52.218245 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:52.218245 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:52.218245 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:52.218245 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:52.218245 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:52.218245 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:52.218245 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:52.218245 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:52.218245 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:52.218245 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:52.218245 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:52.218245 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:52.219285 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:52.219285 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:52.219285 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:52.219285 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:52.219285 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:52.219285 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:52.219285 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:52.219285 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:52.219285 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:52.219285 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:52.219285 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:52.219285 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:52.219285 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:52.219285 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:52.219285 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:52.219285 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:52.219285 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:52.219285 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:52.220257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:52.220257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:52.220257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:52.220257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:52.220257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:52.220257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:52.220257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:52.220257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:52.220257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:42:52.220257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:52.224554 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 373/758] 10.222.0.26 () {56 vars in 1093 bytes} [Sun Oct 2 00:42:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:52.226666 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc6d5e-4496-4de2-a10b-72fa484f2ea7 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:52.227038 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc6d5e-4496-4de2-a10b-72fa484f2ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:52.227407 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc6d5e-4496-4de2-a10b-72fa484f2ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:52.251814 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-47bc6d5e-4496-4de2-a10b-72fa484f2ea7 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:52.253179 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-47bc6d5e-4496-4de2-a10b-72fa484f2ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:52.334372 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c941e5-aac4-433f-90cc-4260accefdad None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:52.339755 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:52.353119 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 374/759] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:42:52.355838 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc6d5e-4496-4de2-a10b-72fa484f2ea7 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:52.422838 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51405625-f0af-4294-a3e2-f5b41fd18ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:52.423795 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51405625-f0af-4294-a3e2-f5b41fd18ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:52.424253 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51405625-f0af-4294-a3e2-f5b41fd18ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:52.424697 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51405625-f0af-4294-a3e2-f5b41fd18ca0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:52.438054 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:52.438719 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51405625-f0af-4294-a3e2-f5b41fd18ca0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:52.440297 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51405625-f0af-4294-a3e2-f5b41fd18ca0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:52.468301 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-51405625-f0af-4294-a3e2-f5b41fd18ca0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:52.468301 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:52.468301 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:52.468301 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:52.468301 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:52.468301 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:52.468301 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:52.468301 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:52.468301 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:52.468301 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:52.468301 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:52.468301 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:52.468301 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:52.468301 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:52.468301 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:52.469324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:52.469324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:52.469324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:52.469324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:52.469324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:52.469324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:52.469324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:52.469324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:52.469324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:52.469324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:52.469324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:52.469324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:52.469324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:52.469324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:52.469324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:52.469324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:52.469324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:52.470248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:52.470248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:52.470248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:52.470248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:52.470248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:52.470248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:52.470248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:52.470248 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:52.477877 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 386/760] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:52.478893 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51405625-f0af-4294-a3e2-f5b41fd18ca0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:52.603367 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc6d5e-4496-4de2-a10b-72fa484f2ea7 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:52.693423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51405625-f0af-4294-a3e2-f5b41fd18ca0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:52.737650 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d68ad6-ce4d-415c-9b03-b92697cb83ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:52.738017 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d68ad6-ce4d-415c-9b03-b92697cb83ae None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:52.738017 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d68ad6-ce4d-415c-9b03-b92697cb83ae None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:52.739569 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d68ad6-ce4d-415c-9b03-b92697cb83ae None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:52.739569 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d68ad6-ce4d-415c-9b03-b92697cb83ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:52.739569 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d68ad6-ce4d-415c-9b03-b92697cb83ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:52.740720 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d68ad6-ce4d-415c-9b03-b92697cb83ae None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:52.760541 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 387/761] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:52.760541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d68ad6-ce4d-415c-9b03-b92697cb83ae None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:52.788400 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:52.849910 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34db07d-41e1-4c4a-a3af-512bd3bcac3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:52.851640 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34db07d-41e1-4c4a-a3af-512bd3bcac3a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:52.852530 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34db07d-41e1-4c4a-a3af-512bd3bcac3a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:52.853297 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34db07d-41e1-4c4a-a3af-512bd3bcac3a None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:52.855724 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34db07d-41e1-4c4a-a3af-512bd3bcac3a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:52.856628 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34db07d-41e1-4c4a-a3af-512bd3bcac3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:52.859837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34db07d-41e1-4c4a-a3af-512bd3bcac3a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:52.894365 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 375/762] 10.222.0.26 () {56 vars in 1133 bytes} [Sun Oct 2 00:42:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 540 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:52.896355 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34db07d-41e1-4c4a-a3af-512bd3bcac3a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:52.904363 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d68ad6-ce4d-415c-9b03-b92697cb83ae None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:52.959513 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc778a6a-4c03-4c6a-a5ce-84cd105a1862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:52.960167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc778a6a-4c03-4c6a-a5ce-84cd105a1862 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:52.960474 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc778a6a-4c03-4c6a-a5ce-84cd105a1862 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:52.960722 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc778a6a-4c03-4c6a-a5ce-84cd105a1862 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:52.961332 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc778a6a-4c03-4c6a-a5ce-84cd105a1862 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:52.962757 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc778a6a-4c03-4c6a-a5ce-84cd105a1862 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:52.976094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-bc778a6a-4c03-4c6a-a5ce-84cd105a1862 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 02 00:42:52.976094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:52.976094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:42:52.976094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:42:52.976094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:42:52.976094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:42:52.976094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:42:52.976094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:42:52.976094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 02 00:42:52.976094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:52.976094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:42:52.976094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:52.976094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:52.976094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:52.976094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:52.976094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:52.976094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:52.977283 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:52.977283 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:52.977283 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:52.977283 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:52.977283 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:52.977283 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:52.977283 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:42:52.977283 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:42:52.977283 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:42:52.977283 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:42:52.977283 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:52.977283 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:52.977283 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:52.977283 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:52.977283 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:52.977283 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:52.978131 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:52.978131 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:52.978131 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:52.978131 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:52.978131 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:52.978131 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:52.978131 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:52.978131 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:52.978131 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:52.978131 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:52.978131 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:42:52.978131 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:42:52.978131 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 02 00:42:52.978131 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:52.978131 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 388/763] 10.222.0.26 () {56 vars in 1129 bytes} [Sun Oct 2 00:42:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:52.989231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd3806-5c25-4b08-aeb5-200d8cc2ac6c None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:52.989231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd3806-5c25-4b08-aeb5-200d8cc2ac6c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:52.989231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd3806-5c25-4b08-aeb5-200d8cc2ac6c None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:52.989231 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 389/764] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:52.989231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd3806-5c25-4b08-aeb5-200d8cc2ac6c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:53.043856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:53.067026 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34db07d-41e1-4c4a-a3af-512bd3bcac3a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:53.100088 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:53.116927 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62771ee1-5bca-424f-993e-854a7b5b8241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:53.117236 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd3806-5c25-4b08-aeb5-200d8cc2ac6c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:53.117807 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62771ee1-5bca-424f-993e-854a7b5b8241 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:53.118211 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62771ee1-5bca-424f-993e-854a7b5b8241 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:53.118558 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62771ee1-5bca-424f-993e-854a7b5b8241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:53.119368 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62771ee1-5bca-424f-993e-854a7b5b8241 None admin] RBAC: Adding query filter params (role.id=714239b608694824a75962d8cbb39f70, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=42dcae7ba3c241eb8d7d0894aadb467f) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:53.119740 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62771ee1-5bca-424f-993e-854a7b5b8241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:53.121984 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62771ee1-5bca-424f-993e-854a7b5b8241 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:53.128570 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 376/765] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:42:52 2022] GET /identity/v3/role_assignments?user.id=42dcae7ba3c241eb8d7d0894aadb467f&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=714239b608694824a75962d8cbb39f70 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:53.129446 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62771ee1-5bca-424f-993e-854a7b5b8241 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:53.180191 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2a3ee-95c0-472b-ac7d-43dadd4e7a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:53.181379 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2a3ee-95c0-472b-ac7d-43dadd4e7a3b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:53.181895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2a3ee-95c0-472b-ac7d-43dadd4e7a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:53.183313 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2a3ee-95c0-472b-ac7d-43dadd4e7a3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:53.197683 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2a3ee-95c0-472b-ac7d-43dadd4e7a3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:53.200243 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2a3ee-95c0-472b-ac7d-43dadd4e7a3b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:53.222793 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e8e2a3ee-95c0-472b-ac7d-43dadd4e7a3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:53.222793 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:53.222793 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:53.222793 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:53.222793 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:53.222793 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:53.222793 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:53.222793 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:53.222793 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:53.222793 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:53.222793 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:53.222793 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:53.222793 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:53.222793 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:53.222793 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:53.222793 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:53.223898 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:53.223898 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:53.223898 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:53.223898 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:53.223898 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:53.223898 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:53.223898 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:53.223898 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:53.223898 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:53.223898 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:53.223898 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:53.223898 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:53.223898 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:53.223898 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:53.223898 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:53.223898 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:53.223898 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:53.224982 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:53.224982 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:53.224982 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:53.227738 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 390/766] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:53.230228 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021380c-96df-44de-a242-fc3fbeb3c6b1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:53.230791 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021380c-96df-44de-a242-fc3fbeb3c6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:53.231290 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021380c-96df-44de-a242-fc3fbeb3c6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:53.256173 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c021380c-96df-44de-a242-fc3fbeb3c6b1 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:53.259280 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c021380c-96df-44de-a242-fc3fbeb3c6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:53.341803 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62771ee1-5bca-424f-993e-854a7b5b8241 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:53.366516 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 391/767] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:42:53.368282 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021380c-96df-44de-a242-fc3fbeb3c6b1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:53.425750 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b4522-853f-42f9-8885-c3367af8ce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:53.426831 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b4522-853f-42f9-8885-c3367af8ce75 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:53.427297 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b4522-853f-42f9-8885-c3367af8ce75 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:53.427755 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b4522-853f-42f9-8885-c3367af8ce75 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:53.429148 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b4522-853f-42f9-8885-c3367af8ce75 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:53.429743 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b4522-853f-42f9-8885-c3367af8ce75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:53.433073 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b4522-853f-42f9-8885-c3367af8ce75 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:53.444172 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 377/768] 10.222.0.26 () {56 vars in 1124 bytes} [Sun Oct 2 00:42:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:53.457452 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b4522-853f-42f9-8885-c3367af8ce75 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:53.497631 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:53.515068 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:53.574769 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021380c-96df-44de-a242-fc3fbeb3c6b1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:53.657098 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d92ed-9c3d-4888-bfa5-c813ae401e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:53.658613 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d92ed-9c3d-4888-bfa5-c813ae401e94 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:53.659398 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d92ed-9c3d-4888-bfa5-c813ae401e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:53.660156 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d92ed-9c3d-4888-bfa5-c813ae401e94 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:53.661708 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d92ed-9c3d-4888-bfa5-c813ae401e94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:53.662649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d92ed-9c3d-4888-bfa5-c813ae401e94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:53.672983 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d92ed-9c3d-4888-bfa5-c813ae401e94 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:53.673284 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b4522-853f-42f9-8885-c3367af8ce75 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:53.692428 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 392/769] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:53.694049 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d92ed-9c3d-4888-bfa5-c813ae401e94 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:53.724181 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6295f5-b0e3-4e9c-9636-4de5bf947252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:53.724801 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6295f5-b0e3-4e9c-9636-4de5bf947252 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:53.725159 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6295f5-b0e3-4e9c-9636-4de5bf947252 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:53.725490 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6295f5-b0e3-4e9c-9636-4de5bf947252 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:53.726135 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6295f5-b0e3-4e9c-9636-4de5bf947252 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:53.726436 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6295f5-b0e3-4e9c-9636-4de5bf947252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:53.727969 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6295f5-b0e3-4e9c-9636-4de5bf947252 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:53.734314 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 378/770] 10.222.0.26 () {56 vars in 1124 bytes} [Sun Oct 2 00:42:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:53.735188 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6295f5-b0e3-4e9c-9636-4de5bf947252 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:53.861767 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:53.881756 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d92ed-9c3d-4888-bfa5-c813ae401e94 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:53.884053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6295f5-b0e3-4e9c-9636-4de5bf947252 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:53.917563 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:53.923449 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5f99a-1d06-476b-9d01-17eb5ca620c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:53.924101 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5f99a-1d06-476b-9d01-17eb5ca620c5 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:53.924400 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5f99a-1d06-476b-9d01-17eb5ca620c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:53.924644 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5f99a-1d06-476b-9d01-17eb5ca620c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:53.927060 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad8f30-0e31-4bc7-9ff3-432541e7e679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:53.928197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad8f30-0e31-4bc7-9ff3-432541e7e679 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:53.928752 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad8f30-0e31-4bc7-9ff3-432541e7e679 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:53.929286 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad8f30-0e31-4bc7-9ff3-432541e7e679 None admin] PATH_INFO: `/v3/services/network` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:53.930335 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad8f30-0e31-4bc7-9ff3-432541e7e679 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:53.932050 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad8f30-0e31-4bc7-9ff3-432541e7e679 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:53.933500 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5f99a-1d06-476b-9d01-17eb5ca620c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:53.935053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5f99a-1d06-476b-9d01-17eb5ca620c5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:53.944123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-76ad8f30-0e31-4bc7-9ff3-432541e7e679 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 02 00:42:53.944123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:53.944123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:42:53.944123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:42:53.944123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:42:53.944123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:42:53.944123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:42:53.944123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:42:53.944123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 02 00:42:53.944123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:53.944123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:42:53.944123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:53.944123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:53.944123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:53.944123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:53.944123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:53.944123 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:53.945272 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:53.945272 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:53.945272 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:53.945272 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:53.945272 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:53.945272 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:53.945272 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:42:53.945272 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:42:53.945272 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:42:53.945272 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:42:53.945272 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:53.945272 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:53.945272 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:53.945272 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:53.945272 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:53.945272 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:53.946120 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:53.946120 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:53.946120 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:53.946120 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:53.946120 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:53.946120 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:53.946120 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:53.946120 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:53.946120 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:53.946120 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:53.946120 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:42:53.946120 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:42:53.946120 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 02 00:42:53.946120 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:53.948710 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-83c5f99a-1d06-476b-9d01-17eb5ca620c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:53.948710 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:53.948710 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:53.948710 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:53.948710 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:53.948710 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:53.948710 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:53.948710 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:53.948710 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:53.948710 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:53.948710 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:53.948710 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:53.948710 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:53.948710 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:53.948710 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:53.949677 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:53.949677 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:53.949677 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:53.949677 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:53.949677 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:53.949677 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:53.949677 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:53.949677 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:53.949677 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:53.949677 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:53.949677 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:53.949677 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:53.949677 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:53.949677 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:53.949677 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:53.949677 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:53.949677 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:53.950603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:53.950603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:53.950603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:53.950603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:53.950603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:53.950603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:53.950603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:53.950603 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:53.957386 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 379/772] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:53.957386 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5f99a-1d06-476b-9d01-17eb5ca620c5 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:53.957642 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 393/772] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:53 2022] GET /identity/v3/services/network => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:53.958672 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad8f30-0e31-4bc7-9ff3-432541e7e679 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:54.090401 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5f99a-1d06-476b-9d01-17eb5ca620c5 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:54.095915 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad8f30-0e31-4bc7-9ff3-432541e7e679 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:54.134738 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dcfa0-04f7-4303-9a30-44c90bd0f700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:54.136244 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dcfa0-04f7-4303-9a30-44c90bd0f700 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:54.136726 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dcfa0-04f7-4303-9a30-44c90bd0f700 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:54.137385 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dcfa0-04f7-4303-9a30-44c90bd0f700 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:54.138593 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dcfa0-04f7-4303-9a30-44c90bd0f700 None admin] RBAC: Adding query filter params (interface=public, service_id=475e6f861f244b4f86b8fac33689963a, region_id=RegionOne) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:54.139077 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dcfa0-04f7-4303-9a30-44c90bd0f700 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:54.140772 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dcfa0-04f7-4303-9a30-44c90bd0f700 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:54.141130 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f98878-b2ce-462f-b280-1adc79227386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:54.141862 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f98878-b2ce-462f-b280-1adc79227386 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:54.141998 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f98878-b2ce-462f-b280-1adc79227386 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:54.142285 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f98878-b2ce-462f-b280-1adc79227386 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:54.142977 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f98878-b2ce-462f-b280-1adc79227386 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:54.143277 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f98878-b2ce-462f-b280-1adc79227386 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:54.144764 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f98878-b2ce-462f-b280-1adc79227386 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:54.157582 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 380/773] 10.222.0.26 () {56 vars in 1251 bytes} [Sun Oct 2 00:42:53 2022] GET /identity/v3/endpoints?service_id=475e6f861f244b4f86b8fac33689963a&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:54.157582 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dcfa0-04f7-4303-9a30-44c90bd0f700 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:54.159487 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:54.167861 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 394/774] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:54.169413 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b652a-f042-4feb-a858-035fe188d881 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:54.169890 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b652a-f042-4feb-a858-035fe188d881 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:54.170324 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b652a-f042-4feb-a858-035fe188d881 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:54.171962 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 395/775] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:54.178914 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b652a-f042-4feb-a858-035fe188d881 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:54.261106 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:54.300352 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dcfa0-04f7-4303-9a30-44c90bd0f700 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:54.342689 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1b9cb-0b47-461c-adf4-83e9bc9cd5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:54.343316 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1b9cb-0b47-461c-adf4-83e9bc9cd5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:54.343597 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1b9cb-0b47-461c-adf4-83e9bc9cd5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:54.343869 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1b9cb-0b47-461c-adf4-83e9bc9cd5d7 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:54.344534 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1b9cb-0b47-461c-adf4-83e9bc9cd5d7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:54.344841 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1b9cb-0b47-461c-adf4-83e9bc9cd5d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:54.346332 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1b9cb-0b47-461c-adf4-83e9bc9cd5d7 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:54.356605 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 381/776] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Oct 2 00:42:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:54.356605 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1b9cb-0b47-461c-adf4-83e9bc9cd5d7 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:54.360614 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b652a-f042-4feb-a858-035fe188d881 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:54.414449 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f9879-593b-4271-8687-993edf21fa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:54.415165 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f9879-593b-4271-8687-993edf21fa22 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:54.415503 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f9879-593b-4271-8687-993edf21fa22 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:54.416284 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f9879-593b-4271-8687-993edf21fa22 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:54.416770 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f9879-593b-4271-8687-993edf21fa22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:54.418729 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f9879-593b-4271-8687-993edf21fa22 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:54.436988 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 396/777] 10.222.0.26 () {56 vars in 1087 bytes} [Sun Oct 2 00:42:54 2022] GET /identity/v3/services => generated 772 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:54.436988 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37b9a6-ce38-4cd0-a26e-cd148ba1dfd7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:54.436988 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37b9a6-ce38-4cd0-a26e-cd148ba1dfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:54.436988 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37b9a6-ce38-4cd0-a26e-cd148ba1dfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:54.449192 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-fe37b9a6-ce38-4cd0-a26e-cd148ba1dfd7 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:54.450741 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fe37b9a6-ce38-4cd0-a26e-cd148ba1dfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:54.468040 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:54.532738 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1b9cb-0b47-461c-adf4-83e9bc9cd5d7 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:54.556974 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 397/778] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:42:54.556974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37b9a6-ce38-4cd0-a26e-cd148ba1dfd7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:54.618299 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b5a1a-1cdc-4432-a7a9-395a55d0775a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:54.618988 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b5a1a-1cdc-4432-a7a9-395a55d0775a None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:54.619270 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b5a1a-1cdc-4432-a7a9-395a55d0775a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:54.619541 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b5a1a-1cdc-4432-a7a9-395a55d0775a None admin] PATH_INFO: `/v3/projects/7aec935005514f808eb735bfb01fee6e/users/81e0396b7ba341ce8d02b1a149786d95/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:54.627194 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b5a1a-1cdc-4432-a7a9-395a55d0775a None admin] RBAC: Authorizing `identity:create_grant(project_id=7aec935005514f808eb735bfb01fee6e, user_id=81e0396b7ba341ce8d02b1a149786d95, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:54.628380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b5a1a-1cdc-4432-a7a9-395a55d0775a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:54.655989 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 382/779] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:42:54 2022] PUT /identity/v3/projects/7aec935005514f808eb735bfb01fee6e/users/81e0396b7ba341ce8d02b1a149786d95/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:42:54.658225 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:54.741081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37b9a6-ce38-4cd0-a26e-cd148ba1dfd7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:54.802405 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcb19e-937f-4b25-bf75-ec3b25f0e52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:54.803044 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcb19e-937f-4b25-bf75-ec3b25f0e52b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:54.803323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcb19e-937f-4b25-bf75-ec3b25f0e52b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:54.803595 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcb19e-937f-4b25-bf75-ec3b25f0e52b None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:54.804327 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcb19e-937f-4b25-bf75-ec3b25f0e52b None admin] RBAC: Adding query filter params (type=network) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:54.804630 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcb19e-937f-4b25-bf75-ec3b25f0e52b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:54.806167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcb19e-937f-4b25-bf75-ec3b25f0e52b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:54.813656 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 398/780] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Oct 2 00:42:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:54.820165 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b5a1a-1cdc-4432-a7a9-395a55d0775a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:54.900640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcb19e-937f-4b25-bf75-ec3b25f0e52b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:54.983584 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b5a1a-1cdc-4432-a7a9-395a55d0775a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:55.052126 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:55.076495 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe92aa-ff75-4908-a4bc-fa162d041ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:55.077568 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe92aa-ff75-4908-a4bc-fa162d041ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:55.078044 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe92aa-ff75-4908-a4bc-fa162d041ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:55.078800 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe92aa-ff75-4908-a4bc-fa162d041ce0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:55.079786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe92aa-ff75-4908-a4bc-fa162d041ce0 None admin] RBAC: Adding query filter params (interface=public, service_id=1997985ef6b34799bb0723526588f6c5, region_id=RegionOne) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:55.080291 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe92aa-ff75-4908-a4bc-fa162d041ce0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:55.082949 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe92aa-ff75-4908-a4bc-fa162d041ce0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:55.091040 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcb19e-937f-4b25-bf75-ec3b25f0e52b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:55.093755 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 383/781] 10.222.0.26 () {56 vars in 1251 bytes} [Sun Oct 2 00:42:54 2022] GET /identity/v3/endpoints?service_id=1997985ef6b34799bb0723526588f6c5&interface=public®ion_id=RegionOne => generated 194 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:55.103478 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe92aa-ff75-4908-a4bc-fa162d041ce0 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:55.117742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:55.145346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69e4dd-df98-4d9f-a212-e852adc46c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:55.146332 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69e4dd-df98-4d9f-a212-e852adc46c3a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:55.146520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69e4dd-df98-4d9f-a212-e852adc46c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:55.146837 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69e4dd-df98-4d9f-a212-e852adc46c3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:55.160804 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69e4dd-df98-4d9f-a212-e852adc46c3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:55.167774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-7b69e4dd-df98-4d9f-a212-e852adc46c3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:42:55.167774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:55.167774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:55.167774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:55.167774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:55.167774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:55.167774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:55.167774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:55.167774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:55.167774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:55.167774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:55.167774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:55.167774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:55.167774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:55.167774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:55.167774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:55.169984 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:55.169984 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:55.169984 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:55.169984 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:55.169984 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:55.169984 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:55.169984 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:55.169984 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:55.169984 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:55.169984 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:55.169984 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:55.169984 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:55.169984 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:55.169984 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:55.169984 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:55.169984 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:55.172169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:55.172169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:55.172169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:55.172169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:55.172169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:55.172169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:55.172169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:55.172169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:55.172169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:55.172169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:55.172169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:42:55.172169 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:55.172169 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 399/782] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:42:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:42:55.177018 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69e4dd-df98-4d9f-a212-e852adc46c3a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:55.289959 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe92aa-ff75-4908-a4bc-fa162d041ce0 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:55.345431 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69e4dd-df98-4d9f-a212-e852adc46c3a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:55.362136 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905f9e4-1b63-44b5-95aa-3dbc64d96dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:55.363726 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905f9e4-1b63-44b5-95aa-3dbc64d96dcf None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:55.364475 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905f9e4-1b63-44b5-95aa-3dbc64d96dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:55.365257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905f9e4-1b63-44b5-95aa-3dbc64d96dcf None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:55.366658 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905f9e4-1b63-44b5-95aa-3dbc64d96dcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:55.369515 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905f9e4-1b63-44b5-95aa-3dbc64d96dcf None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:55.387722 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ec5ce-581a-4e80-8431-155b31d4f378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:55.388608 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ec5ce-581a-4e80-8431-155b31d4f378 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:55.388884 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ec5ce-581a-4e80-8431-155b31d4f378 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:55.389181 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ec5ce-581a-4e80-8431-155b31d4f378 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:55.389852 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ec5ce-581a-4e80-8431-155b31d4f378 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:55.390153 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ec5ce-581a-4e80-8431-155b31d4f378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:55.391539 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ec5ce-581a-4e80-8431-155b31d4f378 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:55.401741 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 384/783] 10.222.0.26 () {56 vars in 1087 bytes} [Sun Oct 2 00:42:55 2022] GET /identity/v3/services => generated 772 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:42:55.418986 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 400/784] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:42:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:42:55.419568 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905f9e4-1b63-44b5-95aa-3dbc64d96dcf None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:55.578788 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:55.683698 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905f9e4-1b63-44b5-95aa-3dbc64d96dcf None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:55.753208 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350382b0-e93f-4bc2-9738-b64991d478ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:55.754243 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350382b0-e93f-4bc2-9738-b64991d478ad None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:55.754682 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350382b0-e93f-4bc2-9738-b64991d478ad None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:55.755151 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350382b0-e93f-4bc2-9738-b64991d478ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:55.775797 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350382b0-e93f-4bc2-9738-b64991d478ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:55.779086 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350382b0-e93f-4bc2-9738-b64991d478ad None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:55.809274 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-350382b0-e93f-4bc2-9738-b64991d478ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:55.809274 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:55.809274 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:55.809274 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:55.809274 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:55.809274 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:55.809274 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:55.809274 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:55.809274 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:55.809274 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:55.809274 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:55.809274 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:55.809274 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:55.809274 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:55.809274 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:55.809274 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:55.811073 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:55.811073 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:55.811073 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:55.811073 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:55.811073 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:55.811073 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:55.811073 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:55.811073 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:55.811073 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:55.811073 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:55.811073 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:55.811073 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:55.811073 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:55.811073 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:55.811073 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:55.811073 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:55.811073 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:55.814704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:55.814704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:55.814704 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:55.814704 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 385/785] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:55.820458 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ec5ce-581a-4e80-8431-155b31d4f378 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:55.886724 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:56.023465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ec5ce-581a-4e80-8431-155b31d4f378 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:56.093509 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28267f83-8133-4436-9837-807a7fc3bb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:56.094572 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28267f83-8133-4436-9837-807a7fc3bb9a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:56.095047 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28267f83-8133-4436-9837-807a7fc3bb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:56.095521 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28267f83-8133-4436-9837-807a7fc3bb9a None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:56.096711 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28267f83-8133-4436-9837-807a7fc3bb9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:56.097269 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28267f83-8133-4436-9837-807a7fc3bb9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:56.099816 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28267f83-8133-4436-9837-807a7fc3bb9a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:56.124025 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 401/786] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:56.132981 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350382b0-e93f-4bc2-9738-b64991d478ad None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:56.351676 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350382b0-e93f-4bc2-9738-b64991d478ad None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:56.374169 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:56.449956 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048ec81-2c60-4b51-b2c8-de802edb5f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:56.451062 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048ec81-2c60-4b51-b2c8-de802edb5f69 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:56.451556 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048ec81-2c60-4b51-b2c8-de802edb5f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:56.452050 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048ec81-2c60-4b51-b2c8-de802edb5f69 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:56.466451 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048ec81-2c60-4b51-b2c8-de802edb5f69 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:56.469161 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048ec81-2c60-4b51-b2c8-de802edb5f69 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:56.495045 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-f048ec81-2c60-4b51-b2c8-de802edb5f69 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:42:56.495045 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:56.495045 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:56.495045 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:56.495045 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:56.495045 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:56.495045 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:56.495045 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:56.495045 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:56.495045 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:56.495045 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:56.495045 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:56.495045 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:56.495045 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:56.495045 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:56.495045 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:56.497090 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:56.497090 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:56.497090 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:56.497090 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:56.497090 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:56.497090 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:56.497090 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:56.497090 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:56.497090 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:56.497090 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:56.497090 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:56.497090 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:56.497090 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:56.497090 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:56.497090 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:56.497090 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:56.497090 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:56.497090 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:56.500218 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:56.500218 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:56.500218 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:56.500218 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:56.500218 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:56.500218 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:56.500218 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:56.500218 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:56.500218 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:42:56.500218 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:56.500218 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 386/787] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:42:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:56.506847 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28267f83-8133-4436-9837-807a7fc3bb9a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:56.706458 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:56.718424 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28267f83-8133-4436-9837-807a7fc3bb9a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:56.804836 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bf939-e0de-4c10-9672-2423a2ada957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:56.805890 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bf939-e0de-4c10-9672-2423a2ada957 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:56.806376 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bf939-e0de-4c10-9672-2423a2ada957 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:56.806851 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bf939-e0de-4c10-9672-2423a2ada957 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:56.809102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072bf939-e0de-4c10-9672-2423a2ada957 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:56.809636 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072bf939-e0de-4c10-9672-2423a2ada957 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:56.812441 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072bf939-e0de-4c10-9672-2423a2ada957 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:56.858175 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 402/788] 10.222.0.26 () {56 vars in 1135 bytes} [Sun Oct 2 00:42:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:42:56.866980 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048ec81-2c60-4b51-b2c8-de802edb5f69 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:57.067706 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048ec81-2c60-4b51-b2c8-de802edb5f69 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:57.125092 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad49598-1051-4ec7-b0f1-a6b27c8f0bde None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:57.125620 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad49598-1051-4ec7-b0f1-a6b27c8f0bde None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:57.126015 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad49598-1051-4ec7-b0f1-a6b27c8f0bde None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:57.126994 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ec916-b817-407d-bac6-b66de644ce25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:57.127638 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ec916-b817-407d-bac6-b66de644ce25 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:57.127916 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ec916-b817-407d-bac6-b66de644ce25 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:57.128181 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ec916-b817-407d-bac6-b66de644ce25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:57.128868 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 403/789] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:42:57.139639 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ff4c4-440d-4599-b8ab-b78956658960 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:57.140565 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ff4c4-440d-4599-b8ab-b78956658960 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:57.141526 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ff4c4-440d-4599-b8ab-b78956658960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:57.147891 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ec916-b817-407d-bac6-b66de644ce25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:57.149388 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ec916-b817-407d-bac6-b66de644ce25 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:57.174567 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-1a3ec916-b817-407d-bac6-b66de644ce25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:57.174567 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:57.174567 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:57.174567 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:57.174567 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:57.174567 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:57.174567 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:57.174567 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:57.174567 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:57.174567 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:57.174567 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:57.174567 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:57.174567 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:57.174567 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:57.174567 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:57.174567 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:57.176825 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:57.176825 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:57.176825 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:57.176825 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:57.176825 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:57.176825 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:57.176825 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:57.176825 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:57.176825 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:57.176825 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:57.176825 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:57.176825 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:57.176825 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:57.176825 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:57.176825 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:57.176825 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:57.176825 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:57.179015 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:57.179015 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:57.179015 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:57.179927 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 387/790] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:57.183526 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-837ff4c4-440d-4599-b8ab-b78956658960 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:57.186021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ec916-b817-407d-bac6-b66de644ce25 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:57.186676 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-837ff4c4-440d-4599-b8ab-b78956658960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:57.247613 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:57.335527 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 404/791] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:42:57.412537 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ec916-b817-407d-bac6-b66de644ce25 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:57.462010 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb0707-efd8-4568-8d0c-22ede0daabc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:57.462624 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb0707-efd8-4568-8d0c-22ede0daabc2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:57.462918 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb0707-efd8-4568-8d0c-22ede0daabc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:57.463174 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb0707-efd8-4568-8d0c-22ede0daabc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:57.463933 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb0707-efd8-4568-8d0c-22ede0daabc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:57.464473 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb0707-efd8-4568-8d0c-22ede0daabc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:57.465936 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb0707-efd8-4568-8d0c-22ede0daabc2 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:57.486999 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 388/792] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:57.495341 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ff4c4-440d-4599-b8ab-b78956658960 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:57.655274 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:57.701211 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ff4c4-440d-4599-b8ab-b78956658960 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:57.788311 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09648c-3a24-42ea-89cf-3b435c2b8ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:57.789386 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09648c-3a24-42ea-89cf-3b435c2b8ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:57.789834 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09648c-3a24-42ea-89cf-3b435c2b8ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:57.790272 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09648c-3a24-42ea-89cf-3b435c2b8ca6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:57.796352 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb0707-efd8-4568-8d0c-22ede0daabc2 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:57.807722 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09648c-3a24-42ea-89cf-3b435c2b8ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:57.809887 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09648c-3a24-42ea-89cf-3b435c2b8ca6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:57.850575 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-5d09648c-3a24-42ea-89cf-3b435c2b8ca6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:57.850575 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:57.850575 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:57.850575 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:57.850575 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:57.850575 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:57.850575 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:57.850575 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:57.850575 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:57.850575 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:57.850575 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:57.850575 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:57.850575 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:42:57.850575 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:42:57.850575 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:42:57.851568 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:42:57.851568 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:57.851568 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:57.851568 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:57.851568 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:57.851568 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:57.851568 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:57.851568 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:57.851568 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:57.851568 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:57.851568 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:57.851568 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:57.851568 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:57.851568 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:57.851568 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:57.851568 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:57.851568 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:57.852509 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:42:57.852509 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:42:57.852509 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:42:57.852509 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:42:57.852509 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:42:57.852509 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:42:57.852509 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:42:57.852509 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:57.852975 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 405/793] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:42:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:57.863093 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09648c-3a24-42ea-89cf-3b435c2b8ca6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:58.042102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09648c-3a24-42ea-89cf-3b435c2b8ca6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:58.061156 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:58.102569 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb0707-efd8-4568-8d0c-22ede0daabc2 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:58.114783 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd39f51-a9ee-4384-a05c-66805540b2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:58.115451 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd39f51-a9ee-4384-a05c-66805540b2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:58.115737 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd39f51-a9ee-4384-a05c-66805540b2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:58.116013 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd39f51-a9ee-4384-a05c-66805540b2d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:58.116741 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd39f51-a9ee-4384-a05c-66805540b2d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:58.117048 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd39f51-a9ee-4384-a05c-66805540b2d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:58.118507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd39f51-a9ee-4384-a05c-66805540b2d7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:58.133576 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 406/794] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:42:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:58.143001 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd39f51-a9ee-4384-a05c-66805540b2d7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:58.154117 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:58.224087 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e34b1e-e1f7-41cf-8562-b41d5a7724c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:58.225160 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e34b1e-e1f7-41cf-8562-b41d5a7724c8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:58.225646 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e34b1e-e1f7-41cf-8562-b41d5a7724c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:58.226123 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e34b1e-e1f7-41cf-8562-b41d5a7724c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:58.269140 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e34b1e-e1f7-41cf-8562-b41d5a7724c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:42:58.279294 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-15e34b1e-e1f7-41cf-8562-b41d5a7724c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:58.279294 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:58.279294 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:58.279294 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:58.279294 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:58.279294 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:58.279294 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:58.279294 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:58.279294 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:58.279294 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:58.279294 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:58.279294 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:58.279294 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:42:58.279294 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:42:58.279294 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:42:58.279294 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:42:58.281569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:42:58.281569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:42:58.281569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:42:58.281569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:42:58.281569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:58.281569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:58.281569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:58.281569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:58.281569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:58.281569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:58.281569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:58.281569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:58.281569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:58.281569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:58.281569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:58.281569 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:58.282572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:58.282572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:58.282572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:58.282572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:58.282572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:42:58.282572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:42:58.282572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:42:58.282572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:42:58.282572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:42:58.282572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:42:58.282572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:42:58.282572 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:58.282572 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 389/795] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:42:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 486 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:42:58.294648 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e34b1e-e1f7-41cf-8562-b41d5a7724c8 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:58.435950 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd39f51-a9ee-4384-a05c-66805540b2d7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:58.481970 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a8b7f-9299-42a7-8d20-b1edc66bb3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:58.483085 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a8b7f-9299-42a7-8d20-b1edc66bb3d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:58.483626 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a8b7f-9299-42a7-8d20-b1edc66bb3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:58.484098 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a8b7f-9299-42a7-8d20-b1edc66bb3d6 None admin] PATH_INFO: `/v3/projects/7aec935005514f808eb735bfb01fee6e/users/2784579d2ddf4cc99fe0e1d109e5cdda/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:58.486617 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a8b7f-9299-42a7-8d20-b1edc66bb3d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7aec935005514f808eb735bfb01fee6e, user_id=2784579d2ddf4cc99fe0e1d109e5cdda, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:58.488409 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a8b7f-9299-42a7-8d20-b1edc66bb3d6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:58.502765 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e34b1e-e1f7-41cf-8562-b41d5a7724c8 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:58.508866 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 407/796] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:42:58 2022] PUT /identity/v3/projects/7aec935005514f808eb735bfb01fee6e/users/2784579d2ddf4cc99fe0e1d109e5cdda/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:42:58.515595 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb4ce2-7820-4909-b518-36d6932042a3 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:58.516229 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb4ce2-7820-4909-b518-36d6932042a3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:58.516739 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb4ce2-7820-4909-b518-36d6932042a3 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:58.518856 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 408/797] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:58.525406 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28ccb3-4c72-47e3-8a28-87a7c913396d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:58.525997 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28ccb3-4c72-47e3-8a28-87a7c913396d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:58.526448 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28ccb3-4c72-47e3-8a28-87a7c913396d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:58.574374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3a28ccb3-4c72-47e3-8a28-87a7c913396d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:58.581180 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3a28ccb3-4c72-47e3-8a28-87a7c913396d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:58.605848 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9417aa-89af-4e92-a4c1-68e3ed28ff2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:58.611450 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9417aa-89af-4e92-a4c1-68e3ed28ff2c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:58.611941 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9417aa-89af-4e92-a4c1-68e3ed28ff2c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:58.612404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9417aa-89af-4e92-a4c1-68e3ed28ff2c None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:58.613747 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9417aa-89af-4e92-a4c1-68e3ed28ff2c None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:58.614308 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9417aa-89af-4e92-a4c1-68e3ed28ff2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:58.618734 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9417aa-89af-4e92-a4c1-68e3ed28ff2c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:58.656858 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 390/798] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:42:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:58.661283 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9417aa-89af-4e92-a4c1-68e3ed28ff2c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:58.670822 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:58.796148 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:58.812560 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 409/799] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:42:58.924651 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9417aa-89af-4e92-a4c1-68e3ed28ff2c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:58.989996 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecf1af-872d-42a0-a02e-87eaa0e32173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:58.991435 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecf1af-872d-42a0-a02e-87eaa0e32173 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:58.992148 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecf1af-872d-42a0-a02e-87eaa0e32173 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:58.996851 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecf1af-872d-42a0-a02e-87eaa0e32173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:59.018571 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecf1af-872d-42a0-a02e-87eaa0e32173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:59.021960 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecf1af-872d-42a0-a02e-87eaa0e32173 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:59.051078 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-45ecf1af-872d-42a0-a02e-87eaa0e32173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:59.051078 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:59.051078 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:59.051078 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:59.051078 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:59.051078 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:59.051078 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:59.051078 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:59.051078 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:59.051078 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:59.051078 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:59.051078 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:59.051078 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:42:59.051078 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:42:59.051078 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:42:59.051078 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:42:59.053210 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:59.053210 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:59.053210 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:59.053210 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:59.053210 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:59.053210 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:59.053210 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:59.053210 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:59.053210 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:59.053210 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:59.053210 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:59.053210 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:59.053210 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:59.053210 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:59.053210 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:59.053210 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:59.053210 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:42:59.055309 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:42:59.055309 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:42:59.055309 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:59.059136 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 391/800] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:42:59.064517 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28ccb3-4c72-47e3-8a28-87a7c913396d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:59.197989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28ccb3-4c72-47e3-8a28-87a7c913396d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:59.244829 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78801039-9eb2-4487-8422-149687c8123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:59.245725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78801039-9eb2-4487-8422-149687c8123a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:59.245821 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78801039-9eb2-4487-8422-149687c8123a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:59.246079 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78801039-9eb2-4487-8422-149687c8123a None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:59.246725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78801039-9eb2-4487-8422-149687c8123a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:59.247028 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78801039-9eb2-4487-8422-149687c8123a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:59.248535 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78801039-9eb2-4487-8422-149687c8123a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:59.267902 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 410/801] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:59.278796 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecf1af-872d-42a0-a02e-87eaa0e32173 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:59.421529 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:59.424609 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78801039-9eb2-4487-8422-149687c8123a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:59.474682 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecf1af-872d-42a0-a02e-87eaa0e32173 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:59.519580 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b6dd3-332f-445b-805d-1f57350f13dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:59.520226 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b6dd3-332f-445b-805d-1f57350f13dd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:59.520524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b6dd3-332f-445b-805d-1f57350f13dd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:59.520799 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b6dd3-332f-445b-805d-1f57350f13dd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:59.530496 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b6dd3-332f-445b-805d-1f57350f13dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:59.531983 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b6dd3-332f-445b-805d-1f57350f13dd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:59.546712 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-4b6b6dd3-332f-445b-805d-1f57350f13dd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:42:59.546712 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:59.546712 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:59.546712 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:59.546712 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:59.546712 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:59.546712 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:59.546712 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:59.546712 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:59.546712 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:59.546712 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:59.546712 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:59.546712 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:42:59.546712 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:42:59.546712 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:42:59.546712 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:42:59.547836 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:59.547836 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:59.547836 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:42:59.547836 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:59.547836 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:42:59.547836 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:42:59.547836 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:59.547836 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:59.547836 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:59.547836 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:59.547836 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:59.547836 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:59.547836 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:59.547836 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:59.547836 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:59.547836 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:59.547836 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:59.547836 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:59.548879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:59.548879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:59.548879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:42:59.548879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:42:59.548879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:42:59.548879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:42:59.548879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:42:59.548879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:42:59.548879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:42:59.548879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:42:59.548879 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 392/802] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Oct 2 00:42:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:59.549576 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968db1ed-0059-415d-be2b-41b2f2cbc5fb None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:59.554231 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968db1ed-0059-415d-be2b-41b2f2cbc5fb None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:59.554231 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968db1ed-0059-415d-be2b-41b2f2cbc5fb None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:59.554231 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 393/803] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:59.554554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:59.554637 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee726-b314-4ec9-b90e-e528b5efdf03 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:59.554637 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee726-b314-4ec9-b90e-e528b5efdf03 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:59.554637 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee726-b314-4ec9-b90e-e528b5efdf03 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:59.554820 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 394/804] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:42:59.555637 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beee726-b314-4ec9-b90e-e528b5efdf03 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:59.658008 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78801039-9eb2-4487-8422-149687c8123a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:59.699242 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beee726-b314-4ec9-b90e-e528b5efdf03 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:42:59.709814 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0802b-7914-4e28-b323-87a2e27345b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:59.710868 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0802b-7914-4e28-b323-87a2e27345b7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:59.711368 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0802b-7914-4e28-b323-87a2e27345b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:59.711842 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0802b-7914-4e28-b323-87a2e27345b7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:59.712905 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0802b-7914-4e28-b323-87a2e27345b7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:59.716296 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0802b-7914-4e28-b323-87a2e27345b7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:59.726700 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:42:59.733616 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-36e0802b-7914-4e28-b323-87a2e27345b7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 02 00:42:59.733616 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:59.733616 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:42:59.733616 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:42:59.733616 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:42:59.733616 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:42:59.733616 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:42:59.733616 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:42:59.733616 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 02 00:42:59.733616 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:59.733616 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:42:59.733616 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:59.733616 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:42:59.733616 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:42:59.733616 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:42:59.733616 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:42:59.733616 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:42:59.735742 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:42:59.735742 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:42:59.735742 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:42:59.735742 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:42:59.735742 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:42:59.735742 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:42:59.735742 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:42:59.735742 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:42:59.735742 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:42:59.735742 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:42:59.735742 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:42:59.735742 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:42:59.735742 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:42:59.735742 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:42:59.735742 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:42:59.735742 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:42:59.737614 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:42:59.737614 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:42:59.737614 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:42:59.737614 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:42:59.737614 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:42:59.737614 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:42:59.737614 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:42:59.737614 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:42:59.737614 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:42:59.737614 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:42:59.737614 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:42:59.737614 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:42:59.737614 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 02 00:42:59.737614 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:42:59.737614 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 411/805] 10.222.0.26 () {56 vars in 1129 bytes} [Sun Oct 2 00:42:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:42:59.745282 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8909c-94d1-4378-b8a7-69a0fc82f961 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:59.745282 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8909c-94d1-4378-b8a7-69a0fc82f961 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:59.745282 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8909c-94d1-4378-b8a7-69a0fc82f961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:59.769369 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aae5a7-7e55-404c-91f2-b17b51a13c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:42:59.770192 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aae5a7-7e55-404c-91f2-b17b51a13c12 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:59.770616 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aae5a7-7e55-404c-91f2-b17b51a13c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:59.771028 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aae5a7-7e55-404c-91f2-b17b51a13c12 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:59.771911 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aae5a7-7e55-404c-91f2-b17b51a13c12 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:42:59.772346 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aae5a7-7e55-404c-91f2-b17b51a13c12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:42:59.774463 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aae5a7-7e55-404c-91f2-b17b51a13c12 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:42:59.781695 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bfb8909c-94d1-4378-b8a7-69a0fc82f961 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:59.783840 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bfb8909c-94d1-4378-b8a7-69a0fc82f961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:59.805250 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 395/806] 10.222.0.26 () {56 vars in 1149 bytes} [Sun Oct 2 00:42:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:42:59.805250 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35475f90-1b21-4740-ab90-36a62b5e59a3 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:42:59.805250 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35475f90-1b21-4740-ab90-36a62b5e59a3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:42:59.805250 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35475f90-1b21-4740-ab90-36a62b5e59a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:42:59.824186 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-35475f90-1b21-4740-ab90-36a62b5e59a3 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:42:59.825484 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-35475f90-1b21-4740-ab90-36a62b5e59a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:42:59.905189 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 412/807] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:42:59.905189 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8909c-94d1-4378-b8a7-69a0fc82f961 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:42:59.954459 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 396/808] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:42:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:42:59.956017 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35475f90-1b21-4740-ab90-36a62b5e59a3 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:00.035824 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:00.137328 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8909c-94d1-4378-b8a7-69a0fc82f961 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:00.204871 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae75b2-659e-4d60-8ec4-d5a2591262ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:00.206456 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae75b2-659e-4d60-8ec4-d5a2591262ea None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:00.207187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae75b2-659e-4d60-8ec4-d5a2591262ea None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:00.207887 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae75b2-659e-4d60-8ec4-d5a2591262ea None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:00.209608 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae75b2-659e-4d60-8ec4-d5a2591262ea None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:00.210367 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae75b2-659e-4d60-8ec4-d5a2591262ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:00.213074 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae75b2-659e-4d60-8ec4-d5a2591262ea None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:00.224439 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 413/809] 10.222.0.26 () {56 vars in 1124 bytes} [Sun Oct 2 00:42:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:00.237094 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae75b2-659e-4d60-8ec4-d5a2591262ea None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:00.252657 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35475f90-1b21-4740-ab90-36a62b5e59a3 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:00.254393 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:00.323504 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09693200-3e29-41f5-a53b-b33610bc9c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:00.324537 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09693200-3e29-41f5-a53b-b33610bc9c92 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:00.324537 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09693200-3e29-41f5-a53b-b33610bc9c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:00.324793 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09693200-3e29-41f5-a53b-b33610bc9c92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:00.347558 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09693200-3e29-41f5-a53b-b33610bc9c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:00.349068 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09693200-3e29-41f5-a53b-b33610bc9c92 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:00.381879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-09693200-3e29-41f5-a53b-b33610bc9c92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:00.381879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:00.381879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:00.381879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:00.381879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:00.381879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:00.381879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:00.381879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:00.381879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:00.381879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:00.381879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:00.381879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:00.381879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:00.381879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:00.381879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:00.381879 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:00.384161 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:00.384161 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:00.384161 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:00.384161 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:00.384161 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:00.384161 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:00.384161 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:00.384161 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:00.384161 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:00.384161 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:00.384161 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:00.384161 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:00.384161 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:00.384161 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:00.384161 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:00.384161 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:00.384161 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:00.387821 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:00.387821 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:00.387821 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:00.387821 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 397/810] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:00.387821 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09693200-3e29-41f5-a53b-b33610bc9c92 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:00.456230 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae75b2-659e-4d60-8ec4-d5a2591262ea None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:00.469432 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:00.497125 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de70b75-6d1f-47bd-8f8a-b72ce4b9829b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:00.497738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de70b75-6d1f-47bd-8f8a-b72ce4b9829b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:00.498003 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de70b75-6d1f-47bd-8f8a-b72ce4b9829b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:00.498288 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de70b75-6d1f-47bd-8f8a-b72ce4b9829b None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:00.498900 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de70b75-6d1f-47bd-8f8a-b72ce4b9829b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:00.499197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de70b75-6d1f-47bd-8f8a-b72ce4b9829b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:00.500619 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de70b75-6d1f-47bd-8f8a-b72ce4b9829b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:00.506747 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 414/811] 10.222.0.26 () {56 vars in 1124 bytes} [Sun Oct 2 00:43:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:00.507599 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de70b75-6d1f-47bd-8f8a-b72ce4b9829b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:00.533349 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09693200-3e29-41f5-a53b-b33610bc9c92 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:00.575241 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16911b-30a2-4f4f-a22c-514ffa73ad5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:00.575696 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16911b-30a2-4f4f-a22c-514ffa73ad5e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:00.575971 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16911b-30a2-4f4f-a22c-514ffa73ad5e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:00.576237 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16911b-30a2-4f4f-a22c-514ffa73ad5e None admin] PATH_INFO: `/v3/services/network` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:00.576823 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16911b-30a2-4f4f-a22c-514ffa73ad5e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:00.578257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16911b-30a2-4f4f-a22c-514ffa73ad5e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:00.587558 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-1c16911b-30a2-4f4f-a22c-514ffa73ad5e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 02 00:43:00.587558 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:00.587558 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:43:00.587558 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:43:00.587558 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:43:00.587558 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:43:00.587558 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:43:00.587558 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:00.587558 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 02 00:43:00.587558 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:00.587558 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:00.587558 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:00.587558 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:00.587558 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:00.587558 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:00.587558 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:00.587558 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:00.589629 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:00.589629 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:00.589629 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:00.589629 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:00.589629 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:00.589629 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:00.589629 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:43:00.589629 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:43:00.589629 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:43:00.589629 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:43:00.589629 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:00.589629 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:00.589629 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:00.589629 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:00.589629 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:00.589629 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:00.590560 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:00.590560 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:00.590560 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:00.590560 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:00.590560 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:00.590560 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:00.590560 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:00.590560 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:00.590560 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:00.590560 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:00.590560 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:43:00.590560 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:00.590560 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 02 00:43:00.590560 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:00.594440 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 398/812] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:43:00 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:00.595397 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16911b-30a2-4f4f-a22c-514ffa73ad5e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:00.616396 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:00.688447 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de70b75-6d1f-47bd-8f8a-b72ce4b9829b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:00.733771 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16911b-30a2-4f4f-a22c-514ffa73ad5e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:00.745743 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9414d-08f2-4385-abd1-9f01e1f3e4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:00.746692 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9414d-08f2-4385-abd1-9f01e1f3e4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:00.747053 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9414d-08f2-4385-abd1-9f01e1f3e4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:00.747417 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9414d-08f2-4385-abd1-9f01e1f3e4e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:00.748384 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9414d-08f2-4385-abd1-9f01e1f3e4e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:00.748864 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9414d-08f2-4385-abd1-9f01e1f3e4e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:00.751170 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9414d-08f2-4385-abd1-9f01e1f3e4e2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:00.778414 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 415/813] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:00.778414 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9414d-08f2-4385-abd1-9f01e1f3e4e2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:00.795107 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9643e-4f0b-4255-8955-96bfa2f13cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:00.795761 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9643e-4f0b-4255-8955-96bfa2f13cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:00.796038 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9643e-4f0b-4255-8955-96bfa2f13cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:00.796309 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9643e-4f0b-4255-8955-96bfa2f13cb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:00.810263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9643e-4f0b-4255-8955-96bfa2f13cb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:43:00.815281 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-5db9643e-4f0b-4255-8955-96bfa2f13cb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:43:00.815281 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:00.815281 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:00.815281 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:00.815281 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:00.815281 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:00.815281 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:00.815281 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:00.815281 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:00.815281 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:00.815281 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:00.815281 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:00.815281 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:43:00.815281 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:43:00.815281 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:43:00.815281 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:43:00.816264 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:43:00.816264 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:43:00.816264 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:43:00.816264 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:43:00.816264 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:00.816264 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:00.816264 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:00.816264 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:00.816264 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:00.816264 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:00.816264 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:00.816264 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:00.816264 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:00.816264 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:00.816264 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:00.816264 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:00.817162 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:00.817162 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:00.817162 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:00.817162 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:00.817162 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:43:00.817162 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:43:00.817162 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:43:00.817162 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:43:00.817162 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:43:00.817162 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:43:00.817162 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:43:00.817162 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:00.817162 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 399/814] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:43:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:00.817907 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9643e-4f0b-4255-8955-96bfa2f13cb7 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:00.835230 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:00.919450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9414d-08f2-4385-abd1-9f01e1f3e4e2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:00.920930 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:00.949415 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9643e-4f0b-4255-8955-96bfa2f13cb7 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:00.970064 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa5c9d-405d-464a-9a15-7b9299c22704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:00.970784 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa5c9d-405d-464a-9a15-7b9299c22704 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:00.971141 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa5c9d-405d-464a-9a15-7b9299c22704 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:00.971477 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa5c9d-405d-464a-9a15-7b9299c22704 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:00.972427 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa5c9d-405d-464a-9a15-7b9299c22704 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:00.974228 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa5c9d-405d-464a-9a15-7b9299c22704 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:00.999060 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a53662-5708-413f-a5ef-cc5438114efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:00.999966 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a53662-5708-413f-a5ef-cc5438114efa None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:01.000364 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a53662-5708-413f-a5ef-cc5438114efa None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:01.000841 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a53662-5708-413f-a5ef-cc5438114efa None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:01.002104 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a53662-5708-413f-a5ef-cc5438114efa None admin] RBAC: Adding query filter params (name=network) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:01.002736 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a53662-5708-413f-a5ef-cc5438114efa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:01.005592 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a53662-5708-413f-a5ef-cc5438114efa None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:01.013902 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 416/815] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:43:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:43:01.013902 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa5c9d-405d-464a-9a15-7b9299c22704 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:01.016116 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 400/816] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Oct 2 00:43:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:01.025721 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a53662-5708-413f-a5ef-cc5438114efa None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:01.155534 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:01.192021 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa5c9d-405d-464a-9a15-7b9299c22704 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:01.214798 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a53662-5708-413f-a5ef-cc5438114efa None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:01.256601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65524f8c-9e89-431f-b2c4-a837dc2b3b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:01.257254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65524f8c-9e89-431f-b2c4-a837dc2b3b9f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:01.257536 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65524f8c-9e89-431f-b2c4-a837dc2b3b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:01.257876 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65524f8c-9e89-431f-b2c4-a837dc2b3b9f None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:01.258560 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65524f8c-9e89-431f-b2c4-a837dc2b3b9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:01.258865 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65524f8c-9e89-431f-b2c4-a837dc2b3b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:01.260498 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65524f8c-9e89-431f-b2c4-a837dc2b3b9f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:01.268450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9229c2-dc87-4f97-a093-9add982e663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:01.269256 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9229c2-dc87-4f97-a093-9add982e663c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:01.269941 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9229c2-dc87-4f97-a093-9add982e663c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:01.270372 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9229c2-dc87-4f97-a093-9add982e663c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:01.272066 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 401/817] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:43:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:01.273076 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65524f8c-9e89-431f-b2c4-a837dc2b3b9f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:01.279745 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:01.281422 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9229c2-dc87-4f97-a093-9add982e663c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:01.283418 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9229c2-dc87-4f97-a093-9add982e663c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:01.300331 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ee9229c2-dc87-4f97-a093-9add982e663c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:01.300331 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:01.300331 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:01.300331 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:01.300331 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:01.300331 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:01.300331 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:01.300331 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:01.300331 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:01.300331 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:01.300331 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:01.300331 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:01.300331 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:43:01.300331 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:43:01.300331 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:43:01.301426 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:43:01.301426 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:01.301426 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:01.301426 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:01.301426 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:01.301426 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:01.301426 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:01.301426 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:01.301426 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:01.301426 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:01.301426 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:01.301426 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:01.301426 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:01.301426 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:01.301426 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:01.301426 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:01.301426 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:01.302340 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:43:01.302340 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:43:01.302340 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:43:01.302340 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:43:01.302340 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:43:01.302340 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:43:01.302340 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:01.302340 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:01.303017 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 417/818] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:43:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:01.310115 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9229c2-dc87-4f97-a093-9add982e663c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:01.416253 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65524f8c-9e89-431f-b2c4-a837dc2b3b9f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:01.435571 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9229c2-dc87-4f97-a093-9add982e663c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:01.458083 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1574ab-2574-4272-b908-3e87d1f2a417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:01.459235 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1574ab-2574-4272-b908-3e87d1f2a417 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:01.459781 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1574ab-2574-4272-b908-3e87d1f2a417 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:01.460260 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1574ab-2574-4272-b908-3e87d1f2a417 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:01.461141 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1574ab-2574-4272-b908-3e87d1f2a417 None admin] RBAC: Adding query filter params (type=network) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:01.461667 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1574ab-2574-4272-b908-3e87d1f2a417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:01.463520 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1574ab-2574-4272-b908-3e87d1f2a417 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:01.470616 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 402/819] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Oct 2 00:43:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:01.471914 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1574ab-2574-4272-b908-3e87d1f2a417 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:01.488598 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fdb86-5864-4ba3-83d7-e07fd7e8b503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:01.489739 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fdb86-5864-4ba3-83d7-e07fd7e8b503 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:01.489739 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fdb86-5864-4ba3-83d7-e07fd7e8b503 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:01.490026 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fdb86-5864-4ba3-83d7-e07fd7e8b503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:01.503220 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fdb86-5864-4ba3-83d7-e07fd7e8b503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:01.504843 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fdb86-5864-4ba3-83d7-e07fd7e8b503 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:01.513483 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:01.524246 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-7f2fdb86-5864-4ba3-83d7-e07fd7e8b503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:01.524246 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:01.524246 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:01.524246 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:01.524246 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:01.524246 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:01.524246 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:01.524246 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:01.524246 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:01.524246 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:01.524246 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:01.524246 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:01.524246 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:01.524246 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:01.524246 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:01.524246 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:01.525311 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:01.525311 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:01.525311 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:01.525311 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:01.525311 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:01.525311 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:01.525311 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:01.525311 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:01.525311 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:01.525311 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:01.525311 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:01.525311 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:01.525311 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:01.525311 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:01.525311 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:01.525311 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:01.525311 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:01.527187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:01.527187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:01.527187 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:01.531687 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 418/820] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:01.532512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fdb86-5864-4ba3-83d7-e07fd7e8b503 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:01.563441 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:01.603822 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1574ab-2574-4272-b908-3e87d1f2a417 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:01.647212 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e793ff-b34a-4c21-95bf-38889914daaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:01.648263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e793ff-b34a-4c21-95bf-38889914daaa None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:01.648617 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e793ff-b34a-4c21-95bf-38889914daaa None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:01.648981 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e793ff-b34a-4c21-95bf-38889914daaa None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:01.650261 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e793ff-b34a-4c21-95bf-38889914daaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:01.650649 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e793ff-b34a-4c21-95bf-38889914daaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:01.653755 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e793ff-b34a-4c21-95bf-38889914daaa None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:01.659372 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fdb86-5864-4ba3-83d7-e07fd7e8b503 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:01.674253 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 403/821] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:43:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:01.674253 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e793ff-b34a-4c21-95bf-38889914daaa None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:01.708573 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bff993-3a01-4216-a066-3b1e738e2356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:01.709673 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bff993-3a01-4216-a066-3b1e738e2356 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:01.710188 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bff993-3a01-4216-a066-3b1e738e2356 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:01.710649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bff993-3a01-4216-a066-3b1e738e2356 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:01.711657 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bff993-3a01-4216-a066-3b1e738e2356 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:01.714563 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bff993-3a01-4216-a066-3b1e738e2356 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:01.745188 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 419/822] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:43:01 2022] POST /identity/v3/endpoints => generated 337 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:43:01.745188 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bff993-3a01-4216-a066-3b1e738e2356 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:01.841000 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e793ff-b34a-4c21-95bf-38889914daaa None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:01.864321 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:01.885934 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:01.904288 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cef543-f6ce-4b38-9aea-f3e0466187aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:01.905049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cef543-f6ce-4b38-9aea-f3e0466187aa None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:01.905332 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cef543-f6ce-4b38-9aea-f3e0466187aa None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:01.905603 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cef543-f6ce-4b38-9aea-f3e0466187aa None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:01.906337 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cef543-f6ce-4b38-9aea-f3e0466187aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:01.906637 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cef543-f6ce-4b38-9aea-f3e0466187aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:01.908103 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cef543-f6ce-4b38-9aea-f3e0466187aa None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:01.924206 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 404/823] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:01.925818 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491cf6f-af4d-4f69-b96b-7c9cd0554f53 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:01.926050 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491cf6f-af4d-4f69-b96b-7c9cd0554f53 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:01.926327 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491cf6f-af4d-4f69-b96b-7c9cd0554f53 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:01.927941 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 405/824] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:01.935258 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491cf6f-af4d-4f69-b96b-7c9cd0554f53 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:01.984702 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bff993-3a01-4216-a066-3b1e738e2356 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:02.055662 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1c69b-dcd8-45b2-88eb-27aa7c591b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:02.056821 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1c69b-dcd8-45b2-88eb-27aa7c591b0e None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:02.057865 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1c69b-dcd8-45b2-88eb-27aa7c591b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:02.058366 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1c69b-dcd8-45b2-88eb-27aa7c591b0e None admin] PATH_INFO: `/v3/projects/7aec935005514f808eb735bfb01fee6e/users/42dcae7ba3c241eb8d7d0894aadb467f/roles/714239b608694824a75962d8cbb39f70` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:02.069320 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491cf6f-af4d-4f69-b96b-7c9cd0554f53 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:02.092890 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1c69b-dcd8-45b2-88eb-27aa7c591b0e None admin] RBAC: Authorizing `identity:create_grant(project_id=7aec935005514f808eb735bfb01fee6e, user_id=42dcae7ba3c241eb8d7d0894aadb467f, role_id=714239b608694824a75962d8cbb39f70)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:02.096550 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1c69b-dcd8-45b2-88eb-27aa7c591b0e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:02.125165 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 420/825] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:43:01 2022] PUT /identity/v3/projects/7aec935005514f808eb735bfb01fee6e/users/42dcae7ba3c241eb8d7d0894aadb467f/roles/714239b608694824a75962d8cbb39f70 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:43:02.126017 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe38db-ee82-4c0b-8517-000dc1d53fe9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:02.126420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe38db-ee82-4c0b-8517-000dc1d53fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:02.126836 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe38db-ee82-4c0b-8517-000dc1d53fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:02.134810 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb72a61-d8c6-4738-a21b-49b92da80dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:02.136651 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb72a61-d8c6-4738-a21b-49b92da80dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:02.137622 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb72a61-d8c6-4738-a21b-49b92da80dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:02.138331 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb72a61-d8c6-4738-a21b-49b92da80dd7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:02.148748 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb72a61-d8c6-4738-a21b-49b92da80dd7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:02.152066 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb72a61-d8c6-4738-a21b-49b92da80dd7 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:02.160242 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9afe38db-ee82-4c0b-8517-000dc1d53fe9 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:02.162335 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9afe38db-ee82-4c0b-8517-000dc1d53fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:02.169244 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-ebb72a61-d8c6-4738-a21b-49b92da80dd7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:43:02.169244 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:02.169244 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:02.169244 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:02.169244 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:02.169244 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:02.169244 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:02.169244 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:02.169244 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:02.169244 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:02.169244 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:02.169244 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:02.169244 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:43:02.169244 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:43:02.169244 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:43:02.169244 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:43:02.170459 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:02.170459 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:02.170459 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:43:02.170459 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:02.170459 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:43:02.170459 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:02.170459 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:02.170459 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:02.170459 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:02.170459 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:02.170459 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:02.170459 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:02.170459 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:02.170459 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:02.170459 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:02.170459 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:02.170459 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:02.170459 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:02.171540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:02.171540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:02.171540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:43:02.171540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:43:02.171540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:43:02.171540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:43:02.171540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:43:02.171540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:43:02.171540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:43:02.171540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:02.173918 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 406/826] 10.222.0.26 () {56 vars in 1093 bytes} [Sun Oct 2 00:43:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:02.179744 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb72a61-d8c6-4738-a21b-49b92da80dd7 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:02.265080 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:02.304705 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 421/827] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:02.392612 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb72a61-d8c6-4738-a21b-49b92da80dd7 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:02.464504 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b4587-2315-4c7c-bd94-f8627b24208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:02.465515 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b4587-2315-4c7c-bd94-f8627b24208f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:02.466012 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b4587-2315-4c7c-bd94-f8627b24208f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:02.466491 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b4587-2315-4c7c-bd94-f8627b24208f None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:02.467876 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b4587-2315-4c7c-bd94-f8627b24208f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:02.468425 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b4587-2315-4c7c-bd94-f8627b24208f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:02.471279 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b4587-2315-4c7c-bd94-f8627b24208f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:02.499057 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 407/828] 10.222.0.26 () {56 vars in 1133 bytes} [Sun Oct 2 00:43:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:02.508336 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe38db-ee82-4c0b-8517-000dc1d53fe9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:02.574635 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:02.656655 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe38db-ee82-4c0b-8517-000dc1d53fe9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:02.680750 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b4587-2315-4c7c-bd94-f8627b24208f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:02.699463 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a58961-bce5-4fcf-b62a-94c5d6e9a42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:02.700494 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a58961-bce5-4fcf-b62a-94c5d6e9a42d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:02.701060 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a58961-bce5-4fcf-b62a-94c5d6e9a42d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:02.702108 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a58961-bce5-4fcf-b62a-94c5d6e9a42d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:02.791045 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a58961-bce5-4fcf-b62a-94c5d6e9a42d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:02.793091 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a58961-bce5-4fcf-b62a-94c5d6e9a42d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:02.834217 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:02.877401 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b4587-2315-4c7c-bd94-f8627b24208f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:02.880242 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:02.925969 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 422/829] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:43:02 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 02 00:43:02.936332 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a58961-bce5-4fcf-b62a-94c5d6e9a42d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:02.951682 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d3290-839d-42ff-86cf-7aad67b3baf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:02.953305 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d3290-839d-42ff-86cf-7aad67b3baf3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:02.954115 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d3290-839d-42ff-86cf-7aad67b3baf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:02.954879 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d3290-839d-42ff-86cf-7aad67b3baf3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:02.975785 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d3290-839d-42ff-86cf-7aad67b3baf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:43:02.987842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-618d3290-839d-42ff-86cf-7aad67b3baf3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:43:02.987842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:02.987842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:02.987842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:02.987842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:02.987842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:02.987842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:02.987842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:02.987842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:02.987842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:02.987842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:02.987842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:02.987842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:43:02.987842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:43:02.987842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:43:02.987842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:43:02.989746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:43:02.989746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:43:02.989746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:43:02.989746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:43:02.989746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:02.989746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:02.989746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:02.989746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:02.989746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:02.989746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:02.989746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:02.989746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:02.989746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:02.989746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:02.989746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:02.989746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:02.991479 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:02.991479 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:02.991479 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:02.991479 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:02.991479 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:43:02.991479 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:43:02.991479 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:43:02.991479 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:43:02.991479 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:43:02.991479 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:43:02.991479 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:43:02.991479 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:03.001430 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 408/830] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:43:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:03.006615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d3290-839d-42ff-86cf-7aad67b3baf3 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:03.056815 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a58961-bce5-4fcf-b62a-94c5d6e9a42d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:03.098850 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d579fcc-f4c2-4b28-879e-af0d74606c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:03.099503 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d579fcc-f4c2-4b28-879e-af0d74606c41 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:03.099792 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d579fcc-f4c2-4b28-879e-af0d74606c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:03.100041 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d579fcc-f4c2-4b28-879e-af0d74606c41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:03.102541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:03.115690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d579fcc-f4c2-4b28-879e-af0d74606c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:03.117292 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d579fcc-f4c2-4b28-879e-af0d74606c41 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:03.140699 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-8d579fcc-f4c2-4b28-879e-af0d74606c41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:03.140699 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:03.140699 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:03.140699 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:03.140699 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:03.140699 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:03.140699 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:03.140699 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:03.140699 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:03.140699 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:03.140699 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:03.140699 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:03.140699 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:03.140699 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:03.140699 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:03.140699 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:03.142417 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:03.142417 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:03.142417 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:03.142417 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:03.142417 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:03.142417 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:03.142417 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:03.142417 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:03.142417 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:03.142417 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:03.142417 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:03.142417 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:03.142417 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:03.142417 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:03.142417 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:03.142417 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:03.142417 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:03.144040 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:03.144040 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:03.144040 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:03.144040 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 423/831] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:03.154422 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d579fcc-f4c2-4b28-879e-af0d74606c41 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:03.195899 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d3290-839d-42ff-86cf-7aad67b3baf3 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:03.252984 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1896f-664e-4d33-a92f-8a636613bd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:03.254509 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1896f-664e-4d33-a92f-8a636613bd67 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:03.255292 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1896f-664e-4d33-a92f-8a636613bd67 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:03.256039 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1896f-664e-4d33-a92f-8a636613bd67 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:03.257635 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1896f-664e-4d33-a92f-8a636613bd67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:03.258533 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1896f-664e-4d33-a92f-8a636613bd67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:03.262004 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1896f-664e-4d33-a92f-8a636613bd67 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:03.285514 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 409/832] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:43:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:03.289093 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1896f-664e-4d33-a92f-8a636613bd67 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:03.298385 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d579fcc-f4c2-4b28-879e-af0d74606c41 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:03.342340 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:03.347218 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f04c55-2822-4121-98f5-fd0ff4bc70e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:03.348377 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f04c55-2822-4121-98f5-fd0ff4bc70e1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:03.348661 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f04c55-2822-4121-98f5-fd0ff4bc70e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:03.348954 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f04c55-2822-4121-98f5-fd0ff4bc70e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:03.350177 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f04c55-2822-4121-98f5-fd0ff4bc70e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:03.350497 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f04c55-2822-4121-98f5-fd0ff4bc70e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:03.352222 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f04c55-2822-4121-98f5-fd0ff4bc70e1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:03.372983 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 424/833] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:03.379851 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f04c55-2822-4121-98f5-fd0ff4bc70e1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:03.451491 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:03.462651 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1896f-664e-4d33-a92f-8a636613bd67 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:03.527973 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38011d6-a8b0-4fcd-bc03-30f528702450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:03.528921 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38011d6-a8b0-4fcd-bc03-30f528702450 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:03.528921 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38011d6-a8b0-4fcd-bc03-30f528702450 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:03.529454 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38011d6-a8b0-4fcd-bc03-30f528702450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:03.539454 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f04c55-2822-4121-98f5-fd0ff4bc70e1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:03.543859 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38011d6-a8b0-4fcd-bc03-30f528702450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:03.546414 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38011d6-a8b0-4fcd-bc03-30f528702450 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:03.581108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e38011d6-a8b0-4fcd-bc03-30f528702450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:03.581108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:03.581108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:03.581108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:03.581108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:03.581108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:03.581108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:03.581108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:03.581108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:03.581108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:03.581108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:03.581108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:03.581108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:03.581108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:03.581108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:03.581108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:03.582494 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:03.582494 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:03.582494 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:03.582494 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:03.582494 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:03.582494 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:03.582494 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:03.582494 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:03.582494 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:03.582494 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:03.582494 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:03.582494 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:03.582494 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:03.582494 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:03.582494 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:03.582494 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:03.582494 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:03.583639 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:03.583639 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:03.583639 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:03.593318 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 410/834] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:03.596741 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38011d6-a8b0-4fcd-bc03-30f528702450 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:03.618358 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfdbff-4fd1-4ab3-819e-435add1c69a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:03.619169 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfdbff-4fd1-4ab3-819e-435add1c69a7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:03.620325 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfdbff-4fd1-4ab3-819e-435add1c69a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:03.620665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfdbff-4fd1-4ab3-819e-435add1c69a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:03.629193 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfdbff-4fd1-4ab3-819e-435add1c69a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:03.630805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfdbff-4fd1-4ab3-819e-435add1c69a7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:03.645886 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-64cfdbff-4fd1-4ab3-819e-435add1c69a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:03.645886 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:03.645886 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:03.645886 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:03.645886 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:03.645886 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:03.645886 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:03.645886 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:03.645886 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:03.645886 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:03.645886 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:03.645886 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:03.645886 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:43:03.645886 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:43:03.645886 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:43:03.648101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:43:03.648101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:03.648101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:03.648101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:03.648101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:03.648101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:03.648101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:03.648101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:03.648101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:03.648101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:03.648101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:03.648101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:03.648101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:03.648101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:03.648101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:03.648101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:03.648101 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:03.650486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:43:03.650486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:43:03.650486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:43:03.650486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:43:03.650486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:43:03.650486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:43:03.650486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:03.650486 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:03.652315 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 425/835] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:43:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:03.655354 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfdbff-4fd1-4ab3-819e-435add1c69a7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:03.794328 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:03.829079 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38011d6-a8b0-4fcd-bc03-30f528702450 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:03.839657 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfdbff-4fd1-4ab3-819e-435add1c69a7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:03.847697 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:03.878725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fd2e8-b27f-41f0-a178-887fd907ad59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:03.879445 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fd2e8-b27f-41f0-a178-887fd907ad59 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:03.879795 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fd2e8-b27f-41f0-a178-887fd907ad59 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:03.880139 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fd2e8-b27f-41f0-a178-887fd907ad59 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:03.880915 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fd2e8-b27f-41f0-a178-887fd907ad59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:03.881324 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fd2e8-b27f-41f0-a178-887fd907ad59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:03.883068 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fd2e8-b27f-41f0-a178-887fd907ad59 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:03.884282 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876780ed-92fd-4db0-bd44-f3cac82ce074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:03.886088 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876780ed-92fd-4db0-bd44-f3cac82ce074 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:03.886815 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876780ed-92fd-4db0-bd44-f3cac82ce074 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:03.887555 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876780ed-92fd-4db0-bd44-f3cac82ce074 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:03.889321 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876780ed-92fd-4db0-bd44-f3cac82ce074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:03.890276 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876780ed-92fd-4db0-bd44-f3cac82ce074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:03.893197 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876780ed-92fd-4db0-bd44-f3cac82ce074 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:03.897348 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 426/836] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:43:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:03.899301 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d04403-f854-4cdc-b774-afb4289ea9b4 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:03.899301 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d04403-f854-4cdc-b774-afb4289ea9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:03.899301 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d04403-f854-4cdc-b774-afb4289ea9b4 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:03.905189 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 427/837] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:03.906123 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d04403-f854-4cdc-b774-afb4289ea9b4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:03.925475 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 411/838] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:03.930410 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8458e-4b07-4b3a-a6c5-eb80d195e4b8 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:03.931282 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8458e-4b07-4b3a-a6c5-eb80d195e4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:03.932883 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8458e-4b07-4b3a-a6c5-eb80d195e4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:03.962643 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-fec8458e-4b07-4b3a-a6c5-eb80d195e4b8 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:03.965557 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fec8458e-4b07-4b3a-a6c5-eb80d195e4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:04.028639 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d04403-f854-4cdc-b774-afb4289ea9b4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:04.084710 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca56bd-c839-4f67-b0cd-24c2f938c2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:04.085799 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca56bd-c839-4f67-b0cd-24c2f938c2bb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:04.085799 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca56bd-c839-4f67-b0cd-24c2f938c2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:04.086126 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca56bd-c839-4f67-b0cd-24c2f938c2bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:04.086948 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca56bd-c839-4f67-b0cd-24c2f938c2bb None admin] RBAC: Adding query filter params (role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=81e0396b7ba341ce8d02b1a149786d95) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:04.087106 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca56bd-c839-4f67-b0cd-24c2f938c2bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:04.089237 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca56bd-c839-4f67-b0cd-24c2f938c2bb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:04.092800 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 412/839] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:04.093880 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8458e-4b07-4b3a-a6c5-eb80d195e4b8 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:04.108642 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 428/840] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:43:03 2022] GET /identity/v3/role_assignments?user.id=81e0396b7ba341ce8d02b1a149786d95&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:04.329069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:04.395735 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8458e-4b07-4b3a-a6c5-eb80d195e4b8 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:04.415466 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca56bd-c839-4f67-b0cd-24c2f938c2bb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:04.466527 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6d9b1-1b12-4587-a0e7-f9669c4732b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:04.468058 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6d9b1-1b12-4587-a0e7-f9669c4732b1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:04.468548 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6d9b1-1b12-4587-a0e7-f9669c4732b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:04.469064 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6d9b1-1b12-4587-a0e7-f9669c4732b1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:04.470173 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:04.483192 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6d9b1-1b12-4587-a0e7-f9669c4732b1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:04.484737 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6d9b1-1b12-4587-a0e7-f9669c4732b1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:04.505863 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-16f6d9b1-1b12-4587-a0e7-f9669c4732b1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:43:04.505863 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:04.505863 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:04.505863 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:04.505863 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:04.505863 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:04.505863 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:04.505863 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:04.505863 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:04.505863 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:04.505863 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:04.505863 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:04.505863 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:43:04.505863 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:43:04.505863 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:43:04.505863 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:43:04.507565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:04.507565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:04.507565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:43:04.507565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:04.507565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:43:04.507565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:04.507565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:04.507565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:04.507565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:04.507565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:04.507565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:04.507565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:04.507565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:04.507565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:04.507565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:04.507565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:04.507565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:04.507565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:04.509101 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:04.509101 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:04.509101 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:43:04.509101 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:43:04.509101 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:43:04.509101 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:43:04.509101 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:43:04.509101 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:43:04.509101 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:43:04.509101 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:04.509101 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 413/841] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:43:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:04.519125 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6d9b1-1b12-4587-a0e7-f9669c4732b1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:04.591439 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca56bd-c839-4f67-b0cd-24c2f938c2bb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:04.647167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40933aea-efe1-4b5a-ba7b-d785c89c58db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:04.648323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40933aea-efe1-4b5a-ba7b-d785c89c58db None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:04.648839 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40933aea-efe1-4b5a-ba7b-d785c89c58db None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:04.649419 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40933aea-efe1-4b5a-ba7b-d785c89c58db None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:04.650492 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40933aea-efe1-4b5a-ba7b-d785c89c58db None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:04.655036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40933aea-efe1-4b5a-ba7b-d785c89c58db None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:04.672865 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-40933aea-efe1-4b5a-ba7b-d785c89c58db None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 02 00:43:04.672865 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:04.672865 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:43:04.672865 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:43:04.672865 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:43:04.672865 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:43:04.672865 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:43:04.672865 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:04.672865 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 02 00:43:04.672865 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:04.672865 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:04.672865 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:04.672865 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:04.672865 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:04.672865 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:04.672865 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:04.672865 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:04.674613 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:04.674613 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:04.674613 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:04.674613 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:04.674613 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:04.674613 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:04.674613 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:43:04.674613 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:43:04.674613 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:43:04.674613 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:43:04.674613 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:04.674613 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:04.674613 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:04.674613 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:04.674613 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:04.674613 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:04.675979 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:04.675979 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:04.675979 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:04.675979 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:04.675979 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:04.675979 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:04.675979 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:04.675979 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:04.675979 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:04.675979 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:04.675979 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:43:04.675979 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:04.675979 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 02 00:43:04.675979 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:04.675979 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 429/842] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:43:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:04.678968 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903d2ca-993f-4219-ac50-2ee62a0d6320 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:04.679470 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903d2ca-993f-4219-ac50-2ee62a0d6320 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:04.679968 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903d2ca-993f-4219-ac50-2ee62a0d6320 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:04.685131 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 430/843] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:04.685131 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903d2ca-993f-4219-ac50-2ee62a0d6320 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:04.752191 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6d9b1-1b12-4587-a0e7-f9669c4732b1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:04.809191 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:04.825425 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf4228-fa07-4af0-8fd6-328bf3ba0796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:04.827506 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf4228-fa07-4af0-8fd6-328bf3ba0796 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:04.827506 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf4228-fa07-4af0-8fd6-328bf3ba0796 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:04.827506 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf4228-fa07-4af0-8fd6-328bf3ba0796 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:04.828718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf4228-fa07-4af0-8fd6-328bf3ba0796 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:04.829269 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf4228-fa07-4af0-8fd6-328bf3ba0796 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:04.832995 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf4228-fa07-4af0-8fd6-328bf3ba0796 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:04.870177 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 414/844] 10.222.0.26 () {56 vars in 1135 bytes} [Sun Oct 2 00:43:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:04.871704 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6df908-ac63-4cfc-80a9-81635f9d13f9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:04.871991 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6df908-ac63-4cfc-80a9-81635f9d13f9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:04.872270 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6df908-ac63-4cfc-80a9-81635f9d13f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:04.896259 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-fa6df908-ac63-4cfc-80a9-81635f9d13f9 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:04.897970 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fa6df908-ac63-4cfc-80a9-81635f9d13f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:04.898507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:04.915426 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903d2ca-993f-4219-ac50-2ee62a0d6320 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:04.989723 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce102d-7448-4a9c-a0dd-1fd66902f7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:04.990753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce102d-7448-4a9c-a0dd-1fd66902f7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:04.991245 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce102d-7448-4a9c-a0dd-1fd66902f7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:04.991722 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce102d-7448-4a9c-a0dd-1fd66902f7e4 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:04.992864 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce102d-7448-4a9c-a0dd-1fd66902f7e4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:04.993439 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce102d-7448-4a9c-a0dd-1fd66902f7e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:04.996574 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce102d-7448-4a9c-a0dd-1fd66902f7e4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:05.009657 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 431/845] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:43:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:05.009657 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce102d-7448-4a9c-a0dd-1fd66902f7e4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:05.036974 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 415/846] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:05.036974 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6df908-ac63-4cfc-80a9-81635f9d13f9 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:05.204562 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce102d-7448-4a9c-a0dd-1fd66902f7e4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:05.243958 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6df908-ac63-4cfc-80a9-81635f9d13f9 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:05.275644 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:05.279045 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e256dbe-abbf-4cff-8bbe-f9e7bfdc00f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:05.279821 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e256dbe-abbf-4cff-8bbe-f9e7bfdc00f0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:05.280226 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e256dbe-abbf-4cff-8bbe-f9e7bfdc00f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:05.280575 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e256dbe-abbf-4cff-8bbe-f9e7bfdc00f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:05.317059 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:05.325522 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe92c0-2c71-42ac-b55c-97b58f46dac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:05.327311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe92c0-2c71-42ac-b55c-97b58f46dac5 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:05.328234 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe92c0-2c71-42ac-b55c-97b58f46dac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:05.329040 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe92c0-2c71-42ac-b55c-97b58f46dac5 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:05.330675 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe92c0-2c71-42ac-b55c-97b58f46dac5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:05.331514 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe92c0-2c71-42ac-b55c-97b58f46dac5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:05.334638 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe92c0-2c71-42ac-b55c-97b58f46dac5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:05.345929 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 416/847] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:43:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:05.372023 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e256dbe-abbf-4cff-8bbe-f9e7bfdc00f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:05.376327 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e256dbe-abbf-4cff-8bbe-f9e7bfdc00f0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:05.442329 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe92c0-2c71-42ac-b55c-97b58f46dac5 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:05.544000 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 432/848] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:43:05 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:43:05.552719 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e256dbe-abbf-4cff-8bbe-f9e7bfdc00f0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:05.667610 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe92c0-2c71-42ac-b55c-97b58f46dac5 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:05.681598 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:05.726020 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a0727-b006-43a3-bddd-0edf3f380e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:05.726683 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a0727-b006-43a3-bddd-0edf3f380e81 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:05.726965 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a0727-b006-43a3-bddd-0edf3f380e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:05.727236 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a0727-b006-43a3-bddd-0edf3f380e81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:05.740071 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a0727-b006-43a3-bddd-0edf3f380e81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:43:05.746577 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-ee4a0727-b006-43a3-bddd-0edf3f380e81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:43:05.746577 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:05.746577 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:05.746577 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:05.746577 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:05.746577 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:05.746577 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:05.746577 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:05.746577 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:05.746577 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:05.746577 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:05.746577 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:05.746577 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:43:05.746577 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:43:05.746577 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:43:05.746577 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:43:05.747591 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:43:05.747591 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:43:05.747591 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:43:05.747591 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:43:05.747591 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:05.747591 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:05.747591 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:05.747591 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:05.747591 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:05.747591 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:05.747591 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:05.747591 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:05.747591 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:05.747591 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:05.747591 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:05.747591 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:05.748478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:05.748478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:05.748478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:05.748478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:05.748478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:43:05.748478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:43:05.748478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:43:05.748478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:43:05.748478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:43:05.748478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:43:05.748478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:43:05.748478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:05.753285 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 417/849] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:43:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:05.755374 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a0727-b006-43a3-bddd-0edf3f380e81 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:05.778228 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e256dbe-abbf-4cff-8bbe-f9e7bfdc00f0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:05.803039 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:05.861266 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acc50b-4358-4c90-bf3c-421dd27b0ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:05.863005 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acc50b-4358-4c90-bf3c-421dd27b0ecf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:05.863873 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acc50b-4358-4c90-bf3c-421dd27b0ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:05.864640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acc50b-4358-4c90-bf3c-421dd27b0ecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:05.883660 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a0727-b006-43a3-bddd-0edf3f380e81 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:05.887942 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acc50b-4358-4c90-bf3c-421dd27b0ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:05.891437 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acc50b-4358-4c90-bf3c-421dd27b0ecf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:05.925574 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-86acc50b-4358-4c90-bf3c-421dd27b0ecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:05.925574 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:05.925574 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:05.925574 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:05.925574 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:05.925574 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:05.925574 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:05.925574 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:05.925574 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:05.925574 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:05.925574 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:05.925574 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:05.925574 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:05.925574 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:05.925574 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:05.925574 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:05.927439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:05.927439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:05.927439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:05.927439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:05.927439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:05.927439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:05.927439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:05.927439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:05.927439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:05.927439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:05.927439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:05.927439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:05.927439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:05.927439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:05.927439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:05.927439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:05.927439 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:05.929370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:05.929370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:05.929370 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:05.931089 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a7a19-24d7-4592-9e9c-13ada1775127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:05.931865 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a7a19-24d7-4592-9e9c-13ada1775127 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:05.932242 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a7a19-24d7-4592-9e9c-13ada1775127 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:05.932616 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a7a19-24d7-4592-9e9c-13ada1775127 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:05.933458 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a7a19-24d7-4592-9e9c-13ada1775127 None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:05.933912 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a7a19-24d7-4592-9e9c-13ada1775127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:05.934167 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 433/850] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:05.935664 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a7a19-24d7-4592-9e9c-13ada1775127 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:05.939836 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acc50b-4358-4c90-bf3c-421dd27b0ecf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:05.951807 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 418/851] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:43:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:05.953542 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a7a19-24d7-4592-9e9c-13ada1775127 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:06.064815 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acc50b-4358-4c90-bf3c-421dd27b0ecf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:06.070927 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:06.075423 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a7a19-24d7-4592-9e9c-13ada1775127 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:06.093602 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:06.109953 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460443b-e840-4c99-a2a1-6f5d7e8e6d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:06.111589 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460443b-e840-4c99-a2a1-6f5d7e8e6d27 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:06.112246 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460443b-e840-4c99-a2a1-6f5d7e8e6d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:06.112789 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460443b-e840-4c99-a2a1-6f5d7e8e6d27 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:06.113882 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460443b-e840-4c99-a2a1-6f5d7e8e6d27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:06.114435 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460443b-e840-4c99-a2a1-6f5d7e8e6d27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:06.116383 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460443b-e840-4c99-a2a1-6f5d7e8e6d27 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:06.117080 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30848def-c4e2-495b-8f0b-7303a854c08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:06.117826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30848def-c4e2-495b-8f0b-7303a854c08a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:06.118208 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30848def-c4e2-495b-8f0b-7303a854c08a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:06.118765 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30848def-c4e2-495b-8f0b-7303a854c08a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:06.130990 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30848def-c4e2-495b-8f0b-7303a854c08a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:06.136461 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30848def-c4e2-495b-8f0b-7303a854c08a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:06.137267 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 434/852] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:06.138653 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460443b-e840-4c99-a2a1-6f5d7e8e6d27 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:06.153546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-30848def-c4e2-495b-8f0b-7303a854c08a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:06.153546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:06.153546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:06.153546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:06.153546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:06.153546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:06.153546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:06.153546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:06.153546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:06.153546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:06.153546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:06.153546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:06.153546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:06.153546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:06.153546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:06.153546 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:06.154743 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:06.154743 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:06.154743 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:06.154743 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:06.154743 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:06.154743 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:06.154743 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:06.154743 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:06.154743 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:06.154743 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:06.154743 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:06.154743 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:06.154743 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:06.154743 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:06.154743 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:06.154743 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:06.154743 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:06.155666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:06.155666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:06.155666 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:06.160446 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 419/853] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:06.162253 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30848def-c4e2-495b-8f0b-7303a854c08a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:06.275331 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460443b-e840-4c99-a2a1-6f5d7e8e6d27 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:06.289524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30848def-c4e2-495b-8f0b-7303a854c08a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:06.320143 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcae38-6977-4316-bdfb-237799a25867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:06.321381 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcae38-6977-4316-bdfb-237799a25867 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:06.321851 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcae38-6977-4316-bdfb-237799a25867 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:06.322834 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcae38-6977-4316-bdfb-237799a25867 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:06.332161 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcae38-6977-4316-bdfb-237799a25867 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:06.334205 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcae38-6977-4316-bdfb-237799a25867 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:06.348931 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f0bcae38-6977-4316-bdfb-237799a25867 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:06.348931 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:06.348931 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:06.348931 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:06.348931 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:06.348931 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:06.348931 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:06.348931 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:06.348931 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:06.348931 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:06.348931 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:06.348931 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:06.348931 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:43:06.348931 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:43:06.348931 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:43:06.349922 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:43:06.349922 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:06.349922 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:06.349922 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:06.349922 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:06.349922 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:06.349922 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:06.349922 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:06.349922 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:06.349922 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:06.349922 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:06.349922 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:06.349922 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:06.349922 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:06.349922 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:06.349922 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:06.349922 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:06.350836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:43:06.350836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:43:06.350836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:43:06.350836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:43:06.350836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:43:06.350836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:43:06.350836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:06.350836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:06.357474 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 435/854] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:43:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:06.360863 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcae38-6977-4316-bdfb-237799a25867 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:06.362726 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ec425-3d8b-491d-8fbf-7b3367cbafbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:06.363611 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ec425-3d8b-491d-8fbf-7b3367cbafbb None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:06.364128 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ec425-3d8b-491d-8fbf-7b3367cbafbb None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:06.364605 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ec425-3d8b-491d-8fbf-7b3367cbafbb None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:06.365909 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ec425-3d8b-491d-8fbf-7b3367cbafbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:06.366431 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ec425-3d8b-491d-8fbf-7b3367cbafbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:06.369323 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ec425-3d8b-491d-8fbf-7b3367cbafbb None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:06.385691 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 420/855] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:06.394780 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ec425-3d8b-491d-8fbf-7b3367cbafbb None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:06.420489 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:06.426737 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:06.504996 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcae38-6977-4316-bdfb-237799a25867 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:06.546855 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e241bd-db6e-48e3-b276-90b250418475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:06.547861 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e241bd-db6e-48e3-b276-90b250418475 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:06.548373 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e241bd-db6e-48e3-b276-90b250418475 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:06.548848 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e241bd-db6e-48e3-b276-90b250418475 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:06.549777 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e241bd-db6e-48e3-b276-90b250418475 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:06.550321 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e241bd-db6e-48e3-b276-90b250418475 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:06.552054 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e241bd-db6e-48e3-b276-90b250418475 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:06.573235 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 436/856] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:43:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:06.574578 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e241bd-db6e-48e3-b276-90b250418475 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:06.610924 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ec425-3d8b-491d-8fbf-7b3367cbafbb None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:06.683840 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:06.692911 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89c384-8ebe-4dc5-b127-399bd3003259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:06.694228 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89c384-8ebe-4dc5-b127-399bd3003259 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:06.694780 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89c384-8ebe-4dc5-b127-399bd3003259 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:06.695267 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89c384-8ebe-4dc5-b127-399bd3003259 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:06.698612 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e241bd-db6e-48e3-b276-90b250418475 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:06.711215 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89c384-8ebe-4dc5-b127-399bd3003259 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:06.713670 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89c384-8ebe-4dc5-b127-399bd3003259 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:06.738421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-ac89c384-8ebe-4dc5-b127-399bd3003259 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:43:06.738421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:06.738421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:06.738421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:06.738421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:06.738421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:06.738421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:06.738421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:06.738421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:06.738421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:06.738421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:06.738421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:06.738421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:43:06.738421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:43:06.738421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:43:06.738421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:43:06.739475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:06.739475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:06.739475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:43:06.739475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:06.739475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:43:06.739475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:06.739475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:06.739475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:06.739475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:06.739475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:06.739475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:06.739475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:06.739475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:06.739475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:06.739475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:06.739475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:06.739475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:06.739475 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:06.740448 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:06.740448 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:06.740448 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:43:06.740448 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:43:06.740448 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:43:06.740448 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:43:06.740448 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:43:06.740448 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:43:06.740448 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:43:06.740448 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:06.741861 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563342b3-4daf-49ef-a592-4fca3742a23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:06.742769 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563342b3-4daf-49ef-a592-4fca3742a23c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:06.743264 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563342b3-4daf-49ef-a592-4fca3742a23c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:06.743746 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563342b3-4daf-49ef-a592-4fca3742a23c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:06.745392 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563342b3-4daf-49ef-a592-4fca3742a23c None admin] RBAC: Adding query filter params (role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=2784579d2ddf4cc99fe0e1d109e5cdda) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:06.745949 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563342b3-4daf-49ef-a592-4fca3742a23c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:06.747615 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563342b3-4daf-49ef-a592-4fca3742a23c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:06.748846 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 421/857] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Oct 2 00:43:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:06.751049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89c384-8ebe-4dc5-b127-399bd3003259 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:06.755233 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 437/858] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:43:06 2022] GET /identity/v3/role_assignments?user.id=2784579d2ddf4cc99fe0e1d109e5cdda&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:06.900338 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:06.940974 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89c384-8ebe-4dc5-b127-399bd3003259 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:06.984051 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13500cb1-051d-4d1e-9b02-c5db2c287d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:06.984694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13500cb1-051d-4d1e-9b02-c5db2c287d89 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:06.985003 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13500cb1-051d-4d1e-9b02-c5db2c287d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:06.985279 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13500cb1-051d-4d1e-9b02-c5db2c287d89 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:06.986056 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13500cb1-051d-4d1e-9b02-c5db2c287d89 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:06.986364 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13500cb1-051d-4d1e-9b02-c5db2c287d89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:06.987879 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13500cb1-051d-4d1e-9b02-c5db2c287d89 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:07.013864 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 422/859] 10.222.0.26 () {56 vars in 1149 bytes} [Sun Oct 2 00:43:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:07.016512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563342b3-4daf-49ef-a592-4fca3742a23c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:07.140476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563342b3-4daf-49ef-a592-4fca3742a23c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:07.186256 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f5761-cbd0-4e70-9ae0-2573726116b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:07.187211 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f5761-cbd0-4e70-9ae0-2573726116b6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:07.187719 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f5761-cbd0-4e70-9ae0-2573726116b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:07.188196 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f5761-cbd0-4e70-9ae0-2573726116b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:07.237960 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:07.316974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f5761-cbd0-4e70-9ae0-2573726116b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:07.319756 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f5761-cbd0-4e70-9ae0-2573726116b6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:07.454869 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6d6c1-7e18-432d-ad29-b67fe1c4fb5e None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:07.455154 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6d6c1-7e18-432d-ad29-b67fe1c4fb5e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:07.455309 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6d6c1-7e18-432d-ad29-b67fe1c4fb5e None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:07.457121 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 423/860] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:07.465718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a0640-9f13-426f-b4ba-202f56270ef4 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:07.466225 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a0640-9f13-426f-b4ba-202f56270ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:07.466522 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a0640-9f13-426f-b4ba-202f56270ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:07.487022 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-be3a0640-9f13-426f-b4ba-202f56270ef4 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:07.488289 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-be3a0640-9f13-426f-b4ba-202f56270ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:07.527452 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 438/861] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:43:07 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 02 00:43:07.535392 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f5761-cbd0-4e70-9ae0-2573726116b6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:07.610898 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 424/862] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:07.658811 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:07.751423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f5761-cbd0-4e70-9ae0-2573726116b6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:07.820287 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767fca4-09eb-4357-b78b-eddc01acd8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:07.821956 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767fca4-09eb-4357-b78b-eddc01acd8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:07.822799 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767fca4-09eb-4357-b78b-eddc01acd8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:07.823609 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767fca4-09eb-4357-b78b-eddc01acd8a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:07.846068 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767fca4-09eb-4357-b78b-eddc01acd8a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:07.849597 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767fca4-09eb-4357-b78b-eddc01acd8a1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:07.881989 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4767fca4-09eb-4357-b78b-eddc01acd8a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:07.881989 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:07.881989 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:07.881989 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:07.881989 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:07.881989 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:07.881989 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:07.881989 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:07.881989 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:07.881989 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:07.881989 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:07.881989 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:07.881989 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:07.881989 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:07.881989 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:07.881989 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:07.884052 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:07.884052 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:07.884052 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:07.884052 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:07.884052 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:07.884052 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:07.884052 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:07.884052 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:07.884052 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:07.884052 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:07.884052 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:07.884052 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:07.884052 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:07.884052 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:07.884052 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:07.884052 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:07.884052 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:07.885529 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:07.885529 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:07.885529 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:07.892760 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 439/863] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:07.894541 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a0640-9f13-426f-b4ba-202f56270ef4 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:07.968076 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:08.020761 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a0640-9f13-426f-b4ba-202f56270ef4 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:08.061069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8bf2f-d6b3-428c-9f08-6f39b410d102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:08.061691 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8bf2f-d6b3-428c-9f08-6f39b410d102 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:08.061971 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8bf2f-d6b3-428c-9f08-6f39b410d102 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:08.062245 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8bf2f-d6b3-428c-9f08-6f39b410d102 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:08.062901 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8bf2f-d6b3-428c-9f08-6f39b410d102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:08.063203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8bf2f-d6b3-428c-9f08-6f39b410d102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:08.064684 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8bf2f-d6b3-428c-9f08-6f39b410d102 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:08.083352 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 425/864] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:08.084922 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767fca4-09eb-4357-b78b-eddc01acd8a1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:08.116694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8bf2f-d6b3-428c-9f08-6f39b410d102 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:08.238264 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767fca4-09eb-4357-b78b-eddc01acd8a1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:08.252478 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:08.261047 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8bf2f-d6b3-428c-9f08-6f39b410d102 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:08.285067 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:08.304183 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e2fa3-0315-4404-949b-250aa4b3ef67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:08.304520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba44409-3699-4550-a030-889e95fc61ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:08.304917 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e2fa3-0315-4404-949b-250aa4b3ef67 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:08.305166 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e2fa3-0315-4404-949b-250aa4b3ef67 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:08.305410 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e2fa3-0315-4404-949b-250aa4b3ef67 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:08.305605 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba44409-3699-4550-a030-889e95fc61ea None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:08.305881 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba44409-3699-4550-a030-889e95fc61ea None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:08.306059 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e2fa3-0315-4404-949b-250aa4b3ef67 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:08.306346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba44409-3699-4550-a030-889e95fc61ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:08.308070 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e2fa3-0315-4404-949b-250aa4b3ef67 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:08.318574 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e48e2fa3-0315-4404-949b-250aa4b3ef67 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 02 00:43:08.318574 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:08.318574 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:43:08.318574 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:43:08.318574 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:43:08.318574 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:43:08.318574 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:43:08.318574 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:08.318574 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 02 00:43:08.318574 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:08.318574 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:08.318574 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:08.318574 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:08.318574 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:08.318574 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:08.318574 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:08.325838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:08.325838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:08.325838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:08.325838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:08.325838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:08.325838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:08.325838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:08.325838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:43:08.325838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:43:08.325838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:43:08.325838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:43:08.325838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:08.325838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:08.325838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:08.325838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:08.325838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:08.325838 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:08.326760 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:08.326760 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:08.326760 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:08.326760 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:08.326760 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:08.326760 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:08.326760 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:08.326760 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:08.326760 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:08.326760 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:08.326760 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:43:08.326760 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:08.326760 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 02 00:43:08.326760 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:08.328217 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba44409-3699-4550-a030-889e95fc61ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:08.328628 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 426/865] 10.222.0.26 () {56 vars in 1132 bytes} [Sun Oct 2 00:43:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:08.328628 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9505882-08e1-406d-8a03-851d2e689888 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:08.328628 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9505882-08e1-406d-8a03-851d2e689888 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:08.328628 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9505882-08e1-406d-8a03-851d2e689888 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:08.329215 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba44409-3699-4550-a030-889e95fc61ea None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:08.329301 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 427/866] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:08.330538 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9505882-08e1-406d-8a03-851d2e689888 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:08.349904 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-1ba44409-3699-4550-a030-889e95fc61ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:08.349904 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:08.349904 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:08.349904 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:08.349904 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:08.349904 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:08.349904 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:08.349904 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:08.349904 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:08.349904 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:08.349904 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:08.349904 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:08.349904 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:43:08.349904 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:43:08.349904 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:43:08.350921 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:43:08.350921 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:08.350921 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:08.350921 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:08.350921 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:08.350921 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:08.350921 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:08.350921 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:08.350921 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:08.350921 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:08.350921 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:08.350921 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:08.350921 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:08.350921 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:08.350921 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:08.350921 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:08.350921 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:08.351831 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:43:08.351831 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:43:08.351831 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:43:08.351831 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:43:08.351831 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:43:08.351831 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:43:08.351831 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:08.351831 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:08.358880 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 440/867] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:43:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:08.358880 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb287c-6315-4407-b0f2-2c407f2c7031 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:08.358880 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb287c-6315-4407-b0f2-2c407f2c7031 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:08.358880 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb287c-6315-4407-b0f2-2c407f2c7031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:08.385856 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-11bb287c-6315-4407-b0f2-2c407f2c7031 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:08.387901 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-11bb287c-6315-4407-b0f2-2c407f2c7031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:08.492213 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 441/868] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:08.493142 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb287c-6315-4407-b0f2-2c407f2c7031 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:08.525829 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9505882-08e1-406d-8a03-851d2e689888 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:08.579083 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90886b1-bac0-406c-b2d4-f57c6fe2f68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:08.579609 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90886b1-bac0-406c-b2d4-f57c6fe2f68f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:08.579886 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90886b1-bac0-406c-b2d4-f57c6fe2f68f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:08.580173 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90886b1-bac0-406c-b2d4-f57c6fe2f68f None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:08.580793 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90886b1-bac0-406c-b2d4-f57c6fe2f68f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:08.581137 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90886b1-bac0-406c-b2d4-f57c6fe2f68f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:08.582774 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90886b1-bac0-406c-b2d4-f57c6fe2f68f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:08.593185 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 428/869] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Oct 2 00:43:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:08.596970 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90886b1-bac0-406c-b2d4-f57c6fe2f68f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:08.652039 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:08.659482 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb287c-6315-4407-b0f2-2c407f2c7031 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:08.699507 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:08.704683 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f9948-1d20-4fc5-be41-32b4e80ac0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:08.705359 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f9948-1d20-4fc5-be41-32b4e80ac0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:08.705636 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f9948-1d20-4fc5-be41-32b4e80ac0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:08.705907 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f9948-1d20-4fc5-be41-32b4e80ac0b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:08.706608 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f9948-1d20-4fc5-be41-32b4e80ac0b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:08.706906 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f9948-1d20-4fc5-be41-32b4e80ac0b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:08.708338 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f9948-1d20-4fc5-be41-32b4e80ac0b7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:08.724990 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 442/870] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:43:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:08.735240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f9948-1d20-4fc5-be41-32b4e80ac0b7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:08.803511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90886b1-bac0-406c-b2d4-f57c6fe2f68f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:08.842450 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d7c7-d474-4317-b3af-98083d968d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:08.842997 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d7c7-d474-4317-b3af-98083d968d39 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:08.843334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d7c7-d474-4317-b3af-98083d968d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:08.843578 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d7c7-d474-4317-b3af-98083d968d39 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:08.844179 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07d7c7-d474-4317-b3af-98083d968d39 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:08.844483 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07d7c7-d474-4317-b3af-98083d968d39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:08.845918 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07d7c7-d474-4317-b3af-98083d968d39 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:08.853149 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 429/871] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Oct 2 00:43:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:08.853149 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d7c7-d474-4317-b3af-98083d968d39 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:08.867595 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f9948-1d20-4fc5-be41-32b4e80ac0b7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:08.911322 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6777c-c4a1-496e-9a23-06206315f83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:08.912233 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6777c-c4a1-496e-9a23-06206315f83b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:08.912661 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6777c-c4a1-496e-9a23-06206315f83b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:08.913124 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6777c-c4a1-496e-9a23-06206315f83b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:08.914037 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6777c-c4a1-496e-9a23-06206315f83b None admin] RBAC: Adding query filter params (role.id=714239b608694824a75962d8cbb39f70, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=42dcae7ba3c241eb8d7d0894aadb467f) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:08.914623 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6777c-c4a1-496e-9a23-06206315f83b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:08.917132 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6777c-c4a1-496e-9a23-06206315f83b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:08.939630 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 443/872] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:43:08 2022] GET /identity/v3/role_assignments?user.id=42dcae7ba3c241eb8d7d0894aadb467f&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=714239b608694824a75962d8cbb39f70 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:09.053300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d7c7-d474-4317-b3af-98083d968d39 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:09.073741 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:09.103764 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0125b22-1ec8-482b-8227-2d3eb1416e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:09.104472 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0125b22-1ec8-482b-8227-2d3eb1416e3a None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:09.104762 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0125b22-1ec8-482b-8227-2d3eb1416e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:09.105068 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0125b22-1ec8-482b-8227-2d3eb1416e3a None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:09.105786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0125b22-1ec8-482b-8227-2d3eb1416e3a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:09.107223 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0125b22-1ec8-482b-8227-2d3eb1416e3a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:09.128825 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 430/873] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Oct 2 00:43:08 2022] POST /identity/v3/services => generated 251 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:43:09.533443 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8b5d5-6a3b-4260-a46e-7c50c34351f0 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:09.534490 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8b5d5-6a3b-4260-a46e-7c50c34351f0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:09.534976 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8b5d5-6a3b-4260-a46e-7c50c34351f0 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:09.536885 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 444/874] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:09.543254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a91fa-55ff-4b25-b874-35ba06d3b3c9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:09.543691 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a91fa-55ff-4b25-b874-35ba06d3b3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:09.544186 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a91fa-55ff-4b25-b874-35ba06d3b3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:09.567135 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-bf8a91fa-55ff-4b25-b874-35ba06d3b3c9 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:09.568353 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-bf8a91fa-55ff-4b25-b874-35ba06d3b3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:09.655543 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 431/875] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:09 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:43:09.936240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8b5d5-6a3b-4260-a46e-7c50c34351f0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:09.970968 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:10.092247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8b5d5-6a3b-4260-a46e-7c50c34351f0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:10.132052 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ebe4b-443f-4ec6-8f1b-f5f15d87beac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:10.132715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ebe4b-443f-4ec6-8f1b-f5f15d87beac None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:10.133027 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ebe4b-443f-4ec6-8f1b-f5f15d87beac None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:10.133409 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ebe4b-443f-4ec6-8f1b-f5f15d87beac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:10.134021 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ebe4b-443f-4ec6-8f1b-f5f15d87beac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:10.135830 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ebe4b-443f-4ec6-8f1b-f5f15d87beac None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:10.146590 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-142ebe4b-443f-4ec6-8f1b-f5f15d87beac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:43:10.146590 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:10.146590 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:43:10.146590 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:43:10.146590 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:43:10.146590 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:43:10.146590 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:43:10.146590 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:10.146590 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:43:10.146590 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:10.146590 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:10.146590 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:10.146590 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:10.146590 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:10.146590 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:10.146590 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:10.146590 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:10.147791 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:10.147791 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:10.147791 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:10.147791 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:10.147791 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:10.147791 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:10.147791 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:43:10.147791 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:43:10.147791 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:43:10.147791 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:43:10.147791 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:10.147791 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:10.147791 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:10.147791 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:10.147791 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:10.147791 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:10.148667 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:10.148667 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:10.148667 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:10.148667 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:10.148667 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:10.148667 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:10.148667 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:10.148667 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:10.148667 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:10.148667 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:10.148667 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:43:10.148667 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:10.148667 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:43:10.148667 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:10.148667 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 445/876] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Oct 2 00:43:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:10.159373 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a91fa-55ff-4b25-b874-35ba06d3b3c9 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:10.278941 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:10.283537 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a91fa-55ff-4b25-b874-35ba06d3b3c9 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:10.324168 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767b348-ea21-4c32-874c-c49a6e709d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:10.324786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767b348-ea21-4c32-874c-c49a6e709d3e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:10.325109 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767b348-ea21-4c32-874c-c49a6e709d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:10.325375 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767b348-ea21-4c32-874c-c49a6e709d3e None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:10.326010 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767b348-ea21-4c32-874c-c49a6e709d3e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:10.326307 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767b348-ea21-4c32-874c-c49a6e709d3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:10.327686 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767b348-ea21-4c32-874c-c49a6e709d3e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:10.333402 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 432/877] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Oct 2 00:43:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:10.343161 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ebe4b-443f-4ec6-8f1b-f5f15d87beac None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:10.503083 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:10.532421 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ebe4b-443f-4ec6-8f1b-f5f15d87beac None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:10.592450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b81515-646f-418a-828b-7edb70fb7883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:10.593550 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b81515-646f-418a-828b-7edb70fb7883 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:10.593972 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b81515-646f-418a-828b-7edb70fb7883 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:10.594418 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b81515-646f-418a-828b-7edb70fb7883 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:10.595596 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b81515-646f-418a-828b-7edb70fb7883 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:10.596155 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b81515-646f-418a-828b-7edb70fb7883 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:10.598665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b81515-646f-418a-828b-7edb70fb7883 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:10.608079 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 446/878] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Oct 2 00:43:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:11.426973 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaebfe-d392-48a0-946c-d6aa89c68cda None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:11.427508 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaebfe-d392-48a0-946c-d6aa89c68cda None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:11.427508 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaebfe-d392-48a0-946c-d6aa89c68cda None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:11.429449 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 433/879] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:11.436486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a3154-ac08-48fb-a101-4b6845aa91a5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:11.436783 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a3154-ac08-48fb-a101-4b6845aa91a5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:11.437204 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a3154-ac08-48fb-a101-4b6845aa91a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:11.457516 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ad2a3154-ac08-48fb-a101-4b6845aa91a5 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:11.458726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ad2a3154-ac08-48fb-a101-4b6845aa91a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:11.462300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599de85a-2402-450b-be8d-fafe8a5861d0 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:11.462596 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599de85a-2402-450b-be8d-fafe8a5861d0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:11.463493 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599de85a-2402-450b-be8d-fafe8a5861d0 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:11.465153 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 434/880] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:11.470582 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76964c50-adc8-4826-b72b-54ad75d75a0b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:11.471162 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76964c50-adc8-4826-b72b-54ad75d75a0b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:11.471547 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76964c50-adc8-4826-b72b-54ad75d75a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:11.491758 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-76964c50-adc8-4826-b72b-54ad75d75a0b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:11.493413 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-76964c50-adc8-4826-b72b-54ad75d75a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:11.577018 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 447/881] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:11 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:11.602834 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 435/882] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:11 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:43:11.843688 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a3154-ac08-48fb-a101-4b6845aa91a5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:11.853524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44b25d-737b-4f88-b6ea-09c23b2e6bc4 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:11.854429 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44b25d-737b-4f88-b6ea-09c23b2e6bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:11.854591 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44b25d-737b-4f88-b6ea-09c23b2e6bc4 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:11.856348 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 436/883] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:11.862239 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca8102-9053-4ea4-9997-9df57291e51f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:11.862573 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca8102-9053-4ea4-9997-9df57291e51f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:11.862857 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca8102-9053-4ea4-9997-9df57291e51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:11.884560 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-f1ca8102-9053-4ea4-9997-9df57291e51f None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:11.886060 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f1ca8102-9053-4ea4-9997-9df57291e51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:11.975352 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 437/884] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:11 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:43:12.006926 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:12.019800 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca8102-9053-4ea4-9997-9df57291e51f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:12.048519 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:12.052130 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a3154-ac08-48fb-a101-4b6845aa91a5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:12.097654 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fe953-9aad-4b24-bcc0-d494f46d0674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:12.098776 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fe953-9aad-4b24-bcc0-d494f46d0674 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:12.099262 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fe953-9aad-4b24-bcc0-d494f46d0674 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:12.099712 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fe953-9aad-4b24-bcc0-d494f46d0674 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:12.100965 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fe953-9aad-4b24-bcc0-d494f46d0674 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:12.102544 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fe953-9aad-4b24-bcc0-d494f46d0674 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:12.129420 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 448/885] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Oct 2 00:43:11 2022] POST /identity/v3/services => generated 269 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:43:12.212536 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca8102-9053-4ea4-9997-9df57291e51f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:12.269067 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fe953-9aad-4b24-bcc0-d494f46d0674 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:12.296493 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ee266-3965-46c9-9b01-16ed318765fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:12.297788 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ee266-3965-46c9-9b01-16ed318765fa None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:12.298434 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ee266-3965-46c9-9b01-16ed318765fa None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:12.298893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ee266-3965-46c9-9b01-16ed318765fa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:12.320496 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ee266-3965-46c9-9b01-16ed318765fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:43:12.330744 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-106ee266-3965-46c9-9b01-16ed318765fa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:43:12.330744 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:12.330744 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:12.330744 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:12.330744 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:12.330744 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:12.330744 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:12.330744 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:12.330744 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:12.330744 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:12.330744 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:12.330744 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:12.330744 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:43:12.330744 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:43:12.330744 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:43:12.330744 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:43:12.331769 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:43:12.331769 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:43:12.331769 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:43:12.331769 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:43:12.331769 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:12.331769 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:12.331769 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:12.331769 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:12.331769 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:12.331769 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:12.331769 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:12.331769 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:12.331769 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:12.331769 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:12.331769 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:12.331769 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:12.332797 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:12.332797 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:12.332797 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:12.332797 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:12.332797 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:43:12.332797 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:43:12.332797 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:43:12.332797 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:43:12.332797 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:43:12.332797 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:43:12.332797 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:43:12.332797 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:12.332797 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 438/886] 10.222.0.26 () {56 vars in 1120 bytes} [Sun Oct 2 00:43:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:12.343342 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ee266-3965-46c9-9b01-16ed318765fa None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:12.442355 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fe953-9aad-4b24-bcc0-d494f46d0674 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:12.490541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0547397-7b94-44b1-a975-bc888a27f1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:12.491352 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0547397-7b94-44b1-a975-bc888a27f1e1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:12.491736 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0547397-7b94-44b1-a975-bc888a27f1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:12.492370 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0547397-7b94-44b1-a975-bc888a27f1e1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:12.493574 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0547397-7b94-44b1-a975-bc888a27f1e1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:12.494919 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:12.498422 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0547397-7b94-44b1-a975-bc888a27f1e1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:12.516480 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-b0547397-7b94-44b1-a975-bc888a27f1e1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 02 00:43:12.516480 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:12.516480 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:43:12.516480 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:43:12.516480 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:43:12.516480 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:43:12.516480 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:43:12.516480 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:12.516480 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 02 00:43:12.516480 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:12.516480 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:12.516480 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:12.516480 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:12.516480 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:12.516480 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:12.516480 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:12.516480 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:12.517642 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:12.517642 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:12.517642 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:12.517642 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:12.517642 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:12.517642 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:12.517642 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:43:12.517642 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:43:12.517642 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:43:12.517642 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:43:12.517642 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:12.517642 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:12.517642 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:12.517642 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:12.517642 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:12.517642 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:12.518545 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:12.518545 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:12.518545 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:12.518545 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:12.518545 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:12.518545 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:12.518545 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:12.518545 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:12.518545 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:12.518545 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:12.518545 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:43:12.518545 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:12.518545 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 02 00:43:12.518545 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:12.525793 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 449/887] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:43:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:12.528594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0547397-7b94-44b1-a975-bc888a27f1e1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:12.532411 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ee266-3965-46c9-9b01-16ed318765fa None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:12.532899 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:12.606175 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511e29f-3b0f-40f4-885a-5dd7ae5d5395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:12.607464 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511e29f-3b0f-40f4-885a-5dd7ae5d5395 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:12.608006 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511e29f-3b0f-40f4-885a-5dd7ae5d5395 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:12.608609 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511e29f-3b0f-40f4-885a-5dd7ae5d5395 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:12.609883 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511e29f-3b0f-40f4-885a-5dd7ae5d5395 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:12.610683 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511e29f-3b0f-40f4-885a-5dd7ae5d5395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:12.613615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511e29f-3b0f-40f4-885a-5dd7ae5d5395 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:12.631278 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 439/888] 10.222.0.26 () {56 vars in 1115 bytes} [Sun Oct 2 00:43:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:12.641569 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511e29f-3b0f-40f4-885a-5dd7ae5d5395 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:12.658229 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0547397-7b94-44b1-a975-bc888a27f1e1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:12.701714 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6271c7d-afb7-4e90-903c-19147d30be13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:12.702655 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6271c7d-afb7-4e90-903c-19147d30be13 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:12.703133 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6271c7d-afb7-4e90-903c-19147d30be13 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:12.703587 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6271c7d-afb7-4e90-903c-19147d30be13 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:12.704429 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6271c7d-afb7-4e90-903c-19147d30be13 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:12.704931 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6271c7d-afb7-4e90-903c-19147d30be13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:12.706539 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6271c7d-afb7-4e90-903c-19147d30be13 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:12.717406 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 450/889] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:43:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:12.718996 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6271c7d-afb7-4e90-903c-19147d30be13 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:12.824294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511e29f-3b0f-40f4-885a-5dd7ae5d5395 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:12.857812 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:12.865878 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06fce5-e7b9-4f95-a29f-d59016ef51a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:12.866949 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06fce5-e7b9-4f95-a29f-d59016ef51a1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:12.867461 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06fce5-e7b9-4f95-a29f-d59016ef51a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:12.867988 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06fce5-e7b9-4f95-a29f-d59016ef51a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:12.878557 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:12.881786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06fce5-e7b9-4f95-a29f-d59016ef51a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:12.883633 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06fce5-e7b9-4f95-a29f-d59016ef51a1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:12.902864 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-4b06fce5-e7b9-4f95-a29f-d59016ef51a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:12.902864 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:12.902864 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:12.902864 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:12.902864 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:12.902864 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:12.902864 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:12.902864 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:12.902864 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:12.902864 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:12.902864 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:12.902864 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:12.902864 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:12.902864 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:12.902864 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:12.902864 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:12.903927 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:12.903927 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:12.903927 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:12.903927 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:12.903927 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:12.903927 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:12.903927 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:12.903927 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:12.903927 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:12.903927 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:12.903927 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:12.903927 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:12.903927 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:12.903927 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:12.903927 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:12.903927 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:12.903927 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:12.904848 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:12.904848 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:12.904848 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:12.907160 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 440/890] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:12.917369 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06fce5-e7b9-4f95-a29f-d59016ef51a1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:12.940856 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6271c7d-afb7-4e90-903c-19147d30be13 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:13.020962 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6157dd7-a572-42e8-a8f5-a97e02cbb333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:13.021932 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6157dd7-a572-42e8-a8f5-a97e02cbb333 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:13.022435 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6157dd7-a572-42e8-a8f5-a97e02cbb333 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:13.023354 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6157dd7-a572-42e8-a8f5-a97e02cbb333 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:13.024109 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6157dd7-a572-42e8-a8f5-a97e02cbb333 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:13.024750 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6157dd7-a572-42e8-a8f5-a97e02cbb333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:13.028160 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6157dd7-a572-42e8-a8f5-a97e02cbb333 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:13.045341 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 451/891] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:43:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:13.048795 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6157dd7-a572-42e8-a8f5-a97e02cbb333 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:13.071160 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06fce5-e7b9-4f95-a29f-d59016ef51a1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:13.133418 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15714ed3-c23c-4ce3-a492-5a409c3222fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:13.134342 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15714ed3-c23c-4ce3-a492-5a409c3222fa None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:13.135333 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15714ed3-c23c-4ce3-a492-5a409c3222fa None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:13.135979 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15714ed3-c23c-4ce3-a492-5a409c3222fa None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:13.136913 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15714ed3-c23c-4ce3-a492-5a409c3222fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:13.137414 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15714ed3-c23c-4ce3-a492-5a409c3222fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:13.140006 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15714ed3-c23c-4ce3-a492-5a409c3222fa None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:13.161968 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 441/892] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:13.164382 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7805de-86d2-4a7b-ad5b-d8556688df40 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:13.164886 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7805de-86d2-4a7b-ad5b-d8556688df40 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:13.165401 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7805de-86d2-4a7b-ad5b-d8556688df40 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:13.168031 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 442/893] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:13.169523 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7805de-86d2-4a7b-ad5b-d8556688df40 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:13.178760 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6157dd7-a572-42e8-a8f5-a97e02cbb333 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:13.226539 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:13.234793 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee984b85-7bf4-4fd4-b28e-368f533d6a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:13.235416 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee984b85-7bf4-4fd4-b28e-368f533d6a2e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:13.235697 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee984b85-7bf4-4fd4-b28e-368f533d6a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:13.235968 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee984b85-7bf4-4fd4-b28e-368f533d6a2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:13.236880 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee984b85-7bf4-4fd4-b28e-368f533d6a2e None admin] RBAC: Adding query filter params (interface=public, service_id=3845da443c004adc8c7eaa4556266ddb, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:13.237217 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee984b85-7bf4-4fd4-b28e-368f533d6a2e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:13.239522 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee984b85-7bf4-4fd4-b28e-368f533d6a2e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:13.253123 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 452/894] 10.222.0.26 () {56 vars in 1251 bytes} [Sun Oct 2 00:43:13 2022] GET /identity/v3/endpoints?service_id=3845da443c004adc8c7eaa4556266ddb&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:13.253123 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b799515-8aa7-49f9-8948-e27f8bd24c15 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:13.253123 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b799515-8aa7-49f9-8948-e27f8bd24c15 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:13.253123 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b799515-8aa7-49f9-8948-e27f8bd24c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:13.271984 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2b799515-8aa7-49f9-8948-e27f8bd24c15 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:13.273146 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2b799515-8aa7-49f9-8948-e27f8bd24c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:13.273656 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:13.340184 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7805de-86d2-4a7b-ad5b-d8556688df40 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:13.375111 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 453/895] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:13.376277 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b799515-8aa7-49f9-8948-e27f8bd24c15 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:13.428463 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50ee83-3201-498b-914c-9a32b2c51daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:13.429892 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50ee83-3201-498b-914c-9a32b2c51daa None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:13.430215 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50ee83-3201-498b-914c-9a32b2c51daa None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:13.430434 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50ee83-3201-498b-914c-9a32b2c51daa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:13.443824 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50ee83-3201-498b-914c-9a32b2c51daa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:13.445363 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50ee83-3201-498b-914c-9a32b2c51daa None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:13.459885 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-cb50ee83-3201-498b-914c-9a32b2c51daa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:43:13.459885 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:13.459885 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:13.459885 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:13.459885 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:13.459885 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:13.459885 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:13.459885 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:13.459885 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:13.459885 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:13.459885 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:13.459885 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:13.459885 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:43:13.459885 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:43:13.459885 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:43:13.459885 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:43:13.461746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:13.461746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:13.461746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:43:13.461746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:13.461746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:43:13.461746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:13.461746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:13.461746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:13.461746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:13.461746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:13.461746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:13.461746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:13.461746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:13.461746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:13.461746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:13.461746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:13.461746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:13.461746 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:13.464900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:13.464900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:13.464900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:43:13.464900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:43:13.464900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:43:13.464900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:43:13.464900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:43:13.464900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:43:13.464900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:43:13.464900 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:13.467429 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 443/896] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Oct 2 00:43:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:13.467429 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50ee83-3201-498b-914c-9a32b2c51daa None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:13.599129 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b799515-8aa7-49f9-8948-e27f8bd24c15 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:13.629698 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:13.639718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50ee83-3201-498b-914c-9a32b2c51daa None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:13.645287 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33643418-b0f9-43c6-9b3c-d67ecdcfcc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:13.645962 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643418-b0f9-43c6-9b3c-d67ecdcfcc20 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:13.646269 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643418-b0f9-43c6-9b3c-d67ecdcfcc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:13.646526 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643418-b0f9-43c6-9b3c-d67ecdcfcc20 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:13.647185 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33643418-b0f9-43c6-9b3c-d67ecdcfcc20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:13.649105 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33643418-b0f9-43c6-9b3c-d67ecdcfcc20 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:13.656970 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 454/897] 10.222.0.26 () {56 vars in 1087 bytes} [Sun Oct 2 00:43:13 2022] GET /identity/v3/services => generated 1268 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:43:13.679777 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:13.722336 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f763ad-1d36-4b49-821c-81bf149ecef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:13.723442 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f763ad-1d36-4b49-821c-81bf149ecef6 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:13.723924 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f763ad-1d36-4b49-821c-81bf149ecef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:13.724395 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f763ad-1d36-4b49-821c-81bf149ecef6 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:13.725778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f763ad-1d36-4b49-821c-81bf149ecef6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:13.726312 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f763ad-1d36-4b49-821c-81bf149ecef6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:13.729673 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f763ad-1d36-4b49-821c-81bf149ecef6 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:13.768043 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 444/898] 10.222.0.26 () {56 vars in 1149 bytes} [Sun Oct 2 00:43:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:13.773924 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33643418-b0f9-43c6-9b3c-d67ecdcfcc20 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:13.858454 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f763ad-1d36-4b49-821c-81bf149ecef6 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:13.981671 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33643418-b0f9-43c6-9b3c-d67ecdcfcc20 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:14.009125 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f763ad-1d36-4b49-821c-81bf149ecef6 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:14.052803 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d1c90-db62-449c-95cc-2765b30e7494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:14.053813 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d1c90-db62-449c-95cc-2765b30e7494 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:14.054424 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d1c90-db62-449c-95cc-2765b30e7494 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:14.054971 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d1c90-db62-449c-95cc-2765b30e7494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:14.075394 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198801a0-7db9-4cb2-a622-be7df11f6fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:14.076340 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198801a0-7db9-4cb2-a622-be7df11f6fd1 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:14.076773 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198801a0-7db9-4cb2-a622-be7df11f6fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:14.077227 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198801a0-7db9-4cb2-a622-be7df11f6fd1 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:14.078317 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198801a0-7db9-4cb2-a622-be7df11f6fd1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:14.080662 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198801a0-7db9-4cb2-a622-be7df11f6fd1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:14.108755 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 445/899] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Oct 2 00:43:13 2022] POST /identity/v3/services => generated 241 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:43:14.189552 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:14.218040 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d1c90-db62-449c-95cc-2765b30e7494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:14.221114 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d1c90-db62-449c-95cc-2765b30e7494 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:14.430527 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 455/900] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:43:13 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:43:14.437031 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198801a0-7db9-4cb2-a622-be7df11f6fd1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:14.473697 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:14.631536 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198801a0-7db9-4cb2-a622-be7df11f6fd1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:14.700839 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16eaea-3528-4f48-a8bd-be8230bd766d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:14.702041 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16eaea-3528-4f48-a8bd-be8230bd766d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:14.702418 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16eaea-3528-4f48-a8bd-be8230bd766d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:14.702904 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16eaea-3528-4f48-a8bd-be8230bd766d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:14.726345 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16eaea-3528-4f48-a8bd-be8230bd766d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:14.727860 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16eaea-3528-4f48-a8bd-be8230bd766d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:14.747729 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-fb16eaea-3528-4f48-a8bd-be8230bd766d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:14.747729 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:14.747729 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:14.747729 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:14.747729 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:14.747729 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:14.747729 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:14.747729 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:14.747729 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:14.747729 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:14.747729 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:14.747729 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:14.747729 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:14.747729 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:14.747729 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:14.747729 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:14.749556 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:14.749556 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:14.749556 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:14.749556 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:14.749556 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:14.749556 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:14.749556 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:14.749556 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:14.749556 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:14.749556 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:14.749556 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:14.749556 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:14.749556 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:14.749556 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:14.749556 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:14.749556 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:14.749556 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:14.751301 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:14.751301 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:14.751301 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:14.751301 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 446/901] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:14.761946 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d1c90-db62-449c-95cc-2765b30e7494 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:14.917993 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259cbfd-c4e6-4439-a981-f1addfcb77a0 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:14.918522 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259cbfd-c4e6-4439-a981-f1addfcb77a0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:14.919016 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259cbfd-c4e6-4439-a981-f1addfcb77a0 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:14.922894 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 447/902] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:14.928259 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:14.932051 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3d842-b476-4f42-95d4-9020b1277320 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:14.932325 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3d842-b476-4f42-95d4-9020b1277320 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:14.932578 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3d842-b476-4f42-95d4-9020b1277320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:14.953493 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d1c90-db62-449c-95cc-2765b30e7494 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:14.967071 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b8f3d842-b476-4f42-95d4-9020b1277320 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:14.969965 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b8f3d842-b476-4f42-95d4-9020b1277320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:15.017981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e79e2-200a-4de6-84c2-83d5b39545be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:15.019836 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e79e2-200a-4de6-84c2-83d5b39545be None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:15.020539 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e79e2-200a-4de6-84c2-83d5b39545be None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:15.021245 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e79e2-200a-4de6-84c2-83d5b39545be None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:15.022506 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e79e2-200a-4de6-84c2-83d5b39545be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:15.023150 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e79e2-200a-4de6-84c2-83d5b39545be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:15.025627 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e79e2-200a-4de6-84c2-83d5b39545be None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:15.049136 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 456/903] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:15.055643 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e79e2-200a-4de6-84c2-83d5b39545be None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:15.101806 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 448/904] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:15.244742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e79e2-200a-4de6-84c2-83d5b39545be None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:15.310169 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abda7ac-db72-4a5a-bfc1-3c8f7a121914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:15.311262 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda7ac-db72-4a5a-bfc1-3c8f7a121914 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:15.311763 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda7ac-db72-4a5a-bfc1-3c8f7a121914 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:15.312254 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda7ac-db72-4a5a-bfc1-3c8f7a121914 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:15.325848 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abda7ac-db72-4a5a-bfc1-3c8f7a121914 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:15.328416 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abda7ac-db72-4a5a-bfc1-3c8f7a121914 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:15.351329 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-7abda7ac-db72-4a5a-bfc1-3c8f7a121914 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:15.351329 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:15.351329 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:15.351329 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:15.351329 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:15.351329 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:15.351329 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:15.351329 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:15.351329 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:15.351329 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:15.351329 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:15.351329 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:15.351329 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:43:15.351329 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:43:15.351329 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:43:15.352305 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:43:15.352305 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:15.352305 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:15.352305 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:15.352305 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:15.352305 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:15.352305 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:15.352305 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:15.352305 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:15.352305 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:15.352305 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:15.352305 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:15.352305 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:15.352305 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:15.352305 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:15.352305 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:15.352305 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:15.353307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:43:15.353307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:43:15.353307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:43:15.353307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:43:15.353307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:43:15.353307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:43:15.353307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:15.353307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:15.353969 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 457/905] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:43:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:15.360434 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3d842-b476-4f42-95d4-9020b1277320 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:15.379660 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:15.401409 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abda7ac-db72-4a5a-bfc1-3c8f7a121914 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:15.424546 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:15.582026 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3d842-b476-4f42-95d4-9020b1277320 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:15.631332 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abda7ac-db72-4a5a-bfc1-3c8f7a121914 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:15.660850 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5a319-90df-4951-b073-a9c4986a6a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:15.661840 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5a319-90df-4951-b073-a9c4986a6a89 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:15.662249 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5a319-90df-4951-b073-a9c4986a6a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:15.662660 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5a319-90df-4951-b073-a9c4986a6a89 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:15.663753 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5a319-90df-4951-b073-a9c4986a6a89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:15.664224 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5a319-90df-4951-b073-a9c4986a6a89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:15.670180 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5a319-90df-4951-b073-a9c4986a6a89 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:15.696926 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 449/906] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:43:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:15.703643 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5a319-90df-4951-b073-a9c4986a6a89 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:15.704604 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353986e7-d822-408a-a0cc-044feeb2e5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:15.705580 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353986e7-d822-408a-a0cc-044feeb2e5cd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:15.706049 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353986e7-d822-408a-a0cc-044feeb2e5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:15.706505 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353986e7-d822-408a-a0cc-044feeb2e5cd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:15.707506 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353986e7-d822-408a-a0cc-044feeb2e5cd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:15.709915 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353986e7-d822-408a-a0cc-044feeb2e5cd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:15.725645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-353986e7-d822-408a-a0cc-044feeb2e5cd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 02 00:43:15.725645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:15.725645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:43:15.725645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:43:15.725645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:43:15.725645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:43:15.725645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:43:15.725645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:15.725645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 02 00:43:15.725645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:15.725645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:15.725645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:15.725645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:15.725645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:15.725645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:15.725645 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:15.727492 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:15.727492 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:15.727492 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:15.727492 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:15.727492 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:15.727492 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:15.727492 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:15.727492 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:43:15.727492 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:43:15.727492 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:43:15.727492 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:43:15.727492 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:15.727492 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:15.727492 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:15.727492 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:15.727492 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:15.727492 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:15.729687 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:15.729687 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:15.729687 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:15.729687 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:15.729687 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:15.729687 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:15.729687 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:15.729687 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:15.729687 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:15.729687 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:15.729687 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:43:15.729687 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:15.729687 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 02 00:43:15.729687 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:15.729687 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 458/907] 10.222.0.26 () {56 vars in 1132 bytes} [Sun Oct 2 00:43:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:15.737911 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353986e7-d822-408a-a0cc-044feeb2e5cd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:15.846553 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:15.859349 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:15.890116 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353986e7-d822-408a-a0cc-044feeb2e5cd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:15.936727 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5a319-90df-4951-b073-a9c4986a6a89 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:15.949186 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6aa6-afc6-4b97-bbba-09d0aafb4114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:15.951055 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6aa6-afc6-4b97-bbba-09d0aafb4114 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:15.951954 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6aa6-afc6-4b97-bbba-09d0aafb4114 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:15.952725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6aa6-afc6-4b97-bbba-09d0aafb4114 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:15.954703 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a6aa6-afc6-4b97-bbba-09d0aafb4114 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:15.955605 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a6aa6-afc6-4b97-bbba-09d0aafb4114 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:15.959095 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a6aa6-afc6-4b97-bbba-09d0aafb4114 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:15.970408 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 459/908] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Oct 2 00:43:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:15.980366 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6aa6-afc6-4b97-bbba-09d0aafb4114 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:15.980615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecaaa0-34e5-42ce-9693-1761e7fd3787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:15.981449 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecaaa0-34e5-42ce-9693-1761e7fd3787 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:15.981662 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecaaa0-34e5-42ce-9693-1761e7fd3787 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:15.981955 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecaaa0-34e5-42ce-9693-1761e7fd3787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:15.984787 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecaaa0-34e5-42ce-9693-1761e7fd3787 None admin] RBAC: Adding query filter params (role.id=64c56800e24e42a496f2aba027c62ab0, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=42dcae7ba3c241eb8d7d0894aadb467f) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:15.984787 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecaaa0-34e5-42ce-9693-1761e7fd3787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:15.984787 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecaaa0-34e5-42ce-9693-1761e7fd3787 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:15.991297 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 450/909] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:43:15 2022] GET /identity/v3/role_assignments?user.id=42dcae7ba3c241eb8d7d0894aadb467f&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=64c56800e24e42a496f2aba027c62ab0 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:16.171472 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6aa6-afc6-4b97-bbba-09d0aafb4114 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:16.237461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb7ce6-96ab-493f-b41e-06051ff4ada5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:16.238930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb7ce6-96ab-493f-b41e-06051ff4ada5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:16.239673 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb7ce6-96ab-493f-b41e-06051ff4ada5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:16.240402 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb7ce6-96ab-493f-b41e-06051ff4ada5 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:16.241799 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb7ce6-96ab-493f-b41e-06051ff4ada5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:16.242595 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb7ce6-96ab-493f-b41e-06051ff4ada5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:16.245925 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb7ce6-96ab-493f-b41e-06051ff4ada5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:16.252558 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:16.256019 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 460/910] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Oct 2 00:43:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:16.262426 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecaaa0-34e5-42ce-9693-1761e7fd3787 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:16.387246 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecaaa0-34e5-42ce-9693-1761e7fd3787 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:16.431948 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:16.437618 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5269a34-f782-4228-a825-28723afae1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:16.438452 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5269a34-f782-4228-a825-28723afae1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:16.438787 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5269a34-f782-4228-a825-28723afae1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:16.439063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5269a34-f782-4228-a825-28723afae1b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:16.439816 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5269a34-f782-4228-a825-28723afae1b8 None admin] RBAC: Adding query filter params (interface=public, service_id=75ad1e8fed224978b6f4985808421c26, region_id=RegionOne) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:16.440134 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5269a34-f782-4228-a825-28723afae1b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:16.441689 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5269a34-f782-4228-a825-28723afae1b8 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:16.448477 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 451/911] 10.222.0.26 () {56 vars in 1251 bytes} [Sun Oct 2 00:43:16 2022] GET /identity/v3/endpoints?service_id=75ad1e8fed224978b6f4985808421c26&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:16.455341 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb7ce6-96ab-493f-b41e-06051ff4ada5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:16.570856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645382d0-f5f3-484a-92ba-d174c5981c4f None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:16.571199 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645382d0-f5f3-484a-92ba-d174c5981c4f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:16.571585 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645382d0-f5f3-484a-92ba-d174c5981c4f None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:16.574089 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 452/912] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:16.583429 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e1a02-dcad-4a1d-8969-e1d27b940d92 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:16.583911 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e1a02-dcad-4a1d-8969-e1d27b940d92 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:16.584540 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e1a02-dcad-4a1d-8969-e1d27b940d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:16.619330 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-c13e1a02-dcad-4a1d-8969-e1d27b940d92 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:16.621684 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c13e1a02-dcad-4a1d-8969-e1d27b940d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:16.621972 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb7ce6-96ab-493f-b41e-06051ff4ada5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:16.677237 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447ff2a-723c-4e8e-8b82-6d3908e71edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:16.677927 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447ff2a-723c-4e8e-8b82-6d3908e71edb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:16.678207 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447ff2a-723c-4e8e-8b82-6d3908e71edb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:16.678486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447ff2a-723c-4e8e-8b82-6d3908e71edb None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:16.679137 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447ff2a-723c-4e8e-8b82-6d3908e71edb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:16.680599 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447ff2a-723c-4e8e-8b82-6d3908e71edb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:16.689523 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 461/913] 10.222.0.26 () {56 vars in 1087 bytes} [Sun Oct 2 00:43:16 2022] GET /identity/v3/services => generated 1497 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 00:43:16.737439 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 453/914] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:16.997027 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a39fb-c5f0-4625-8c55-a0db54ab04f3 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:16.997268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a39fb-c5f0-4625-8c55-a0db54ab04f3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:16.997597 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a39fb-c5f0-4625-8c55-a0db54ab04f3 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:16.999052 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 462/915] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:17.008376 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f493a-850c-4f4c-9773-92b169bbb428 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:17.009315 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f493a-850c-4f4c-9773-92b169bbb428 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:17.010148 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f493a-850c-4f4c-9773-92b169bbb428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:17.043698 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4c7f493a-850c-4f4c-9773-92b169bbb428 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:17.045911 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4c7f493a-850c-4f4c-9773-92b169bbb428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:17.179156 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 454/916] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:17.257173 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a39fb-c5f0-4625-8c55-a0db54ab04f3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:17.386983 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:17.471035 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a39fb-c5f0-4625-8c55-a0db54ab04f3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:17.537255 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8f5d5-200c-41f4-9d84-8c626ae6174b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:17.538221 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8f5d5-200c-41f4-9d84-8c626ae6174b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:17.538695 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8f5d5-200c-41f4-9d84-8c626ae6174b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:17.539162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8f5d5-200c-41f4-9d84-8c626ae6174b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:17.540281 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8f5d5-200c-41f4-9d84-8c626ae6174b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:17.543359 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8f5d5-200c-41f4-9d84-8c626ae6174b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:17.561080 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-fae8f5d5-200c-41f4-9d84-8c626ae6174b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 02 00:43:17.561080 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:17.561080 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:43:17.561080 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:43:17.561080 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:43:17.561080 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:43:17.561080 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:43:17.561080 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:17.561080 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 02 00:43:17.561080 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:17.561080 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:17.561080 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:17.561080 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:17.561080 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:17.561080 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:17.561080 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:17.561080 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:17.563025 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:17.563025 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:17.563025 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:17.563025 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:17.563025 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:17.563025 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:17.563025 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:43:17.563025 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:43:17.563025 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:43:17.563025 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:43:17.563025 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:17.563025 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:17.563025 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:17.563025 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:17.563025 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:17.563025 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:17.566481 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:17.566481 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:17.566481 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:17.566481 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:17.566481 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:17.566481 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:17.566481 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:17.566481 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:17.566481 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:17.566481 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:17.566481 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:43:17.566481 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:17.566481 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 02 00:43:17.566481 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:17.566481 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 463/917] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:43:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:17.579720 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f493a-850c-4f4c-9773-92b169bbb428 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:17.692739 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:17.745671 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8f5d5-200c-41f4-9d84-8c626ae6174b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:17.778861 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f493a-850c-4f4c-9773-92b169bbb428 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:17.831870 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0dbf0e-46c6-463c-97ab-11236409ade5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:17.832384 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dbf0e-46c6-463c-97ab-11236409ade5 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:17.832686 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dbf0e-46c6-463c-97ab-11236409ade5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:17.832930 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dbf0e-46c6-463c-97ab-11236409ade5 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:17.833588 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0dbf0e-46c6-463c-97ab-11236409ade5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:17.833885 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0dbf0e-46c6-463c-97ab-11236409ade5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:17.835265 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0dbf0e-46c6-463c-97ab-11236409ade5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:17.844976 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 455/918] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:43:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:17.851162 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0dbf0e-46c6-463c-97ab-11236409ade5 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:17.942512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8f5d5-200c-41f4-9d84-8c626ae6174b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:17.991357 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:17.992375 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0dbf0e-46c6-463c-97ab-11236409ade5 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:18.006451 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85e5cf-f1ed-41fa-97a5-29787e85c707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:18.007385 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85e5cf-f1ed-41fa-97a5-29787e85c707 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:18.007872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85e5cf-f1ed-41fa-97a5-29787e85c707 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:18.008352 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85e5cf-f1ed-41fa-97a5-29787e85c707 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:18.009569 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85e5cf-f1ed-41fa-97a5-29787e85c707 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:18.011619 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85e5cf-f1ed-41fa-97a5-29787e85c707 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:18.019503 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:18.030381 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-1e85e5cf-f1ed-41fa-97a5-29787e85c707 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:43:18.030381 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:18.030381 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:43:18.030381 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:43:18.030381 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:43:18.030381 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:43:18.030381 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:43:18.030381 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:18.030381 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:43:18.030381 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:18.030381 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:18.030381 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:18.030381 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:18.030381 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:18.030381 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:18.030381 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:18.030381 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:18.031494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:18.031494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:18.031494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:18.031494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:18.031494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:18.031494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:18.031494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:43:18.031494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:43:18.031494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:43:18.031494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:43:18.031494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:18.031494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:18.031494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:18.031494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:18.031494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:18.031494 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:18.032354 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:18.032354 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:18.032354 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:18.032354 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:18.032354 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:18.032354 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:18.032354 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:18.032354 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:18.032354 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:18.032354 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:18.032354 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:43:18.032354 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:18.032354 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:43:18.032354 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:18.033171 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 464/919] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Oct 2 00:43:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:18.043541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85e5cf-f1ed-41fa-97a5-29787e85c707 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:18.048366 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc7035-ddd1-448b-9efa-9a99e104205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:18.049461 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc7035-ddd1-448b-9efa-9a99e104205e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:18.050179 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc7035-ddd1-448b-9efa-9a99e104205e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:18.050738 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc7035-ddd1-448b-9efa-9a99e104205e None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:18.052157 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc7035-ddd1-448b-9efa-9a99e104205e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:18.052665 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc7035-ddd1-448b-9efa-9a99e104205e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:18.054801 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc7035-ddd1-448b-9efa-9a99e104205e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:18.072975 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 456/920] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Oct 2 00:43:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:18.075565 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc7035-ddd1-448b-9efa-9a99e104205e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:18.225321 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85e5cf-f1ed-41fa-97a5-29787e85c707 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:18.272951 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233be86c-cd23-468b-b41c-0f62351735ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:18.274032 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233be86c-cd23-468b-b41c-0f62351735ab None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:18.274528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233be86c-cd23-468b-b41c-0f62351735ab None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:18.275193 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233be86c-cd23-468b-b41c-0f62351735ab None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:18.276410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233be86c-cd23-468b-b41c-0f62351735ab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:18.276926 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233be86c-cd23-468b-b41c-0f62351735ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:18.279631 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233be86c-cd23-468b-b41c-0f62351735ab None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:18.289757 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 465/921] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Oct 2 00:43:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:18.298127 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233be86c-cd23-468b-b41c-0f62351735ab None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:18.301476 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc7035-ddd1-448b-9efa-9a99e104205e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:18.346871 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51260f2a-91a1-46d3-9a28-3e6a68c66e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:18.347803 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260f2a-91a1-46d3-9a28-3e6a68c66e07 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:18.348236 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260f2a-91a1-46d3-9a28-3e6a68c66e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:18.348674 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260f2a-91a1-46d3-9a28-3e6a68c66e07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:18.349560 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51260f2a-91a1-46d3-9a28-3e6a68c66e07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:18.351155 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51260f2a-91a1-46d3-9a28-3e6a68c66e07 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:18.393439 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 457/922] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:43:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:43:18.401696 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:18.461553 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233be86c-cd23-468b-b41c-0f62351735ab None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:18.515053 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b95a09-3c90-45e6-954b-cbdc9704c0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:18.515586 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b95a09-3c90-45e6-954b-cbdc9704c0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:18.515912 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b95a09-3c90-45e6-954b-cbdc9704c0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:18.516191 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b95a09-3c90-45e6-954b-cbdc9704c0e5 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:18.516846 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b95a09-3c90-45e6-954b-cbdc9704c0e5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:18.517178 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b95a09-3c90-45e6-954b-cbdc9704c0e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:18.518606 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b95a09-3c90-45e6-954b-cbdc9704c0e5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:18.525632 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 466/923] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Oct 2 00:43:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:18.535468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51260f2a-91a1-46d3-9a28-3e6a68c66e07 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:18.617542 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:18.699766 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51260f2a-91a1-46d3-9a28-3e6a68c66e07 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:18.764759 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a992f4-f6eb-424a-a5f1-baec18eea461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:18.766217 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a992f4-f6eb-424a-a5f1-baec18eea461 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:18.766994 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a992f4-f6eb-424a-a5f1-baec18eea461 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:18.767772 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a992f4-f6eb-424a-a5f1-baec18eea461 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:18.769410 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a992f4-f6eb-424a-a5f1-baec18eea461 None admin] RBAC: Adding query filter params (interface=public, service_id=1dc24cd55a5342579868156528069e2c, region_id=RegionOne) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:18.770244 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a992f4-f6eb-424a-a5f1-baec18eea461 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:18.773183 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a992f4-f6eb-424a-a5f1-baec18eea461 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:18.784858 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 458/924] 10.222.0.26 () {56 vars in 1251 bytes} [Sun Oct 2 00:43:18 2022] GET /identity/v3/endpoints?service_id=1dc24cd55a5342579868156528069e2c&interface=public®ion_id=RegionOne => generated 194 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:18.795984 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b95a09-3c90-45e6-954b-cbdc9704c0e5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:18.840499 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2ba4a-8d84-4ee0-815f-4ba15ef769fd None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:18.841494 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2ba4a-8d84-4ee0-815f-4ba15ef769fd None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:18.842278 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2ba4a-8d84-4ee0-815f-4ba15ef769fd None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:18.845430 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 459/925] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:43:18.854441 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a322202-4f29-489c-8dba-2a68b1b44175 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:18.855308 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a322202-4f29-489c-8dba-2a68b1b44175 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:18.856045 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a322202-4f29-489c-8dba-2a68b1b44175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:18.887474 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3a322202-4f29-489c-8dba-2a68b1b44175 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:18.890185 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3a322202-4f29-489c-8dba-2a68b1b44175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:18.935132 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b95a09-3c90-45e6-954b-cbdc9704c0e5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:18.959608 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:18.987314 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e14942-5a81-4c5d-99ec-90776c069f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:18.987947 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e14942-5a81-4c5d-99ec-90776c069f16 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:18.988248 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e14942-5a81-4c5d-99ec-90776c069f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:18.988670 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e14942-5a81-4c5d-99ec-90776c069f16 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:18.989472 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e14942-5a81-4c5d-99ec-90776c069f16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:18.990886 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e14942-5a81-4c5d-99ec-90776c069f16 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:18.998993 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 467/926] 10.222.0.26 () {56 vars in 1087 bytes} [Sun Oct 2 00:43:18 2022] GET /identity/v3/services => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:43:19.030338 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 460/927] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:43:19.561526 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e14942-5a81-4c5d-99ec-90776c069f16 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:19.667959 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72923a49-4ae3-4880-a8e9-f1d6f57287a0 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:19.668401 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72923a49-4ae3-4880-a8e9-f1d6f57287a0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:19.669173 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72923a49-4ae3-4880-a8e9-f1d6f57287a0 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:19.678252 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 461/928] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:19.680558 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef598880-ea38-48ca-8b02-c2f4485c5753 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:19.682783 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef598880-ea38-48ca-8b02-c2f4485c5753 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:19.683543 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef598880-ea38-48ca-8b02-c2f4485c5753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:19.717055 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ef598880-ea38-48ca-8b02-c2f4485c5753 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:19.719454 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ef598880-ea38-48ca-8b02-c2f4485c5753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:19.740749 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e14942-5a81-4c5d-99ec-90776c069f16 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:19.772730 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:19.793578 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebacba9-d1da-443a-a571-03c52d6ab405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:19.794238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebacba9-d1da-443a-a571-03c52d6ab405 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:19.794508 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebacba9-d1da-443a-a571-03c52d6ab405 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:19.794981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebacba9-d1da-443a-a571-03c52d6ab405 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:19.808841 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebacba9-d1da-443a-a571-03c52d6ab405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:43:19.814966 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-1ebacba9-d1da-443a-a571-03c52d6ab405 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:43:19.814966 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:19.814966 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:19.814966 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:19.814966 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:19.814966 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:19.814966 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:19.814966 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:19.814966 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:19.814966 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:19.814966 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:19.814966 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:19.814966 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:43:19.814966 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:43:19.814966 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:43:19.814966 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:43:19.816024 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:43:19.816024 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:43:19.816024 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:43:19.816024 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:43:19.816024 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:19.816024 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:19.816024 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:19.816024 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:19.816024 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:19.816024 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:19.816024 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:19.816024 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:19.816024 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:19.816024 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:19.816024 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:19.816024 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:19.816874 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:19.816874 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:19.816874 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:19.816874 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:19.816874 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:43:19.816874 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:43:19.816874 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:43:19.816874 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:43:19.816874 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:43:19.816874 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:43:19.816874 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:43:19.816874 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:19.825333 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 468/929] 10.222.0.26 () {56 vars in 1120 bytes} [Sun Oct 2 00:43:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:19.826607 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebacba9-d1da-443a-a571-03c52d6ab405 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:19.859671 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 462/930] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:43:19.902485 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:19.983816 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebacba9-d1da-443a-a571-03c52d6ab405 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:20.028968 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a9c75-a9d8-4c98-935e-45a86c0a5394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:20.029990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a9c75-a9d8-4c98-935e-45a86c0a5394 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:20.030509 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a9c75-a9d8-4c98-935e-45a86c0a5394 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:20.030992 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a9c75-a9d8-4c98-935e-45a86c0a5394 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:20.031907 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a9c75-a9d8-4c98-935e-45a86c0a5394 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:20.032502 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a9c75-a9d8-4c98-935e-45a86c0a5394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:20.034203 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a9c75-a9d8-4c98-935e-45a86c0a5394 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:20.046147 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 469/931] 10.222.0.26 () {56 vars in 1115 bytes} [Sun Oct 2 00:43:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:20.052395 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef598880-ea38-48ca-8b02-c2f4485c5753 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:20.252625 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef598880-ea38-48ca-8b02-c2f4485c5753 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:20.320507 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa708060-9786-4e18-959c-1c0ad72bb2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:20.321622 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa708060-9786-4e18-959c-1c0ad72bb2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:20.322933 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa708060-9786-4e18-959c-1c0ad72bb2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:20.323610 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa708060-9786-4e18-959c-1c0ad72bb2c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:20.343641 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa708060-9786-4e18-959c-1c0ad72bb2c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:20.346508 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa708060-9786-4e18-959c-1c0ad72bb2c9 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:20.352472 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a9c75-a9d8-4c98-935e-45a86c0a5394 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:20.376844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-aa708060-9786-4e18-959c-1c0ad72bb2c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:20.376844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:20.376844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:20.376844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:20.376844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:20.376844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:20.376844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:20.376844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:20.376844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:20.376844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:20.376844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:20.376844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:20.376844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:20.376844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:20.376844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:20.376844 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:20.377884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:20.377884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:20.377884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:20.377884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:20.377884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:20.377884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:20.377884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:20.377884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:20.377884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:20.377884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:20.377884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:20.377884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:20.377884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:20.377884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:20.377884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:20.377884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:20.377884 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:20.378796 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:20.378796 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:20.378796 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:20.378973 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 463/932] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:20.389816 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa708060-9786-4e18-959c-1c0ad72bb2c9 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:20.429234 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:20.581856 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a9c75-a9d8-4c98-935e-45a86c0a5394 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:20.585918 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:20.611866 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa708060-9786-4e18-959c-1c0ad72bb2c9 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:20.656865 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067a69e-fc99-4fd6-b3cf-f8c5725f83cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:20.659143 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067a69e-fc99-4fd6-b3cf-f8c5725f83cf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:20.660168 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067a69e-fc99-4fd6-b3cf-f8c5725f83cf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:20.660986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067a69e-fc99-4fd6-b3cf-f8c5725f83cf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:20.662195 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067a69e-fc99-4fd6-b3cf-f8c5725f83cf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:20.666126 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067a69e-fc99-4fd6-b3cf-f8c5725f83cf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:20.679381 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef0717-df44-4686-8311-66f4715e9199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:20.680587 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef0717-df44-4686-8311-66f4715e9199 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:20.681845 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef0717-df44-4686-8311-66f4715e9199 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:20.682468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef0717-df44-4686-8311-66f4715e9199 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:20.683987 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef0717-df44-4686-8311-66f4715e9199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:20.684652 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef0717-df44-4686-8311-66f4715e9199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:20.687555 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef0717-df44-4686-8311-66f4715e9199 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:20.688677 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c067a69e-fc99-4fd6-b3cf-f8c5725f83cf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 02 00:43:20.688677 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:20.688677 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:43:20.688677 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:43:20.688677 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:43:20.688677 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:43:20.688677 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:43:20.688677 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:20.688677 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 02 00:43:20.688677 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:20.688677 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:20.688677 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:20.688677 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:20.688677 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:20.688677 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:20.688677 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:20.690701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:20.690701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:20.690701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:20.690701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:20.690701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:20.690701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:20.690701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:20.690701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:43:20.690701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:43:20.690701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:43:20.690701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:43:20.690701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:20.690701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:20.690701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:20.690701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:20.690701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:20.690701 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:20.692842 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:20.692842 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:20.692842 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:20.692842 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:20.692842 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:20.692842 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:20.692842 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:20.692842 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:20.692842 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:20.692842 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:20.692842 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:43:20.692842 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:20.692842 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 02 00:43:20.692842 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:20.705029 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 470/933] 10.222.0.26 () {56 vars in 1132 bytes} [Sun Oct 2 00:43:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:20.708513 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067a69e-fc99-4fd6-b3cf-f8c5725f83cf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:20.725308 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 464/934] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:20.735193 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef0717-df44-4686-8311-66f4715e9199 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:20.922511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:20.930854 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067a69e-fc99-4fd6-b3cf-f8c5725f83cf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:20.983474 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef0717-df44-4686-8311-66f4715e9199 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:21.013543 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210bfa8-0a2b-468a-a477-e6750d118351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:21.015802 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210bfa8-0a2b-468a-a477-e6750d118351 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:21.016914 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210bfa8-0a2b-468a-a477-e6750d118351 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:21.017704 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210bfa8-0a2b-468a-a477-e6750d118351 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:21.019455 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210bfa8-0a2b-468a-a477-e6750d118351 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:21.020840 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210bfa8-0a2b-468a-a477-e6750d118351 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:21.023720 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210bfa8-0a2b-468a-a477-e6750d118351 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:21.041838 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 471/935] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Oct 2 00:43:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:21.048887 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210bfa8-0a2b-468a-a477-e6750d118351 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:21.062617 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b21e9-ed01-433f-aa7c-ae225e79b480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:21.063654 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b21e9-ed01-433f-aa7c-ae225e79b480 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:21.064126 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b21e9-ed01-433f-aa7c-ae225e79b480 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:21.064603 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b21e9-ed01-433f-aa7c-ae225e79b480 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:21.082021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b21e9-ed01-433f-aa7c-ae225e79b480 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:21.085078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b21e9-ed01-433f-aa7c-ae225e79b480 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:21.114709 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e06b21e9-ed01-433f-aa7c-ae225e79b480 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:43:21.114709 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:21.114709 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:21.114709 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:21.114709 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:21.114709 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:21.114709 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:21.114709 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:21.114709 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:21.114709 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:21.114709 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:21.114709 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:21.114709 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:43:21.114709 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:43:21.114709 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:43:21.114709 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:43:21.116564 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:21.116564 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:21.116564 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:43:21.116564 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:21.116564 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:43:21.116564 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:21.116564 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:21.116564 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:21.116564 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:21.116564 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:21.116564 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:21.116564 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:21.116564 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:21.116564 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:21.116564 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:21.116564 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:21.116564 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:21.116564 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:21.118805 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:21.118805 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:21.118805 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:43:21.118805 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:43:21.118805 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:43:21.118805 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:43:21.118805 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:43:21.118805 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:43:21.118805 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:43:21.118805 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:21.122279 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:21.124181 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 465/936] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Oct 2 00:43:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:21.128138 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b21e9-ed01-433f-aa7c-ae225e79b480 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:21.284179 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210bfa8-0a2b-468a-a477-e6750d118351 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:21.334290 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b21e9-ed01-433f-aa7c-ae225e79b480 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:21.342676 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cee7a2-46bc-43b6-9de9-cb5b14d48f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:21.343662 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cee7a2-46bc-43b6-9de9-cb5b14d48f16 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:21.343944 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cee7a2-46bc-43b6-9de9-cb5b14d48f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:21.344322 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cee7a2-46bc-43b6-9de9-cb5b14d48f16 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:21.345533 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cee7a2-46bc-43b6-9de9-cb5b14d48f16 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:21.346063 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cee7a2-46bc-43b6-9de9-cb5b14d48f16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:21.348516 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cee7a2-46bc-43b6-9de9-cb5b14d48f16 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:21.364985 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 472/937] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Oct 2 00:43:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:21.364985 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13583601-ca55-4c6b-84c2-3c2ab5128272 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:21.364985 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13583601-ca55-4c6b-84c2-3c2ab5128272 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:21.364985 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13583601-ca55-4c6b-84c2-3c2ab5128272 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:21.366533 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 473/938] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:21.370967 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13583601-ca55-4c6b-84c2-3c2ab5128272 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:21.386185 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d3c36-6706-4f64-bbc3-42a2fc48c2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:21.386923 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d3c36-6706-4f64-bbc3-42a2fc48c2fd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:21.387267 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d3c36-6706-4f64-bbc3-42a2fc48c2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:21.387609 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d3c36-6706-4f64-bbc3-42a2fc48c2fd None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:21.389280 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d3c36-6706-4f64-bbc3-42a2fc48c2fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:21.389587 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d3c36-6706-4f64-bbc3-42a2fc48c2fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:21.391069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d3c36-6706-4f64-bbc3-42a2fc48c2fd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:21.396091 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:21.424703 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 466/939] 10.222.0.26 () {56 vars in 1149 bytes} [Sun Oct 2 00:43:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:21.427464 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac75d7-0770-456c-bead-65a17f3c5ed2 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:21.427632 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac75d7-0770-456c-bead-65a17f3c5ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:21.428078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac75d7-0770-456c-bead-65a17f3c5ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:21.458881 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-fcac75d7-0770-456c-bead-65a17f3c5ed2 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:21.461074 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fcac75d7-0770-456c-bead-65a17f3c5ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:21.513594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:21.524371 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13583601-ca55-4c6b-84c2-3c2ab5128272 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:21.577215 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3d24b-77a0-4314-a4dd-4eb5d80eac90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:21.578573 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3d24b-77a0-4314-a4dd-4eb5d80eac90 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:21.579060 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3d24b-77a0-4314-a4dd-4eb5d80eac90 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:21.579545 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3d24b-77a0-4314-a4dd-4eb5d80eac90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:21.589301 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 467/940] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:21.589598 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3d24b-77a0-4314-a4dd-4eb5d80eac90 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:21.590319 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac75d7-0770-456c-bead-65a17f3c5ed2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:21.590491 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3d24b-77a0-4314-a4dd-4eb5d80eac90 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:21.640980 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 474/941] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:43:21 2022] POST /identity/v3/endpoints => generated 347 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:43:21.804785 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d5568-df64-4099-ba1d-7dcdfa244ed4 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:21.805309 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d5568-df64-4099-ba1d-7dcdfa244ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:21.805801 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d5568-df64-4099-ba1d-7dcdfa244ed4 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:21.809327 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 475/942] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:21.815883 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1725847-8d37-4449-bd20-bea83ad2c18b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:21.816565 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1725847-8d37-4449-bd20-bea83ad2c18b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:21.817238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1725847-8d37-4449-bd20-bea83ad2c18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:21.817409 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac75d7-0770-456c-bead-65a17f3c5ed2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:21.846856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:21.858506 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f1725847-8d37-4449-bd20-bea83ad2c18b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:21.861843 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f1725847-8d37-4449-bd20-bea83ad2c18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:21.873788 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049e371-e45a-4372-8f4c-b15cccf74fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:21.874458 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049e371-e45a-4372-8f4c-b15cccf74fbd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:21.874737 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049e371-e45a-4372-8f4c-b15cccf74fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:21.875004 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049e371-e45a-4372-8f4c-b15cccf74fbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:21.888605 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049e371-e45a-4372-8f4c-b15cccf74fbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:21.890142 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049e371-e45a-4372-8f4c-b15cccf74fbd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:21.907443 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-b049e371-e45a-4372-8f4c-b15cccf74fbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:21.907443 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:21.907443 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:21.907443 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:21.907443 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:21.907443 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:21.907443 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:21.907443 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:21.907443 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:21.907443 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:21.907443 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:21.907443 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:21.907443 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:21.907443 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:21.907443 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:21.907443 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:21.909851 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:21.909851 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:21.909851 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:21.909851 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:21.909851 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:21.909851 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:21.909851 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:21.909851 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:21.909851 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:21.909851 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:21.909851 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:21.909851 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:21.909851 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:21.909851 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:21.909851 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:21.909851 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:21.909851 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:21.911694 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:21.911694 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:21.911694 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:21.911694 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 468/943] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:21.911694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049e371-e45a-4372-8f4c-b15cccf74fbd None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:22.001643 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 476/944] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:22.003799 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1725847-8d37-4449-bd20-bea83ad2c18b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:22.121087 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049e371-e45a-4372-8f4c-b15cccf74fbd None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:22.148443 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:22.177280 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0832469-da25-45eb-8c14-6289c2057e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:22.178035 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0832469-da25-45eb-8c14-6289c2057e36 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:22.178806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0832469-da25-45eb-8c14-6289c2057e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:22.178806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0832469-da25-45eb-8c14-6289c2057e36 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:22.179528 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0832469-da25-45eb-8c14-6289c2057e36 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:22.182093 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0832469-da25-45eb-8c14-6289c2057e36 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:22.185298 dv-cinder-master-3-smb devstack@keystone.service[81451]: WARNING keystone.server.flask.common [None req-b0832469-da25-45eb-8c14-6289c2057e36 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 02 00:43:22.198740 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1725847-8d37-4449-bd20-bea83ad2c18b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:22.208929 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.sql.core [None req-b0832469-da25-45eb-8c14-6289c2057e36 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 02 00:43:22.208929 dv-cinder-master-3-smb devstack@keystone.service[81451]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 02 00:43:22.208929 dv-cinder-master-3-smb devstack@keystone.service[81451]: [parameters: {'id': '9aff029ddd374cad9d963d889055b97c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 02 00:43:22.208929 dv-cinder-master-3-smb devstack@keystone.service[81451]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81451) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 02 00:43:22.228638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-b0832469-da25-45eb-8c14-6289c2057e36 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9aff029ddd374cad9d963d889055b97c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9aff029ddd374cad9d963d889055b97c. Oct 02 00:43:22.228638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:22.228638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 00:43:22.228638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 02 00:43:22.228638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 00:43:22.228638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 02 00:43:22.228638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 00:43:22.228638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application result = self._query(query) Oct 02 00:43:22.228638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 00:43:22.228638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application conn.query(q) Oct 02 00:43:22.228638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 00:43:22.228638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 00:43:22.228638 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 00:43:22.230261 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application result.read() Oct 02 00:43:22.230261 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 00:43:22.230261 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 02 00:43:22.230261 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 00:43:22.230261 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 02 00:43:22.230261 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 00:43:22.230261 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 02 00:43:22.230261 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 00:43:22.230261 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 02 00:43:22.230261 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 02 00:43:22.230261 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:22.230261 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 02 00:43:22.230261 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:22.230261 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:22.230261 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 02 00:43:22.230261 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 02 00:43:22.230261 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 02 00:43:22.230261 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 02 00:43:22.232108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 02 00:43:22.232108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application next(self.gen) Oct 02 00:43:22.232108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 02 00:43:22.232108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application yield resource Oct 02 00:43:22.232108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 02 00:43:22.232108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application next(self.gen) Oct 02 00:43:22.232108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 02 00:43:22.232108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.session.rollback() Oct 02 00:43:22.232108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 00:43:22.232108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.force_reraise() Oct 02 00:43:22.232108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 00:43:22.232108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise self.value Oct 02 00:43:22.232108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 02 00:43:22.232108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 02 00:43:22.232108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 02 00:43:22.232108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application session.commit() Oct 02 00:43:22.232108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 02 00:43:22.233970 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 02 00:43:22.233970 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 02 00:43:22.233970 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._prepare_impl() Oct 02 00:43:22.233970 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 02 00:43:22.233970 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.session.flush() Oct 02 00:43:22.233970 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 02 00:43:22.233970 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._flush(objects) Oct 02 00:43:22.233970 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 02 00:43:22.233970 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 02 00:43:22.233970 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 02 00:43:22.233970 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application compat.raise_( Oct 02 00:43:22.233970 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 00:43:22.233970 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception Oct 02 00:43:22.233970 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 02 00:43:22.233970 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application flush_context.execute() Oct 02 00:43:22.233970 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 02 00:43:22.233970 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rec.execute(self) Oct 02 00:43:22.237419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 02 00:43:22.237419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 02 00:43:22.237419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 02 00:43:22.237419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 02 00:43:22.237419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 02 00:43:22.237419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 02 00:43:22.237419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 02 00:43:22.237419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 02 00:43:22.237419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 02 00:43:22.237419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 02 00:43:22.237419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 02 00:43:22.237419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 02 00:43:22.237419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 02 00:43:22.237419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 02 00:43:22.237419 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 02 00:43:22.244588 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 02 00:43:22.244588 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 00:43:22.244588 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception Oct 02 00:43:22.244588 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 00:43:22.244588 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 02 00:43:22.244588 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 00:43:22.244588 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 02 00:43:22.244588 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 00:43:22.244588 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application result = self._query(query) Oct 02 00:43:22.244588 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 00:43:22.244588 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application conn.query(q) Oct 02 00:43:22.244588 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 00:43:22.244588 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 00:43:22.244588 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 00:43:22.244588 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application result.read() Oct 02 00:43:22.244588 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 00:43:22.244588 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 02 00:43:22.247658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 00:43:22.247658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 02 00:43:22.247658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 00:43:22.247658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 02 00:43:22.247658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 00:43:22.247658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 02 00:43:22.247658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 02 00:43:22.247658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 02 00:43:22.247658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [parameters: {'id': '9aff029ddd374cad9d963d889055b97c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 02 00:43:22.247658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 02 00:43:22.247658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:22.247658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:22.247658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:22.247658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:22.247658 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 02 00:43:22.252435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 02 00:43:22.252435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 02 00:43:22.252435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 02 00:43:22.252435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 02 00:43:22.252435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:22.252435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:22.252435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:22.252435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:22.252435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:22.252435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:22.252435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:22.252435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:22.252435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:22.252435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:22.252435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:22.252435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:22.252435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:22.256306 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:22.256306 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 02 00:43:22.256306 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 02 00:43:22.256306 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:22.256306 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:22.256306 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 02 00:43:22.256306 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 02 00:43:22.256306 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9aff029ddd374cad9d963d889055b97c. Oct 02 00:43:22.256306 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:22.256306 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 469/945] 10.222.0.26 () {60 vars in 1140 bytes} [Sun Oct 2 00:43:21 2022] POST /identity/v3/projects => generated 262 bytes in 327 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:22.256306 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0832469-da25-45eb-8c14-6289c2057e36 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:22.292862 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bff22-8a5b-435a-9044-82cc72446908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:22.293671 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bff22-8a5b-435a-9044-82cc72446908 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:22.293872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bff22-8a5b-435a-9044-82cc72446908 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:22.294074 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bff22-8a5b-435a-9044-82cc72446908 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:22.294732 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bff22-8a5b-435a-9044-82cc72446908 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:22.295037 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bff22-8a5b-435a-9044-82cc72446908 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:22.296228 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:22.296418 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bff22-8a5b-435a-9044-82cc72446908 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:22.311787 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 477/946] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:22.323559 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bff22-8a5b-435a-9044-82cc72446908 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:22.452008 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0832469-da25-45eb-8c14-6289c2057e36 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:22.513367 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb83ac-575d-4516-a1e5-7a568d676419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:22.513921 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb83ac-575d-4516-a1e5-7a568d676419 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:22.514076 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb83ac-575d-4516-a1e5-7a568d676419 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:22.514347 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb83ac-575d-4516-a1e5-7a568d676419 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:22.527998 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb83ac-575d-4516-a1e5-7a568d676419 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:22.531381 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb83ac-575d-4516-a1e5-7a568d676419 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:22.533253 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bff22-8a5b-435a-9044-82cc72446908 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:22.554700 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-95cb83ac-575d-4516-a1e5-7a568d676419 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:22.554700 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:22.554700 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:22.554700 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:22.554700 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:22.554700 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:22.554700 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:22.554700 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:22.554700 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:22.554700 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:22.554700 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:22.554700 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:22.554700 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:43:22.554700 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:43:22.554700 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:43:22.556829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:43:22.556829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:22.556829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:22.556829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:22.556829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:22.556829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:22.556829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:22.556829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:22.556829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:22.556829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:22.556829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:22.556829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:22.556829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:22.556829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:22.556829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:22.556829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:22.556829 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:22.559337 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:43:22.559337 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:43:22.559337 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:43:22.559337 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:43:22.559337 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:43:22.559337 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:43:22.559337 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:22.559337 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:22.559337 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 470/947] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:43:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:22.559337 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb83ac-575d-4516-a1e5-7a568d676419 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:22.587206 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088ebe0-0706-4c3a-ae55-884e3c7ed2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:22.587940 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088ebe0-0706-4c3a-ae55-884e3c7ed2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:22.588222 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088ebe0-0706-4c3a-ae55-884e3c7ed2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:22.588485 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088ebe0-0706-4c3a-ae55-884e3c7ed2b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:22.597175 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088ebe0-0706-4c3a-ae55-884e3c7ed2b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:22.598691 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088ebe0-0706-4c3a-ae55-884e3c7ed2b3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:22.602701 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:22.614256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-2088ebe0-0706-4c3a-ae55-884e3c7ed2b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:22.614256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:22.614256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:22.614256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:22.614256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:22.614256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:22.614256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:22.614256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:22.614256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:22.614256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:22.614256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:22.614256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:22.614256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:43:22.614256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:43:22.614256 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:43:22.616537 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:43:22.616537 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:22.616537 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:22.616537 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:22.616537 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:22.616537 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:22.616537 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:22.616537 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:22.616537 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:22.616537 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:22.616537 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:22.616537 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:22.616537 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:22.616537 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:22.616537 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:22.616537 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:22.616537 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:22.618836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:43:22.618836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:43:22.618836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:43:22.618836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:43:22.618836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:43:22.618836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:43:22.618836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:22.618836 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:22.618836 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 478/948] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:43:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:22.618836 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088ebe0-0706-4c3a-ae55-884e3c7ed2b3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:22.742436 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:22.751839 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088ebe0-0706-4c3a-ae55-884e3c7ed2b3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:22.767544 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb83ac-575d-4516-a1e5-7a568d676419 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:22.793912 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454786e-3c6b-4b59-8879-331aea01acac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:22.794532 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454786e-3c6b-4b59-8879-331aea01acac None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:22.794817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454786e-3c6b-4b59-8879-331aea01acac None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:22.795095 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454786e-3c6b-4b59-8879-331aea01acac None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:22.795761 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454786e-3c6b-4b59-8879-331aea01acac None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:22.796064 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454786e-3c6b-4b59-8879-331aea01acac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:22.797554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454786e-3c6b-4b59-8879-331aea01acac None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:22.826878 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2476a28-ac06-4f45-91ea-9349d8f13f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:22.827885 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 479/949] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Oct 2 00:43:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:22.828105 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2476a28-ac06-4f45-91ea-9349d8f13f50 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:22.828483 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2476a28-ac06-4f45-91ea-9349d8f13f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:22.828971 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2476a28-ac06-4f45-91ea-9349d8f13f50 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:22.830118 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2476a28-ac06-4f45-91ea-9349d8f13f50 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:22.830846 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454786e-3c6b-4b59-8879-331aea01acac None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:22.832873 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2476a28-ac06-4f45-91ea-9349d8f13f50 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:22.851518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-f2476a28-ac06-4f45-91ea-9349d8f13f50 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:43:22.851518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:22.851518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:43:22.851518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:43:22.851518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:43:22.851518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:43:22.851518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:43:22.851518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:22.851518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:43:22.851518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:22.851518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:22.851518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:22.851518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:22.851518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:22.851518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:22.851518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:22.851518 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:22.854563 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:22.854563 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:22.854563 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:22.854563 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:22.854563 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:22.854563 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:22.854563 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:43:22.854563 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:43:22.854563 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:43:22.854563 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:43:22.854563 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:22.854563 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:22.854563 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:22.854563 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:22.854563 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:22.854563 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:22.856457 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:22.856457 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:22.856457 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:22.856457 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:22.856457 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:22.856457 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:22.856457 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:22.856457 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:22.856457 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:22.856457 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:22.856457 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:43:22.856457 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:22.856457 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:43:22.856457 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:22.856457 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 471/950] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Oct 2 00:43:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:22.860839 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2476a28-ac06-4f45-91ea-9349d8f13f50 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:22.989518 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:23.074793 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2476a28-ac06-4f45-91ea-9349d8f13f50 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:23.079963 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454786e-3c6b-4b59-8879-331aea01acac None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:23.140072 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3afb5-226a-4d75-934a-aacb537a7c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:23.144081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3afb5-226a-4d75-934a-aacb537a7c13 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:23.144081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3afb5-226a-4d75-934a-aacb537a7c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:23.144081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3afb5-226a-4d75-934a-aacb537a7c13 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:23.144777 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3afb5-226a-4d75-934a-aacb537a7c13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:23.146159 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3afb5-226a-4d75-934a-aacb537a7c13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:23.148574 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3afb5-226a-4d75-934a-aacb537a7c13 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:23.150350 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e2c19-2d5e-454d-9444-ca4b999b94f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:23.151036 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e2c19-2d5e-454d-9444-ca4b999b94f4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:23.151748 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e2c19-2d5e-454d-9444-ca4b999b94f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:23.152212 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e2c19-2d5e-454d-9444-ca4b999b94f4 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:23.154827 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e2c19-2d5e-454d-9444-ca4b999b94f4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:23.154827 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e2c19-2d5e-454d-9444-ca4b999b94f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:23.156611 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e2c19-2d5e-454d-9444-ca4b999b94f4 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:23.173116 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 480/951] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:43:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:23.176963 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 472/952] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Oct 2 00:43:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:23.180302 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3afb5-226a-4d75-934a-aacb537a7c13 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:23.183587 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e2c19-2d5e-454d-9444-ca4b999b94f4 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:23.209980 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:23.351243 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3afb5-226a-4d75-934a-aacb537a7c13 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:23.351450 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e2c19-2d5e-454d-9444-ca4b999b94f4 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:23.378495 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:23.417360 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a350ec9-7f53-408a-8367-49d2350c7999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:23.418636 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a350ec9-7f53-408a-8367-49d2350c7999 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:23.420044 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a350ec9-7f53-408a-8367-49d2350c7999 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:23.420540 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a350ec9-7f53-408a-8367-49d2350c7999 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:23.421817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a350ec9-7f53-408a-8367-49d2350c7999 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:23.422368 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a350ec9-7f53-408a-8367-49d2350c7999 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:23.425067 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a350ec9-7f53-408a-8367-49d2350c7999 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:23.430797 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477473e-867a-436c-abaf-31b0b3d38c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:23.433015 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477473e-867a-436c-abaf-31b0b3d38c75 None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:23.433996 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477473e-867a-436c-abaf-31b0b3d38c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:23.434776 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477473e-867a-436c-abaf-31b0b3d38c75 None admin] PATH_INFO: `/v3/projects/7aec935005514f808eb735bfb01fee6e/users/42dcae7ba3c241eb8d7d0894aadb467f/roles/64c56800e24e42a496f2aba027c62ab0` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:23.439425 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477473e-867a-436c-abaf-31b0b3d38c75 None admin] RBAC: Authorizing `identity:create_grant(project_id=7aec935005514f808eb735bfb01fee6e, user_id=42dcae7ba3c241eb8d7d0894aadb467f, role_id=64c56800e24e42a496f2aba027c62ab0)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:23.442281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477473e-867a-436c-abaf-31b0b3d38c75 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:23.445105 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 481/953] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Oct 2 00:43:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:23.448111 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a350ec9-7f53-408a-8367-49d2350c7999 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:23.473911 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 473/954] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:43:23 2022] PUT /identity/v3/projects/7aec935005514f808eb735bfb01fee6e/users/42dcae7ba3c241eb8d7d0894aadb467f/roles/64c56800e24e42a496f2aba027c62ab0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:43:23.668361 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a350ec9-7f53-408a-8367-49d2350c7999 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:23.753271 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0258c8-10a6-4665-8b25-bb42056714a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:23.754333 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0258c8-10a6-4665-8b25-bb42056714a5 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:23.754818 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0258c8-10a6-4665-8b25-bb42056714a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:23.755382 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0258c8-10a6-4665-8b25-bb42056714a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:23.756640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0258c8-10a6-4665-8b25-bb42056714a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:23.760027 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0258c8-10a6-4665-8b25-bb42056714a5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:23.805216 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 482/955] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:43:23 2022] POST /identity/v3/endpoints => generated 349 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:43:24.099113 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b29f5-fd42-4c1d-aae0-dac2fc3db954 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:24.099363 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b29f5-fd42-4c1d-aae0-dac2fc3db954 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:24.099502 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b29f5-fd42-4c1d-aae0-dac2fc3db954 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:24.101322 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 474/956] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:24.112280 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63d71f-430e-4bbe-a152-65bbb6ecad16 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:24.113483 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63d71f-430e-4bbe-a152-65bbb6ecad16 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:24.114380 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63d71f-430e-4bbe-a152-65bbb6ecad16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:24.148634 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7a63d71f-430e-4bbe-a152-65bbb6ecad16 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:24.150145 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7a63d71f-430e-4bbe-a152-65bbb6ecad16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:24.194268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:24.242677 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 483/957] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:24.778342 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b29f5-fd42-4c1d-aae0-dac2fc3db954 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:24.948128 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:24.998701 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b29f5-fd42-4c1d-aae0-dac2fc3db954 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:25.068782 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18349966-4f1b-4f86-89e9-5857c67a305e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:25.070489 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18349966-4f1b-4f86-89e9-5857c67a305e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:25.071312 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18349966-4f1b-4f86-89e9-5857c67a305e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:25.072896 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18349966-4f1b-4f86-89e9-5857c67a305e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:25.074345 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18349966-4f1b-4f86-89e9-5857c67a305e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:25.077255 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18349966-4f1b-4f86-89e9-5857c67a305e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:25.096723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-18349966-4f1b-4f86-89e9-5857c67a305e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 02 00:43:25.096723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:25.096723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:43:25.096723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:43:25.096723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:43:25.096723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:43:25.096723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:43:25.096723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:25.096723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 02 00:43:25.096723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:25.096723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:25.096723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:25.096723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:25.096723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:25.096723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:25.096723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:25.096723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:25.098477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:25.098477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:25.098477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:25.098477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:25.098477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:25.098477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:25.098477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:43:25.098477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:43:25.098477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:43:25.098477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:43:25.098477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:25.098477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:25.098477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:25.098477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:25.098477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:25.098477 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:25.099540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:25.099540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:25.099540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:25.099540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:25.099540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:25.099540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:25.099540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:25.099540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:25.099540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:25.099540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:25.099540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:43:25.099540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:25.099540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 02 00:43:25.099540 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:25.109731 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 475/958] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:43:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:25.116445 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63d71f-430e-4bbe-a152-65bbb6ecad16 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:25.267362 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63d71f-430e-4bbe-a152-65bbb6ecad16 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:25.308464 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b7525-a0e9-46bc-9fb5-ce922a1899a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:25.309103 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b7525-a0e9-46bc-9fb5-ce922a1899a6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:25.309380 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b7525-a0e9-46bc-9fb5-ce922a1899a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:25.309654 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b7525-a0e9-46bc-9fb5-ce922a1899a6 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:25.310275 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b7525-a0e9-46bc-9fb5-ce922a1899a6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:25.310573 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b7525-a0e9-46bc-9fb5-ce922a1899a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:25.311948 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b7525-a0e9-46bc-9fb5-ce922a1899a6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:25.317837 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 484/959] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Oct 2 00:43:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:25.327936 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18349966-4f1b-4f86-89e9-5857c67a305e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:25.526451 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18349966-4f1b-4f86-89e9-5857c67a305e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:25.592634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d37109-3c6e-4888-ae0b-a84c9bc9388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:25.594277 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d37109-3c6e-4888-ae0b-a84c9bc9388f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:25.595073 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d37109-3c6e-4888-ae0b-a84c9bc9388f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:25.595855 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d37109-3c6e-4888-ae0b-a84c9bc9388f None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:25.597371 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d37109-3c6e-4888-ae0b-a84c9bc9388f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:25.598225 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d37109-3c6e-4888-ae0b-a84c9bc9388f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:25.601121 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d37109-3c6e-4888-ae0b-a84c9bc9388f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:25.617165 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 476/960] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Oct 2 00:43:25 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:26.298335 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b259c-1525-437c-80e2-c6b47895fdcf None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:26.299149 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b259c-1525-437c-80e2-c6b47895fdcf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:26.299149 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b259c-1525-437c-80e2-c6b47895fdcf None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:26.300484 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 485/961] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:26.308386 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb17abf-84ba-4c32-830f-d61b6c48c973 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:26.309268 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb17abf-84ba-4c32-830f-d61b6c48c973 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:26.309268 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb17abf-84ba-4c32-830f-d61b6c48c973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:26.318546 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:26.332461 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4fb17abf-84ba-4c32-830f-d61b6c48c973 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:26.334160 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4fb17abf-84ba-4c32-830f-d61b6c48c973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:26.472693 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 477/962] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:43:26.495551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2df4c-72c8-4c21-a62c-c8a51f028191 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:26.495835 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2df4c-72c8-4c21-a62c-c8a51f028191 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:26.496118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2df4c-72c8-4c21-a62c-c8a51f028191 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:26.497882 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 486/963] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:43:26.503670 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6a0d4-c269-45e2-9705-35ceba5925e9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:26.503962 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6a0d4-c269-45e2-9705-35ceba5925e9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:26.504235 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6a0d4-c269-45e2-9705-35ceba5925e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:26.541995 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4be6a0d4-c269-45e2-9705-35ceba5925e9 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:26.544100 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4be6a0d4-c269-45e2-9705-35ceba5925e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:26.641902 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 478/964] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:26.819490 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2df4c-72c8-4c21-a62c-c8a51f028191 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:26.865719 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:26.917650 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91096d-2551-4e26-a0d1-fc6d5c044139 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:26.918303 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91096d-2551-4e26-a0d1-fc6d5c044139 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:26.918781 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91096d-2551-4e26-a0d1-fc6d5c044139 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:26.920686 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 479/965] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:26.925957 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91096d-2551-4e26-a0d1-fc6d5c044139 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:26.990095 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2df4c-72c8-4c21-a62c-c8a51f028191 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:27.036039 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187edc75-b1ba-440b-be51-60d4d8512470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:27.036690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187edc75-b1ba-440b-be51-60d4d8512470 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:27.036999 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187edc75-b1ba-440b-be51-60d4d8512470 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:27.037270 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187edc75-b1ba-440b-be51-60d4d8512470 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:27.037872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187edc75-b1ba-440b-be51-60d4d8512470 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:27.039302 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187edc75-b1ba-440b-be51-60d4d8512470 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:27.048778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:27.051117 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-187edc75-b1ba-440b-be51-60d4d8512470 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:43:27.051117 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:27.051117 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:43:27.051117 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:43:27.051117 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:43:27.051117 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:43:27.051117 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:43:27.051117 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:27.051117 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:43:27.051117 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:27.051117 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:27.051117 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:27.051117 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:27.051117 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:27.051117 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:27.051117 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:27.051117 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:27.053495 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:27.053495 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:27.053495 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:27.053495 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:27.053495 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:27.053495 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:27.053495 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:43:27.053495 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:43:27.053495 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:43:27.053495 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:43:27.053495 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:27.053495 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:27.053495 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:27.053495 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:27.053495 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:27.053495 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:27.055219 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:27.055219 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:27.055219 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:27.055219 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:27.055219 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:27.055219 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:27.055219 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:27.055219 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:27.055219 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:27.055219 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:27.055219 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:43:27.055219 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:27.055219 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:43:27.055219 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:27.055219 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 487/966] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Oct 2 00:43:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:27.060710 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0b278-ee51-4004-8a91-bbdb7b41966b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:27.060710 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0b278-ee51-4004-8a91-bbdb7b41966b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:27.060710 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0b278-ee51-4004-8a91-bbdb7b41966b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:27.082787 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-73a0b278-ee51-4004-8a91-bbdb7b41966b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:27.084034 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-73a0b278-ee51-4004-8a91-bbdb7b41966b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:27.128260 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91096d-2551-4e26-a0d1-fc6d5c044139 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:27.193405 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b073b-f607-4d8d-8315-0133cef1b8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:27.194214 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b073b-f607-4d8d-8315-0133cef1b8f4 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:27.194717 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b073b-f607-4d8d-8315-0133cef1b8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:27.195198 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b073b-f607-4d8d-8315-0133cef1b8f4 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:27.196238 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b073b-f607-4d8d-8315-0133cef1b8f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:27.200866 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b073b-f607-4d8d-8315-0133cef1b8f4 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:27.214774 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 488/967] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:27.215676 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0b278-ee51-4004-8a91-bbdb7b41966b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:27.221077 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.sql.core [None req-119b073b-f607-4d8d-8315-0133cef1b8f4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 02 00:43:27.221077 dv-cinder-master-3-smb devstack@keystone.service[81451]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 02 00:43:27.221077 dv-cinder-master-3-smb devstack@keystone.service[81451]: [parameters: {'user_id': 'ebcf66890d2b46c6a57d67f1c9527a37', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 02 00:43:27.221077 dv-cinder-master-3-smb devstack@keystone.service[81451]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81451) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 02 00:43:27.230106 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-119b073b-f607-4d8d-8315-0133cef1b8f4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 02 00:43:27.230106 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:27.230106 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 00:43:27.230106 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 02 00:43:27.230106 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 00:43:27.230106 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 02 00:43:27.230106 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 00:43:27.230106 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application result = self._query(query) Oct 02 00:43:27.230106 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 00:43:27.230106 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application conn.query(q) Oct 02 00:43:27.230106 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 00:43:27.230106 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 00:43:27.230106 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 00:43:27.230106 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application result.read() Oct 02 00:43:27.230106 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 00:43:27.231097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 02 00:43:27.231097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 00:43:27.231097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 02 00:43:27.231097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 00:43:27.231097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 02 00:43:27.231097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 00:43:27.231097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 02 00:43:27.231097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 02 00:43:27.231097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:27.231097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 02 00:43:27.231097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:27.231097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:27.231097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 02 00:43:27.231097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 02 00:43:27.231097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 02 00:43:27.231097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 02 00:43:27.231097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 02 00:43:27.231097 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application next(self.gen) Oct 02 00:43:27.232096 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 02 00:43:27.232096 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application yield resource Oct 02 00:43:27.232096 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 02 00:43:27.232096 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application next(self.gen) Oct 02 00:43:27.232096 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 02 00:43:27.232096 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.session.rollback() Oct 02 00:43:27.232096 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 00:43:27.232096 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.force_reraise() Oct 02 00:43:27.232096 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 00:43:27.232096 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise self.value Oct 02 00:43:27.232096 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 02 00:43:27.232096 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 02 00:43:27.232096 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 02 00:43:27.232096 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application session.commit() Oct 02 00:43:27.232096 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 02 00:43:27.232096 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 02 00:43:27.232096 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 02 00:43:27.233040 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._prepare_impl() Oct 02 00:43:27.233040 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 02 00:43:27.233040 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.session.flush() Oct 02 00:43:27.233040 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 02 00:43:27.233040 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._flush(objects) Oct 02 00:43:27.233040 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 02 00:43:27.233040 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 02 00:43:27.233040 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 02 00:43:27.233040 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application compat.raise_( Oct 02 00:43:27.233040 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 00:43:27.233040 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception Oct 02 00:43:27.233040 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 02 00:43:27.233040 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application flush_context.execute() Oct 02 00:43:27.233040 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 02 00:43:27.233040 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rec.execute(self) Oct 02 00:43:27.233040 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 02 00:43:27.233040 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 02 00:43:27.234053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 02 00:43:27.234053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 02 00:43:27.234053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 02 00:43:27.234053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 02 00:43:27.234053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 02 00:43:27.234053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 02 00:43:27.234053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 02 00:43:27.234053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 02 00:43:27.234053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 02 00:43:27.234053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 02 00:43:27.234053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 02 00:43:27.234053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 02 00:43:27.234053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 02 00:43:27.234053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 02 00:43:27.234053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 00:43:27.234053 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception Oct 02 00:43:27.234925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 00:43:27.234925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 02 00:43:27.234925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 00:43:27.234925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 02 00:43:27.234925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 00:43:27.234925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application result = self._query(query) Oct 02 00:43:27.234925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 00:43:27.234925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application conn.query(q) Oct 02 00:43:27.234925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 00:43:27.234925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 00:43:27.234925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 00:43:27.234925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application result.read() Oct 02 00:43:27.234925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 00:43:27.234925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 02 00:43:27.234925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 00:43:27.234925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 02 00:43:27.235786 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 00:43:27.235786 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 02 00:43:27.235786 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 00:43:27.235786 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 02 00:43:27.235786 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 02 00:43:27.235786 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 02 00:43:27.235786 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ebcf66890d2b46c6a57d67f1c9527a37', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 02 00:43:27.235786 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 02 00:43:27.235786 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:27.235786 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:27.235786 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:27.235786 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:27.235786 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:27.235786 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:27.235786 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:27.238127 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:27.238127 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:27.238127 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:27.238127 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:27.238127 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:27.238127 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:27.238127 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:27.238127 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 02 00:43:27.238127 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 02 00:43:27.238127 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:27.238127 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:27.238127 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:43:27.238127 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:27.238127 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:43:27.238127 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:27.238127 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 02 00:43:27.238127 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 02 00:43:27.240441 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 02 00:43:27.240441 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 02 00:43:27.240441 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 02 00:43:27.240441 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 02 00:43:27.240441 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 02 00:43:27.240441 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:27.249153 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:27.249506 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 480/968] 10.222.0.26 () {60 vars in 1131 bytes} [Sun Oct 2 00:43:26 2022] POST /identity/v3/users => generated 160 bytes in 323 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:27.251812 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b073b-f607-4d8d-8315-0133cef1b8f4 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:27.355143 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0b278-ee51-4004-8a91-bbdb7b41966b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:27.392892 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b073b-f607-4d8d-8315-0133cef1b8f4 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:27.394825 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4d44d-1c7c-4693-8788-9fa32addf8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:27.395461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4d44d-1c7c-4693-8788-9fa32addf8e7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:27.395810 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4d44d-1c7c-4693-8788-9fa32addf8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:27.395979 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4d44d-1c7c-4693-8788-9fa32addf8e7 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:27.396609 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4d44d-1c7c-4693-8788-9fa32addf8e7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:27.396906 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4d44d-1c7c-4693-8788-9fa32addf8e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:27.398451 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4d44d-1c7c-4693-8788-9fa32addf8e7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:27.409344 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 489/969] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Oct 2 00:43:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:27.410508 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4d44d-1c7c-4693-8788-9fa32addf8e7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:27.436997 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:27.457479 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a196d4-ed34-49c9-9d12-25167ed19d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:27.458042 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a196d4-ed34-49c9-9d12-25167ed19d69 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:27.458319 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a196d4-ed34-49c9-9d12-25167ed19d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:27.458585 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a196d4-ed34-49c9-9d12-25167ed19d69 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:27.470642 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a196d4-ed34-49c9-9d12-25167ed19d69 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:27.473806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a196d4-ed34-49c9-9d12-25167ed19d69 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:27.489928 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-28a196d4-ed34-49c9-9d12-25167ed19d69 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 02 00:43:27.489928 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:27.489928 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:27.489928 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:27.489928 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:27.489928 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:27.489928 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:27.489928 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:27.489928 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:27.489928 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:27.489928 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:27.489928 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:27.489928 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:43:27.489928 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:43:27.489928 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:43:27.489928 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:43:27.491842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:27.491842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:27.491842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:43:27.491842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:27.491842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:43:27.491842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:27.491842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:27.491842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:27.491842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:27.491842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:27.491842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:27.491842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:27.491842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:27.491842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:27.491842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:27.491842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:27.491842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:27.491842 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:27.494486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:27.494486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:27.494486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:43:27.494486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:43:27.494486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:43:27.494486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:43:27.494486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:43:27.494486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:43:27.494486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 02 00:43:27.494486 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:27.496141 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 481/970] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:43:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:27.497735 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a196d4-ed34-49c9-9d12-25167ed19d69 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:27.558904 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:27.575759 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4d44d-1c7c-4693-8788-9fa32addf8e7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:27.614169 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a196d4-ed34-49c9-9d12-25167ed19d69 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:27.620707 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeed8e-5ad3-4e7a-9f02-439c9991f8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:27.621354 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeed8e-5ad3-4e7a-9f02-439c9991f8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:27.621631 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeed8e-5ad3-4e7a-9f02-439c9991f8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:27.621965 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeed8e-5ad3-4e7a-9f02-439c9991f8a2 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:27.624350 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaeed8e-5ad3-4e7a-9f02-439c9991f8a2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:27.624659 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaeed8e-5ad3-4e7a-9f02-439c9991f8a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:27.626577 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaeed8e-5ad3-4e7a-9f02-439c9991f8a2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:27.633413 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 490/971] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Oct 2 00:43:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:27.640466 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeed8e-5ad3-4e7a-9f02-439c9991f8a2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:27.660095 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dc756-f66d-4083-ad65-c999af36ad65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:27.660812 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc756-f66d-4083-ad65-c999af36ad65 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:27.661139 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc756-f66d-4083-ad65-c999af36ad65 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:27.661409 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc756-f66d-4083-ad65-c999af36ad65 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:27.662303 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dc756-f66d-4083-ad65-c999af36ad65 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:27.662608 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dc756-f66d-4083-ad65-c999af36ad65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:27.664181 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dc756-f66d-4083-ad65-c999af36ad65 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:27.713697 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 482/972] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Oct 2 00:43:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:27.757147 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dc756-f66d-4083-ad65-c999af36ad65 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:27.768209 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeed8e-5ad3-4e7a-9f02-439c9991f8a2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:27.828665 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:27.841789 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60348444-813d-4bb9-8220-18e0630cb87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:27.842790 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60348444-813d-4bb9-8220-18e0630cb87a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:27.843297 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60348444-813d-4bb9-8220-18e0630cb87a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:27.843876 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60348444-813d-4bb9-8220-18e0630cb87a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:27.844800 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60348444-813d-4bb9-8220-18e0630cb87a None admin] RBAC: Adding query filter params (interface=admin, service_id=1dc24cd55a5342579868156528069e2c, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:27.845362 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60348444-813d-4bb9-8220-18e0630cb87a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:27.847812 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60348444-813d-4bb9-8220-18e0630cb87a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:27.863990 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 491/973] 10.222.0.26 () {56 vars in 1249 bytes} [Sun Oct 2 00:43:27 2022] GET /identity/v3/endpoints?service_id=1dc24cd55a5342579868156528069e2c&interface=admin®ion_id=RegionOne => generated 193 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:27.873014 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60348444-813d-4bb9-8220-18e0630cb87a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:27.895124 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:27.936142 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dc756-f66d-4083-ad65-c999af36ad65 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:27.982916 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e050ff-bcf7-4c13-8a84-b7945dfc000b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:27.983495 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e050ff-bcf7-4c13-8a84-b7945dfc000b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:27.983781 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e050ff-bcf7-4c13-8a84-b7945dfc000b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:27.984057 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e050ff-bcf7-4c13-8a84-b7945dfc000b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:27.999874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e050ff-bcf7-4c13-8a84-b7945dfc000b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:43:28.006339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-c4e050ff-bcf7-4c13-8a84-b7945dfc000b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:43:28.006339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:28.006339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:28.006339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:28.006339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:28.006339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:28.006339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:28.006339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:28.006339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:28.006339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:28.006339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:28.006339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:28.006339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:43:28.006339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:43:28.006339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:43:28.006339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:43:28.008177 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:43:28.008177 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:43:28.008177 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:43:28.008177 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:43:28.008177 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:28.008177 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:28.008177 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:28.008177 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:28.008177 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:28.008177 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:28.008177 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:28.008177 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:28.008177 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:28.008177 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:28.008177 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:28.008177 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:28.010525 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:28.010525 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:28.010525 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:28.010525 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:28.010525 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:43:28.010525 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:43:28.010525 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:43:28.010525 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:43:28.010525 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:43:28.010525 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:43:28.010525 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:43:28.010525 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:28.013397 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 483/974] 10.222.0.26 () {56 vars in 1120 bytes} [Sun Oct 2 00:43:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:28.015840 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e050ff-bcf7-4c13-8a84-b7945dfc000b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:28.067767 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60348444-813d-4bb9-8220-18e0630cb87a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:28.126177 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecb7e4-a3ce-475f-92ea-c180ef09b75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:28.127232 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecb7e4-a3ce-475f-92ea-c180ef09b75b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:28.127759 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecb7e4-a3ce-475f-92ea-c180ef09b75b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:28.128247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecb7e4-a3ce-475f-92ea-c180ef09b75b None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:28.129154 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecb7e4-a3ce-475f-92ea-c180ef09b75b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:28.130856 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecb7e4-a3ce-475f-92ea-c180ef09b75b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:28.141231 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 492/975] 10.222.0.26 () {56 vars in 1087 bytes} [Sun Oct 2 00:43:27 2022] GET /identity/v3/services => generated 1497 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 00:43:28.212926 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e050ff-bcf7-4c13-8a84-b7945dfc000b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:28.217530 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:28.279548 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0fd04-28b3-4b9b-a45c-e956f87ec3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:28.280357 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0fd04-28b3-4b9b-a45c-e956f87ec3fc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:28.280701 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0fd04-28b3-4b9b-a45c-e956f87ec3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:28.281212 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0fd04-28b3-4b9b-a45c-e956f87ec3fc None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:28.282348 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0fd04-28b3-4b9b-a45c-e956f87ec3fc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:28.282849 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0fd04-28b3-4b9b-a45c-e956f87ec3fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:28.285309 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0fd04-28b3-4b9b-a45c-e956f87ec3fc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:28.298202 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 484/976] 10.222.0.26 () {56 vars in 1115 bytes} [Sun Oct 2 00:43:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:28.304037 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecb7e4-a3ce-475f-92ea-c180ef09b75b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:28.464310 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:28.490446 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecb7e4-a3ce-475f-92ea-c180ef09b75b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:28.532771 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc2050-cfb7-4fc1-bd04-e6c2d3aba4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:28.533331 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc2050-cfb7-4fc1-bd04-e6c2d3aba4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:28.533600 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc2050-cfb7-4fc1-bd04-e6c2d3aba4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:28.533868 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc2050-cfb7-4fc1-bd04-e6c2d3aba4e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:28.547234 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc2050-cfb7-4fc1-bd04-e6c2d3aba4e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:28.548691 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc2050-cfb7-4fc1-bd04-e6c2d3aba4e9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:28.557744 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11736dc1-6274-467b-bbb3-75083d784354 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:28.558301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11736dc1-6274-467b-bbb3-75083d784354 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:28.558301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11736dc1-6274-467b-bbb3-75083d784354 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:28.559981 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 485/977] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:43:28.565506 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754fc3a-5476-4ffe-b252-9dd3e2d94f97 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:28.565794 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754fc3a-5476-4ffe-b252-9dd3e2d94f97 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:28.566068 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754fc3a-5476-4ffe-b252-9dd3e2d94f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:28.567752 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-20cc2050-cfb7-4fc1-bd04-e6c2d3aba4e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:28.567752 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:28.567752 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:28.567752 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:28.567752 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:28.567752 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:28.567752 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:28.567752 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:28.567752 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:28.567752 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:28.567752 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:28.567752 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:28.567752 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:28.567752 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:28.567752 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:28.567752 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:28.568731 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:28.568731 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:28.568731 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:28.568731 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:28.568731 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:28.568731 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:28.568731 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:28.568731 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:28.568731 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:28.568731 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:28.568731 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:28.568731 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:28.568731 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:28.568731 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:28.568731 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:28.568731 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:28.568731 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:28.570436 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:28.570436 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:28.570436 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:28.570436 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 493/978] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:28.575476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc2050-cfb7-4fc1-bd04-e6c2d3aba4e9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:28.590011 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6754fc3a-5476-4ffe-b252-9dd3e2d94f97 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:28.591970 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6754fc3a-5476-4ffe-b252-9dd3e2d94f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:28.685537 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 486/979] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:43:28.734984 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc2050-cfb7-4fc1-bd04-e6c2d3aba4e9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:28.770229 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:28.778804 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e1eb9-01e0-4a2a-8e64-f42d03116374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:28.779420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e1eb9-01e0-4a2a-8e64-f42d03116374 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:28.779687 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e1eb9-01e0-4a2a-8e64-f42d03116374 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:28.779963 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e1eb9-01e0-4a2a-8e64-f42d03116374 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:28.780595 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e1eb9-01e0-4a2a-8e64-f42d03116374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:28.780895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e1eb9-01e0-4a2a-8e64-f42d03116374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:28.782322 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e1eb9-01e0-4a2a-8e64-f42d03116374 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:28.797770 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 494/980] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:28.804061 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754fc3a-5476-4ffe-b252-9dd3e2d94f97 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:28.985756 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:29.000569 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754fc3a-5476-4ffe-b252-9dd3e2d94f97 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:29.058011 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51addd70-618d-490d-a43c-1103f94bdb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:29.058838 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51addd70-618d-490d-a43c-1103f94bdb4a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:29.059240 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51addd70-618d-490d-a43c-1103f94bdb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:29.059623 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51addd70-618d-490d-a43c-1103f94bdb4a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:29.073143 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51addd70-618d-490d-a43c-1103f94bdb4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:29.076021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51addd70-618d-490d-a43c-1103f94bdb4a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:29.099108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-51addd70-618d-490d-a43c-1103f94bdb4a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:43:29.099108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:29.099108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:29.099108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:29.099108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:29.099108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:29.099108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:29.099108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:29.099108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:29.099108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:29.099108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:29.099108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:29.099108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:43:29.099108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:43:29.099108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:43:29.099108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:43:29.101081 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:29.101081 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:29.101081 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:43:29.101081 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:29.101081 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:43:29.101081 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:29.101081 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:29.101081 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:29.101081 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:29.101081 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:29.101081 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:29.101081 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:29.101081 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:29.101081 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:29.101081 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:29.101081 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:29.101081 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:29.101081 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:29.111234 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:29.111234 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:29.111234 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:43:29.111234 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:43:29.111234 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:43:29.111234 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:43:29.111234 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:43:29.111234 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:43:29.111234 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:43:29.111234 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:29.111234 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 487/981] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Oct 2 00:43:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:29.114932 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e1eb9-01e0-4a2a-8e64-f42d03116374 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:29.187493 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51addd70-618d-490d-a43c-1103f94bdb4a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:29.296806 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e1eb9-01e0-4a2a-8e64-f42d03116374 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:29.353646 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51addd70-618d-490d-a43c-1103f94bdb4a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:29.363924 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2cbcc-4ab1-4b71-9fb6-efacb825a2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:29.365396 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2cbcc-4ab1-4b71-9fb6-efacb825a2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:29.365880 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2cbcc-4ab1-4b71-9fb6-efacb825a2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:29.366367 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2cbcc-4ab1-4b71-9fb6-efacb825a2b8 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:29.367735 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2cbcc-4ab1-4b71-9fb6-efacb825a2b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:29.368610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2cbcc-4ab1-4b71-9fb6-efacb825a2b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:29.371228 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2cbcc-4ab1-4b71-9fb6-efacb825a2b8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:29.401498 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2940a91-8286-4bbe-b601-e6b05dce266a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:29.402370 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2940a91-8286-4bbe-b601-e6b05dce266a None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:29.402791 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2940a91-8286-4bbe-b601-e6b05dce266a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:29.403195 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2940a91-8286-4bbe-b601-e6b05dce266a None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:29.405787 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2940a91-8286-4bbe-b601-e6b05dce266a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:29.412762 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 495/982] 10.222.0.26 () {56 vars in 1149 bytes} [Sun Oct 2 00:43:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:29.412910 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2940a91-8286-4bbe-b601-e6b05dce266a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:29.421821 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2cbcc-4ab1-4b71-9fb6-efacb825a2b8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:29.440991 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 488/983] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Oct 2 00:43:29 2022] POST /identity/v3/services => generated 242 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:43:29.524031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:29.630982 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2cbcc-4ab1-4b71-9fb6-efacb825a2b8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:29.701789 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f8ed0-552b-4f58-b51b-270a85dd49e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:29.702836 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f8ed0-552b-4f58-b51b-270a85dd49e5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:29.703294 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f8ed0-552b-4f58-b51b-270a85dd49e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:29.703744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f8ed0-552b-4f58-b51b-270a85dd49e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:29.860309 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f8ed0-552b-4f58-b51b-270a85dd49e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:29.863308 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f8ed0-552b-4f58-b51b-270a85dd49e5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:29.950773 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:30.055681 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 496/984] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:43:29 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:43:30.068244 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2940a91-8286-4bbe-b601-e6b05dce266a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:30.101837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:30.261073 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2940a91-8286-4bbe-b601-e6b05dce266a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:30.328527 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e60c1-69a7-4409-ba72-8afa20042acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:30.329615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e60c1-69a7-4409-ba72-8afa20042acc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:30.330128 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e60c1-69a7-4409-ba72-8afa20042acc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:30.330618 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e60c1-69a7-4409-ba72-8afa20042acc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:30.351654 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e60c1-69a7-4409-ba72-8afa20042acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:30.355022 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e60c1-69a7-4409-ba72-8afa20042acc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:30.385349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-3d6e60c1-69a7-4409-ba72-8afa20042acc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:30.385349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:30.385349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:30.385349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:30.385349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:30.385349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:30.385349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:30.385349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:30.385349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:30.385349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:30.385349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:30.385349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:30.385349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:30.385349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:30.385349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:30.385349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:30.387333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:30.387333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:30.387333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:30.387333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:30.387333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:30.387333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:30.387333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:30.387333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:30.387333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:30.387333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:30.387333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:30.387333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:30.387333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:30.387333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:30.387333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:30.387333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:30.387333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:30.391724 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:30.391724 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:30.391724 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:30.393408 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 489/985] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:30.398485 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f8ed0-552b-4f58-b51b-270a85dd49e5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:30.615337 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f8ed0-552b-4f58-b51b-270a85dd49e5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:30.682164 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f2063-a66e-4dbf-aee8-df8d917d8d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:30.683168 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f2063-a66e-4dbf-aee8-df8d917d8d81 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:30.683638 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f2063-a66e-4dbf-aee8-df8d917d8d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:30.684139 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f2063-a66e-4dbf-aee8-df8d917d8d81 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:30.685373 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f2063-a66e-4dbf-aee8-df8d917d8d81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:30.685896 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f2063-a66e-4dbf-aee8-df8d917d8d81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:30.688413 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f2063-a66e-4dbf-aee8-df8d917d8d81 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:30.710824 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 497/986] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:30.719624 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e60c1-69a7-4409-ba72-8afa20042acc None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:30.739069 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94599444-bd8c-40ba-8fe2-7cda52089d03 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:30.739551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94599444-bd8c-40ba-8fe2-7cda52089d03 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:30.740036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94599444-bd8c-40ba-8fe2-7cda52089d03 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:30.742640 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 498/987] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:30.751911 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e51dc-3b45-408e-a1b6-51250411f431 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:30.752393 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e51dc-3b45-408e-a1b6-51250411f431 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:30.752876 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e51dc-3b45-408e-a1b6-51250411f431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:30.778214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:30.786018 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b33e51dc-3b45-408e-a1b6-51250411f431 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:30.788035 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b33e51dc-3b45-408e-a1b6-51250411f431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:30.818280 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:30.859381 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e60c1-69a7-4409-ba72-8afa20042acc None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:30.902588 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd5aee-cfa2-40ae-a021-3b67f9003f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:30.903238 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd5aee-cfa2-40ae-a021-3b67f9003f52 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:30.903509 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd5aee-cfa2-40ae-a021-3b67f9003f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:30.903806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd5aee-cfa2-40ae-a021-3b67f9003f52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:30.911397 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd5aee-cfa2-40ae-a021-3b67f9003f52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:30.912847 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd5aee-cfa2-40ae-a021-3b67f9003f52 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:30.918813 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 499/988] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:43:30.926439 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-64cd5aee-cfa2-40ae-a021-3b67f9003f52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:30.926439 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:30.926439 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:30.926439 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:30.926439 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:30.926439 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:30.926439 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:30.926439 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:30.926439 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:30.926439 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:30.926439 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:30.926439 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:30.926439 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:43:30.926439 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:43:30.926439 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:43:30.928181 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:43:30.928181 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:30.928181 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:30.928181 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:30.928181 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:30.928181 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:30.928181 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:30.928181 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:30.928181 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:30.928181 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:30.928181 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:30.928181 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:30.928181 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:30.928181 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:30.928181 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:30.928181 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:30.928181 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:30.930651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:43:30.930651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:43:30.930651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:43:30.930651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:43:30.930651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:43:30.930651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:43:30.930651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:30.930651 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:30.930651 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 490/989] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:43:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:30.938109 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e51dc-3b45-408e-a1b6-51250411f431 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:31.121508 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e51dc-3b45-408e-a1b6-51250411f431 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:31.184301 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee2dd1-6a4a-477e-8338-4002b16af69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:31.185232 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee2dd1-6a4a-477e-8338-4002b16af69c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:31.185699 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee2dd1-6a4a-477e-8338-4002b16af69c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:31.186199 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee2dd1-6a4a-477e-8338-4002b16af69c None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:31.187455 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee2dd1-6a4a-477e-8338-4002b16af69c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:31.187954 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee2dd1-6a4a-477e-8338-4002b16af69c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:31.190649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee2dd1-6a4a-477e-8338-4002b16af69c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:31.195654 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:31.224253 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 500/990] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:43:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:31.226642 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd5aee-cfa2-40ae-a021-3b67f9003f52 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:31.329428 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee2dd1-6a4a-477e-8338-4002b16af69c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:31.439300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd5aee-cfa2-40ae-a021-3b67f9003f52 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:31.488592 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:31.502068 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23610a-78e5-4e96-8a94-525a5fea1444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:31.503021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23610a-78e5-4e96-8a94-525a5fea1444 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:31.503462 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23610a-78e5-4e96-8a94-525a5fea1444 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:31.503873 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23610a-78e5-4e96-8a94-525a5fea1444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:31.504027 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee2dd1-6a4a-477e-8338-4002b16af69c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:31.505124 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23610a-78e5-4e96-8a94-525a5fea1444 None admin] RBAC: Adding query filter params (role.id=64c56800e24e42a496f2aba027c62ab0, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=42dcae7ba3c241eb8d7d0894aadb467f) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:31.505620 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23610a-78e5-4e96-8a94-525a5fea1444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:31.509043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23610a-78e5-4e96-8a94-525a5fea1444 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:31.517855 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 491/991] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:43:31 2022] GET /identity/v3/role_assignments?user.id=42dcae7ba3c241eb8d7d0894aadb467f&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=64c56800e24e42a496f2aba027c62ab0 => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:31.566766 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbf9d7-2f07-450e-977e-b4f534c9c825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:31.567689 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbf9d7-2f07-450e-977e-b4f534c9c825 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:31.568101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbf9d7-2f07-450e-977e-b4f534c9c825 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:31.568509 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbf9d7-2f07-450e-977e-b4f534c9c825 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:31.569459 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbf9d7-2f07-450e-977e-b4f534c9c825 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:31.572323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbf9d7-2f07-450e-977e-b4f534c9c825 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:31.588090 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-abcbf9d7-2f07-450e-977e-b4f534c9c825 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:43:31.588090 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:31.588090 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:43:31.588090 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:43:31.588090 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:43:31.588090 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:43:31.588090 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:43:31.588090 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:31.588090 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:43:31.588090 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:31.588090 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:31.588090 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:31.588090 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:31.588090 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:31.588090 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:31.588090 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:31.588090 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:31.589515 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:31.589515 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:31.589515 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:31.589515 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:31.589515 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:31.589515 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:31.589515 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:43:31.589515 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:43:31.589515 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:43:31.589515 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:43:31.589515 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:31.589515 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:31.589515 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:31.589515 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:31.589515 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:31.589515 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:31.590398 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:31.590398 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:31.590398 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:31.590398 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:31.590398 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:31.590398 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:31.590398 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:31.590398 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:31.590398 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:31.590398 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:31.590398 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:43:31.590398 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:31.590398 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:43:31.590398 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:31.591147 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 501/992] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Oct 2 00:43:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:31.601150 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23610a-78e5-4e96-8a94-525a5fea1444 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:31.800835 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23610a-78e5-4e96-8a94-525a5fea1444 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:31.849598 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522ee15-6afa-41b3-bd39-7ca5c738b7e5 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:31.850326 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522ee15-6afa-41b3-bd39-7ca5c738b7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:31.850466 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522ee15-6afa-41b3-bd39-7ca5c738b7e5 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:31.853374 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 502/993] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:31.861101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21654a0c-67c4-49ce-9290-8dbf13f32de0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:31.862009 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b5fed-7d3a-4ef7-aaf4-b85fae265235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:31.862850 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21654a0c-67c4-49ce-9290-8dbf13f32de0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:31.862989 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b5fed-7d3a-4ef7-aaf4-b85fae265235 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:31.863306 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b5fed-7d3a-4ef7-aaf4-b85fae265235 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:31.863410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21654a0c-67c4-49ce-9290-8dbf13f32de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:31.863763 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b5fed-7d3a-4ef7-aaf4-b85fae265235 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:31.865062 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b5fed-7d3a-4ef7-aaf4-b85fae265235 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:31.865573 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b5fed-7d3a-4ef7-aaf4-b85fae265235 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:31.867499 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b5fed-7d3a-4ef7-aaf4-b85fae265235 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:31.874186 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 492/994] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Oct 2 00:43:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:31.880564 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b5fed-7d3a-4ef7-aaf4-b85fae265235 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:31.891812 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-21654a0c-67c4-49ce-9290-8dbf13f32de0 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:31.893116 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-21654a0c-67c4-49ce-9290-8dbf13f32de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:31.959969 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:31.964205 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:31.980994 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 503/995] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:32.020850 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b5fed-7d3a-4ef7-aaf4-b85fae265235 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:32.061937 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05e213-b208-489d-8968-a6982c997f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:32.062495 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05e213-b208-489d-8968-a6982c997f08 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:32.062764 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05e213-b208-489d-8968-a6982c997f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:32.063035 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05e213-b208-489d-8968-a6982c997f08 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:32.063665 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05e213-b208-489d-8968-a6982c997f08 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:32.063960 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05e213-b208-489d-8968-a6982c997f08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:32.065444 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05e213-b208-489d-8968-a6982c997f08 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:32.071504 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 493/996] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Oct 2 00:43:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:32.077719 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21654a0c-67c4-49ce-9290-8dbf13f32de0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:32.261527 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21654a0c-67c4-49ce-9290-8dbf13f32de0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:32.268250 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05e213-b208-489d-8968-a6982c997f08 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:32.325092 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4b765-3969-4747-ab03-1b0a4adac317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:32.326230 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4b765-3969-4747-ab03-1b0a4adac317 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:32.326700 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4b765-3969-4747-ab03-1b0a4adac317 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:32.327208 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4b765-3969-4747-ab03-1b0a4adac317 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:32.328365 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4b765-3969-4747-ab03-1b0a4adac317 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:32.331066 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4b765-3969-4747-ab03-1b0a4adac317 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:32.359469 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 504/997] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:43:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:43:32.430373 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05e213-b208-489d-8968-a6982c997f08 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:32.466567 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:32.509329 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527ff36-3e95-4280-843a-8b0d88544c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:32.510380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527ff36-3e95-4280-843a-8b0d88544c98 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:32.510852 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527ff36-3e95-4280-843a-8b0d88544c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:32.511322 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527ff36-3e95-4280-843a-8b0d88544c98 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:32.512412 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527ff36-3e95-4280-843a-8b0d88544c98 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:32.515432 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527ff36-3e95-4280-843a-8b0d88544c98 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:32.533246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-7527ff36-3e95-4280-843a-8b0d88544c98 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 02 00:43:32.533246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:32.533246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:43:32.533246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:43:32.533246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:43:32.533246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:43:32.533246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:43:32.533246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:32.533246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 02 00:43:32.533246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:32.533246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:32.533246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:32.533246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:32.533246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:32.533246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:32.533246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:32.533246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:32.534745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:32.534745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:32.534745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:32.534745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:32.534745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:32.534745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:32.534745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:43:32.534745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:43:32.534745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:43:32.534745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:43:32.534745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:32.534745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:32.534745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:32.534745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:32.534745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:32.534745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:32.535907 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:32.535907 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:32.535907 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:32.535907 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:32.535907 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:32.535907 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:32.535907 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:32.535907 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:32.535907 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:32.535907 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:32.535907 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:43:32.535907 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:32.535907 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 02 00:43:32.535907 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:32.541458 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 494/998] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:43:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:32.546097 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4b765-3969-4747-ab03-1b0a4adac317 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:32.617850 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:32.683029 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4b765-3969-4747-ab03-1b0a4adac317 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:32.720628 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45aeff6-f7e9-43c0-ac37-b6fee3581d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:32.721266 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45aeff6-f7e9-43c0-ac37-b6fee3581d8b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:32.721541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45aeff6-f7e9-43c0-ac37-b6fee3581d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:32.721809 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45aeff6-f7e9-43c0-ac37-b6fee3581d8b None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:32.722439 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45aeff6-f7e9-43c0-ac37-b6fee3581d8b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:32.722736 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45aeff6-f7e9-43c0-ac37-b6fee3581d8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:32.724105 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45aeff6-f7e9-43c0-ac37-b6fee3581d8b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:32.736453 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 505/999] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Oct 2 00:43:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:32.738409 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527ff36-3e95-4280-843a-8b0d88544c98 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:32.859781 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527ff36-3e95-4280-843a-8b0d88544c98 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:32.900710 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3c4e5-f021-4312-999a-15bd07577e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:32.901357 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3c4e5-f021-4312-999a-15bd07577e36 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:32.901635 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3c4e5-f021-4312-999a-15bd07577e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:32.901905 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3c4e5-f021-4312-999a-15bd07577e36 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:32.902545 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3c4e5-f021-4312-999a-15bd07577e36 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:32.902843 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3c4e5-f021-4312-999a-15bd07577e36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:32.904248 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3c4e5-f021-4312-999a-15bd07577e36 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:32.911746 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 495/1000] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Oct 2 00:43:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:32.919250 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45aeff6-f7e9-43c0-ac37-b6fee3581d8b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:33.095451 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45aeff6-f7e9-43c0-ac37-b6fee3581d8b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:33.114788 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:33.146011 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657bdc4-5223-4100-bf92-c9eb4ec94af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:33.147263 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657bdc4-5223-4100-bf92-c9eb4ec94af3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:33.147945 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657bdc4-5223-4100-bf92-c9eb4ec94af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:33.148458 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657bdc4-5223-4100-bf92-c9eb4ec94af3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:33.150615 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657bdc4-5223-4100-bf92-c9eb4ec94af3 None admin] RBAC: Adding query filter params (interface=public, service_id=6d55e3e8518c44a59d3d8e2efe1754f0, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:33.151552 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657bdc4-5223-4100-bf92-c9eb4ec94af3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:33.153996 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657bdc4-5223-4100-bf92-c9eb4ec94af3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:33.163349 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 506/1001] 10.222.0.26 () {56 vars in 1251 bytes} [Sun Oct 2 00:43:32 2022] GET /identity/v3/endpoints?service_id=6d55e3e8518c44a59d3d8e2efe1754f0&interface=public®ion_id=RegionOne => generated 194 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:33.172422 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3c4e5-f021-4312-999a-15bd07577e36 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:33.256547 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:33.322061 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3c4e5-f021-4312-999a-15bd07577e36 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:33.359706 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ac943-dc87-4c5b-b0e1-c9b3046985ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:33.360321 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ac943-dc87-4c5b-b0e1-c9b3046985ab None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:33.360605 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ac943-dc87-4c5b-b0e1-c9b3046985ab None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:33.360856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ac943-dc87-4c5b-b0e1-c9b3046985ab None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:33.361504 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ac943-dc87-4c5b-b0e1-c9b3046985ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:33.362877 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ac943-dc87-4c5b-b0e1-c9b3046985ab None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:33.370556 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 496/1002] 10.222.0.26 () {56 vars in 1087 bytes} [Sun Oct 2 00:43:33 2022] GET /identity/v3/services => generated 1727 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 00:43:34.129467 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721ac64-f94a-44d8-b771-f8be5bf419c6 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:34.130002 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721ac64-f94a-44d8-b771-f8be5bf419c6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:34.130002 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721ac64-f94a-44d8-b771-f8be5bf419c6 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:34.131367 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 507/1003] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:34.137233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea98df-413d-41fa-a918-c255164c6968 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:34.137575 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea98df-413d-41fa-a918-c255164c6968 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:34.138086 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea98df-413d-41fa-a918-c255164c6968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:34.158504 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-06ea98df-413d-41fa-a918-c255164c6968 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:34.159729 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-06ea98df-413d-41fa-a918-c255164c6968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:34.253312 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 497/1004] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:34 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:34.522192 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721ac64-f94a-44d8-b771-f8be5bf419c6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:34.644725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721ac64-f94a-44d8-b771-f8be5bf419c6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:34.686274 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61907cb7-c118-41e1-af3a-1c61ed00d22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:34.687176 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61907cb7-c118-41e1-af3a-1c61ed00d22b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:34.687608 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61907cb7-c118-41e1-af3a-1c61ed00d22b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:34.688156 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61907cb7-c118-41e1-af3a-1c61ed00d22b None admin] PATH_INFO: `/v3/services/image` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:34.688986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61907cb7-c118-41e1-af3a-1c61ed00d22b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:34.690663 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61907cb7-c118-41e1-af3a-1c61ed00d22b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:34.701859 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-61907cb7-c118-41e1-af3a-1c61ed00d22b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 02 00:43:34.701859 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:34.701859 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:43:34.701859 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:43:34.701859 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:43:34.701859 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:43:34.701859 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:43:34.701859 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:34.701859 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 02 00:43:34.701859 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:34.701859 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:34.701859 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:34.701859 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:34.701859 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:34.701859 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:34.701859 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:34.701859 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:34.703014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:34.703014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:34.703014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:34.703014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:34.703014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:34.703014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:34.703014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:43:34.703014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:43:34.703014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:43:34.703014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:43:34.703014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:34.703014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:34.703014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:34.703014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:34.703014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:34.703014 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:34.703866 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:34.703866 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:34.703866 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:34.703866 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:34.703866 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:34.703866 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:34.703866 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:34.703866 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:34.703866 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:34.703866 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:34.703866 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:43:34.703866 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:34.703866 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 02 00:43:34.703866 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:34.709082 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 508/1005] 10.222.0.26 () {56 vars in 1105 bytes} [Sun Oct 2 00:43:34 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:34.710338 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea98df-413d-41fa-a918-c255164c6968 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:34.761533 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:34.836090 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b5e53-5c39-4193-9f1e-32be9e893343 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:34.836364 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b5e53-5c39-4193-9f1e-32be9e893343 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:34.836636 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b5e53-5c39-4193-9f1e-32be9e893343 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:34.838513 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 509/1006] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:43:34.845098 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf7df2-c359-41fb-8c8b-b6de7a193316 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:34.845390 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf7df2-c359-41fb-8c8b-b6de7a193316 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:34.845809 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf7df2-c359-41fb-8c8b-b6de7a193316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:34.847610 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea98df-413d-41fa-a918-c255164c6968 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:34.872358 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-addf7df2-c359-41fb-8c8b-b6de7a193316 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:34.873677 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-addf7df2-c359-41fb-8c8b-b6de7a193316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:34.891544 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0a178-013a-4203-8bc8-13b7bdfdc5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:34.892152 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0a178-013a-4203-8bc8-13b7bdfdc5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:34.892430 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0a178-013a-4203-8bc8-13b7bdfdc5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:34.892694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0a178-013a-4203-8bc8-13b7bdfdc5d8 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:34.893352 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0a178-013a-4203-8bc8-13b7bdfdc5d8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:34.893651 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0a178-013a-4203-8bc8-13b7bdfdc5d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:34.895014 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0a178-013a-4203-8bc8-13b7bdfdc5d8 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:34.900865 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 498/1007] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:34.906346 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0a178-013a-4203-8bc8-13b7bdfdc5d8 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:34.918196 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:34.957353 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 510/1008] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:34 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:43:35.022630 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0a178-013a-4203-8bc8-13b7bdfdc5d8 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:35.025030 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:35.062815 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4bc51-f6b6-4756-bc6f-32b99c471ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:35.063431 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4bc51-f6b6-4756-bc6f-32b99c471ebc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:35.063708 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4bc51-f6b6-4756-bc6f-32b99c471ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:35.063975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4bc51-f6b6-4756-bc6f-32b99c471ebc None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:35.064663 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4bc51-f6b6-4756-bc6f-32b99c471ebc None admin] RBAC: Adding query filter params (type=image) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:35.066015 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4bc51-f6b6-4756-bc6f-32b99c471ebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:35.067523 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4bc51-f6b6-4756-bc6f-32b99c471ebc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:35.080976 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 499/1009] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:35.235584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf7df2-c359-41fb-8c8b-b6de7a193316 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:35.398713 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf7df2-c359-41fb-8c8b-b6de7a193316 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:35.445788 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcddf6-7982-477e-960d-5393a94ae066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:35.448771 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcddf6-7982-477e-960d-5393a94ae066 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:35.448771 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcddf6-7982-477e-960d-5393a94ae066 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:35.448771 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcddf6-7982-477e-960d-5393a94ae066 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:35.449818 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcddf6-7982-477e-960d-5393a94ae066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:35.451272 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcddf6-7982-477e-960d-5393a94ae066 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:35.453226 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 511/1010] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:35.459333 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4bc51-f6b6-4756-bc6f-32b99c471ebc None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:35.630788 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4bc51-f6b6-4756-bc6f-32b99c471ebc None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:35.686645 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b900b0b-7b39-4df1-a379-ebd68237a455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:35.687249 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b900b0b-7b39-4df1-a379-ebd68237a455 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:35.687523 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b900b0b-7b39-4df1-a379-ebd68237a455 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:35.687797 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b900b0b-7b39-4df1-a379-ebd68237a455 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:35.688441 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b900b0b-7b39-4df1-a379-ebd68237a455 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:35.689905 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b900b0b-7b39-4df1-a379-ebd68237a455 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:35.726895 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 500/1011] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Oct 2 00:43:35 2022] POST /identity/v3/projects => generated 311 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:43:36.276616 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d64ea-a20f-4941-bbf6-60b0ad67dc21 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:36.277195 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d64ea-a20f-4941-bbf6-60b0ad67dc21 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:36.277195 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d64ea-a20f-4941-bbf6-60b0ad67dc21 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:36.278577 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 512/1012] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:36.284235 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4d073-624c-4b84-a14f-1490d970ddab None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:36.284527 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4d073-624c-4b84-a14f-1490d970ddab None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:36.284794 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4d073-624c-4b84-a14f-1490d970ddab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:36.305026 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5da4d073-624c-4b84-a14f-1490d970ddab None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:36.306831 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5da4d073-624c-4b84-a14f-1490d970ddab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:36.322544 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:36.437001 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 501/1013] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:36 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:36.846630 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d64ea-a20f-4941-bbf6-60b0ad67dc21 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:36.897897 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:36.966753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d64ea-a20f-4941-bbf6-60b0ad67dc21 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:37.005836 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e94f98-e0f4-4678-999d-86c81a5f65c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:37.006457 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e94f98-e0f4-4678-999d-86c81a5f65c0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:37.006741 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e94f98-e0f4-4678-999d-86c81a5f65c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:37.006994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e94f98-e0f4-4678-999d-86c81a5f65c0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:37.007567 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e94f98-e0f4-4678-999d-86c81a5f65c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:37.009643 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e94f98-e0f4-4678-999d-86c81a5f65c0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:37.019712 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c6e94f98-e0f4-4678-999d-86c81a5f65c0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 02 00:43:37.019712 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:37.019712 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:43:37.019712 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:43:37.019712 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:43:37.019712 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:43:37.019712 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:43:37.019712 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:37.019712 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 02 00:43:37.019712 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:37.019712 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:37.019712 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:37.019712 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:37.019712 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:37.019712 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:37.019712 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:37.019712 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:37.021703 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:37.021703 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:37.021703 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:37.021703 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:37.021703 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:37.021703 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:37.021703 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:43:37.021703 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:43:37.021703 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:43:37.021703 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:43:37.021703 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:37.021703 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:37.021703 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:37.021703 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:37.021703 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:37.021703 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:37.023390 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:37.023390 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:37.023390 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:37.023390 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:37.023390 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:37.023390 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:37.023390 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:37.023390 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:37.023390 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:37.023390 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:37.023390 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:43:37.023390 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:37.023390 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 02 00:43:37.023390 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:37.025497 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 513/1014] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:43:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:37.028643 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4d073-624c-4b84-a14f-1490d970ddab None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:37.203167 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4d073-624c-4b84-a14f-1490d970ddab None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:37.256431 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e913351-ec98-476e-b441-759b7887614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:37.257228 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e913351-ec98-476e-b441-759b7887614e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:37.257575 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e913351-ec98-476e-b441-759b7887614e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:37.258046 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e913351-ec98-476e-b441-759b7887614e None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:37.258926 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e913351-ec98-476e-b441-759b7887614e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:37.259281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e913351-ec98-476e-b441-759b7887614e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:37.261084 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e913351-ec98-476e-b441-759b7887614e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:37.274633 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 502/1015] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Oct 2 00:43:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:37.275899 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e94f98-e0f4-4678-999d-86c81a5f65c0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:37.417135 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e94f98-e0f4-4678-999d-86c81a5f65c0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:37.420137 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:37.460989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41bbbb-179b-430d-ab87-b07b72782d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:37.461497 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41bbbb-179b-430d-ab87-b07b72782d02 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:37.461812 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41bbbb-179b-430d-ab87-b07b72782d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:37.462085 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41bbbb-179b-430d-ab87-b07b72782d02 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:37.462888 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41bbbb-179b-430d-ab87-b07b72782d02 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:37.463193 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41bbbb-179b-430d-ab87-b07b72782d02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:37.464604 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41bbbb-179b-430d-ab87-b07b72782d02 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:37.471012 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 514/1016] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Oct 2 00:43:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:37.476747 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e913351-ec98-476e-b441-759b7887614e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:37.495378 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:37.554875 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece150c-c3dc-4f38-b6d6-d4833d181ad1 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:37.555369 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece150c-c3dc-4f38-b6d6-d4833d181ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:37.555872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece150c-c3dc-4f38-b6d6-d4833d181ad1 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:37.558307 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 515/1017] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:37.567034 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c66b2-4de1-4ddb-9ea2-93d3d42f585a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:37.567463 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c66b2-4de1-4ddb-9ea2-93d3d42f585a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:37.567883 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c66b2-4de1-4ddb-9ea2-93d3d42f585a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:37.595410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1b9c66b2-4de1-4ddb-9ea2-93d3d42f585a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:37.597363 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1b9c66b2-4de1-4ddb-9ea2-93d3d42f585a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:37.615172 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e913351-ec98-476e-b441-759b7887614e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:37.663196 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa57712-e6a3-4f6a-8146-b7bcb03cfff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:37.664191 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa57712-e6a3-4f6a-8146-b7bcb03cfff5 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:37.664640 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa57712-e6a3-4f6a-8146-b7bcb03cfff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:37.665630 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa57712-e6a3-4f6a-8146-b7bcb03cfff5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:37.666434 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa57712-e6a3-4f6a-8146-b7bcb03cfff5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:37.668536 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa57712-e6a3-4f6a-8146-b7bcb03cfff5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:37.696971 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 516/1018] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:37 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:43:37.697247 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 503/1019] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:43:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:43:37.974813 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c66b2-4de1-4ddb-9ea2-93d3d42f585a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:38.113792 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:38.120559 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c66b2-4de1-4ddb-9ea2-93d3d42f585a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:38.181383 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d0c6a-9d86-4ed7-af16-55b3c58417af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:38.182063 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d0c6a-9d86-4ed7-af16-55b3c58417af None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:38.182380 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d0c6a-9d86-4ed7-af16-55b3c58417af None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:38.182652 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1c1f1-e8c0-41ff-b0c7-648b7ff11ee4 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:38.183402 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d0c6a-9d86-4ed7-af16-55b3c58417af None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:38.183589 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1c1f1-e8c0-41ff-b0c7-648b7ff11ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:38.183589 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1c1f1-e8c0-41ff-b0c7-648b7ff11ee4 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:38.183896 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d0c6a-9d86-4ed7-af16-55b3c58417af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:38.184808 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 504/1020] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:43:38.185037 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d0c6a-9d86-4ed7-af16-55b3c58417af None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:38.190633 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93434b47-2031-4516-b959-cf822e81356d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:38.190924 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93434b47-2031-4516-b959-cf822e81356d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:38.191164 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93434b47-2031-4516-b959-cf822e81356d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:38.204448 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 517/1021] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Oct 2 00:43:37 2022] POST /identity/v3/services => generated 242 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:43:38.217577 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-93434b47-2031-4516-b959-cf822e81356d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:38.218862 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-93434b47-2031-4516-b959-cf822e81356d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:38.298929 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:38.318865 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 505/1022] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:43:38.597494 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d0c6a-9d86-4ed7-af16-55b3c58417af None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:38.715010 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d0c6a-9d86-4ed7-af16-55b3c58417af None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:38.754157 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfe39d-e20e-453e-a597-5bcd5c3ebd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:38.754988 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfe39d-e20e-453e-a597-5bcd5c3ebd85 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:38.755409 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfe39d-e20e-453e-a597-5bcd5c3ebd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:38.755816 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfe39d-e20e-453e-a597-5bcd5c3ebd85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:38.757358 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dfe39d-e20e-453e-a597-5bcd5c3ebd85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:38.759206 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dfe39d-e20e-453e-a597-5bcd5c3ebd85 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:38.765014 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 518/1023] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:38.768348 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93434b47-2031-4516-b959-cf822e81356d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:38.881595 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93434b47-2031-4516-b959-cf822e81356d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:38.920204 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a9a67-d140-492d-8570-0c117ca50812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:38.921061 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a9a67-d140-492d-8570-0c117ca50812 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:38.921485 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a9a67-d140-492d-8570-0c117ca50812 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:38.921923 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a9a67-d140-492d-8570-0c117ca50812 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:38.922711 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a9a67-d140-492d-8570-0c117ca50812 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:38.924291 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a9a67-d140-492d-8570-0c117ca50812 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:38.956969 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 506/1024] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Oct 2 00:43:38 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:43:40.100042 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a392a3-45f5-4d93-845c-60389f8526f1 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:40.100759 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a392a3-45f5-4d93-845c-60389f8526f1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:40.100759 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a392a3-45f5-4d93-845c-60389f8526f1 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:40.104990 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 519/1025] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:40.112345 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c9388-fea5-4992-a4ae-6deb72e64006 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:40.112883 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c9388-fea5-4992-a4ae-6deb72e64006 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:40.113222 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c9388-fea5-4992-a4ae-6deb72e64006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:40.144052 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e34c9388-fea5-4992-a4ae-6deb72e64006 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:40.146225 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e34c9388-fea5-4992-a4ae-6deb72e64006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:40.219574 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:40.257009 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 507/1026] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:40.583394 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4beb9-6c54-4ddd-8f77-f17abbc609d1 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:40.583800 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4beb9-6c54-4ddd-8f77-f17abbc609d1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:40.583989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4beb9-6c54-4ddd-8f77-f17abbc609d1 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:40.585482 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 520/1027] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:40.591666 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0a0d1-3eb5-48f4-ac3e-db31fbe3160d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:40.592022 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0a0d1-3eb5-48f4-ac3e-db31fbe3160d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:40.592209 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0a0d1-3eb5-48f4-ac3e-db31fbe3160d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:40.609631 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4beb9-6c54-4ddd-8f77-f17abbc609d1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:40.611409 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3fa0a0d1-3eb5-48f4-ac3e-db31fbe3160d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:40.612740 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3fa0a0d1-3eb5-48f4-ac3e-db31fbe3160d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:40.638473 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:40.707576 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 508/1028] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:40.746950 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4beb9-6c54-4ddd-8f77-f17abbc609d1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:40.787656 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fa57a-c2f6-438b-9b12-cd84dae44e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:40.788618 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa57a-c2f6-438b-9b12-cd84dae44e27 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:40.788987 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa57a-c2f6-438b-9b12-cd84dae44e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:40.789348 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa57a-c2f6-438b-9b12-cd84dae44e27 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:40.802290 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fa57a-c2f6-438b-9b12-cd84dae44e27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:43:40.807269 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-3d5fa57a-c2f6-438b-9b12-cd84dae44e27 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:43:40.807269 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:40.807269 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:40.807269 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:40.807269 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:40.807269 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:40.807269 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:40.807269 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:40.807269 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:40.807269 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:40.807269 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:40.807269 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:40.807269 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:43:40.807269 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:43:40.807269 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:43:40.807269 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:43:40.808410 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:43:40.808410 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:43:40.808410 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:43:40.808410 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:43:40.808410 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:40.808410 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:40.808410 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:40.808410 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:40.808410 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:40.808410 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:40.808410 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:40.808410 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:40.808410 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:40.808410 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:40.808410 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:40.808410 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:40.809401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:40.809401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:40.809401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:40.809401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:40.809401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:43:40.809401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:43:40.809401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:43:40.809401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:43:40.809401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:43:40.809401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:43:40.809401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:43:40.809401 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:40.809401 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 521/1029] 10.222.0.26 () {56 vars in 1120 bytes} [Sun Oct 2 00:43:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:40.814382 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0a0d1-3eb5-48f4-ac3e-db31fbe3160d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:40.928508 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0a0d1-3eb5-48f4-ac3e-db31fbe3160d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:40.941769 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:40.974876 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e67c27-5a7e-40ec-aa6e-2b857fce8b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:40.975465 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e67c27-5a7e-40ec-aa6e-2b857fce8b7b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:40.975764 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e67c27-5a7e-40ec-aa6e-2b857fce8b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:40.976086 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e67c27-5a7e-40ec-aa6e-2b857fce8b7b None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:40.976892 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e67c27-5a7e-40ec-aa6e-2b857fce8b7b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:40.977329 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e67c27-5a7e-40ec-aa6e-2b857fce8b7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:40.979712 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e67c27-5a7e-40ec-aa6e-2b857fce8b7b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:40.985474 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fa57a-c2f6-438b-9b12-cd84dae44e27 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:40.991478 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 509/1030] 10.222.0.26 () {56 vars in 1115 bytes} [Sun Oct 2 00:43:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:40.998496 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e67c27-5a7e-40ec-aa6e-2b857fce8b7b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:41.100427 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:41.131226 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fa57a-c2f6-438b-9b12-cd84dae44e27 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:41.132962 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e67c27-5a7e-40ec-aa6e-2b857fce8b7b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:41.176603 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd887e-247a-4911-ba0e-5b9d460a8374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:41.177740 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd887e-247a-4911-ba0e-5b9d460a8374 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:41.178233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd887e-247a-4911-ba0e-5b9d460a8374 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:41.178687 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd887e-247a-4911-ba0e-5b9d460a8374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:41.188882 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231ec07-ddd8-4410-a05d-bb171e988b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:41.189565 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231ec07-ddd8-4410-a05d-bb171e988b15 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:41.189847 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231ec07-ddd8-4410-a05d-bb171e988b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:41.190106 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231ec07-ddd8-4410-a05d-bb171e988b15 None admin] PATH_INFO: `/v3/services/image` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:41.190688 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231ec07-ddd8-4410-a05d-bb171e988b15 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:41.192106 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231ec07-ddd8-4410-a05d-bb171e988b15 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:41.198986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd887e-247a-4911-ba0e-5b9d460a8374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:41.200457 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd887e-247a-4911-ba0e-5b9d460a8374 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:41.209930 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c231ec07-ddd8-4410-a05d-bb171e988b15 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 02 00:43:41.209930 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:41.209930 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:43:41.209930 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:43:41.209930 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:43:41.209930 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:43:41.209930 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:43:41.209930 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:41.209930 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 02 00:43:41.209930 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:41.209930 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:41.209930 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:41.209930 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:41.209930 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:41.209930 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:41.209930 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:41.209930 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:41.211095 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:41.211095 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:41.211095 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:41.211095 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:41.211095 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:41.211095 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:41.211095 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:43:41.211095 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:43:41.211095 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:43:41.211095 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:43:41.211095 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:41.211095 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:41.211095 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:41.211095 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:41.211095 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:41.211095 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:41.213956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:41.213956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:41.213956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:41.213956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:41.213956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:41.213956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:41.213956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:41.213956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:41.213956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:41.213956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:41.213956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:43:41.213956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:41.213956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 02 00:43:41.213956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:41.213956 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 522/1031] 10.222.0.26 () {56 vars in 1105 bytes} [Sun Oct 2 00:43:40 2022] GET /identity/v3/services/image => generated 86 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:41.216683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-6bfd887e-247a-4911-ba0e-5b9d460a8374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:41.216683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:41.216683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:41.216683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:41.216683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:41.216683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:41.216683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:41.216683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:41.216683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:41.216683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:41.216683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:41.216683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:41.216683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:41.216683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:41.216683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:41.216683 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:41.218748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:41.218748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:41.218748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:41.218748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:41.218748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:41.218748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:41.218748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:41.218748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:41.218748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:41.218748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:41.218748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:41.218748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:41.218748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:41.218748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:41.218748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:41.218748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:41.218748 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:41.219994 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:41.219994 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:41.219994 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:41.219994 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 510/1032] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:41.221408 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231ec07-ddd8-4410-a05d-bb171e988b15 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:41.223866 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd887e-247a-4911-ba0e-5b9d460a8374 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:41.270153 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:41.376357 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231ec07-ddd8-4410-a05d-bb171e988b15 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:41.380038 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd887e-247a-4911-ba0e-5b9d460a8374 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:41.425055 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18e2b9-0c53-4332-884d-4d69c518dcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:41.425685 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18e2b9-0c53-4332-884d-4d69c518dcd3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:41.425960 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18e2b9-0c53-4332-884d-4d69c518dcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:41.426234 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18e2b9-0c53-4332-884d-4d69c518dcd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:41.426906 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18e2b9-0c53-4332-884d-4d69c518dcd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:41.427209 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18e2b9-0c53-4332-884d-4d69c518dcd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:41.428148 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc5cb7-36b8-42d0-ba0f-3b21e6dc0fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:41.428710 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18e2b9-0c53-4332-884d-4d69c518dcd3 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:41.428824 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc5cb7-36b8-42d0-ba0f-3b21e6dc0fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:41.429087 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc5cb7-36b8-42d0-ba0f-3b21e6dc0fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:41.429361 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc5cb7-36b8-42d0-ba0f-3b21e6dc0fa7 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:41.430018 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc5cb7-36b8-42d0-ba0f-3b21e6dc0fa7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:41.430395 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc5cb7-36b8-42d0-ba0f-3b21e6dc0fa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:41.432592 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc5cb7-36b8-42d0-ba0f-3b21e6dc0fa7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:41.438701 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 523/1033] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:41.444560 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc5cb7-36b8-42d0-ba0f-3b21e6dc0fa7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:41.450719 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 511/1034] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:41.456481 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18e2b9-0c53-4332-884d-4d69c518dcd3 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:41.462034 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:41.561769 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:41.566959 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc5cb7-36b8-42d0-ba0f-3b21e6dc0fa7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:41.581928 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18e2b9-0c53-4332-884d-4d69c518dcd3 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:41.606034 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c638b5c-ac27-407f-b84d-33489ac690f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:41.606650 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c638b5c-ac27-407f-b84d-33489ac690f2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:41.606928 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c638b5c-ac27-407f-b84d-33489ac690f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:41.607197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c638b5c-ac27-407f-b84d-33489ac690f2 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:41.607828 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c638b5c-ac27-407f-b84d-33489ac690f2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:41.608130 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c638b5c-ac27-407f-b84d-33489ac690f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:41.609548 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c638b5c-ac27-407f-b84d-33489ac690f2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:41.614619 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 524/1035] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:41.615842 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe7613-8dea-44d9-b697-5bb13a3a14dc None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:41.616127 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe7613-8dea-44d9-b697-5bb13a3a14dc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:41.616402 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe7613-8dea-44d9-b697-5bb13a3a14dc None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:41.618334 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 525/1036] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:41.624335 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0c7f8-4048-4826-8487-919128fd9ac3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:41.624614 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0c7f8-4048-4826-8487-919128fd9ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:41.624892 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0c7f8-4048-4826-8487-919128fd9ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:41.628514 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d9f73-c606-40e3-805b-b02cc0afdc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:41.629145 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d9f73-c606-40e3-805b-b02cc0afdc48 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:41.629427 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d9f73-c606-40e3-805b-b02cc0afdc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:41.629702 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d9f73-c606-40e3-805b-b02cc0afdc48 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:41.642206 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d9f73-c606-40e3-805b-b02cc0afdc48 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:41.644161 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a2a0c7f8-4048-4826-8487-919128fd9ac3 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:41.644975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d9f73-c606-40e3-805b-b02cc0afdc48 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:41.645430 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a2a0c7f8-4048-4826-8487-919128fd9ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:41.667136 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-345d9f73-c606-40e3-805b-b02cc0afdc48 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:43:41.667136 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:41.667136 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:41.667136 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:41.667136 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:41.667136 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:41.667136 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:41.667136 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:41.667136 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:41.667136 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:41.667136 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:41.667136 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:41.667136 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:43:41.667136 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:43:41.667136 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:43:41.667136 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:43:41.668318 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:41.668318 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:41.668318 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:43:41.668318 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:41.668318 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:43:41.668318 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:41.668318 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:41.668318 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:41.668318 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:41.668318 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:41.668318 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:41.668318 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:41.668318 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:41.668318 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:41.668318 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:41.668318 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:41.668318 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:41.668318 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:41.669356 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:41.669356 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:41.669356 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:43:41.669356 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:43:41.669356 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:43:41.669356 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:43:41.669356 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:43:41.669356 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:43:41.669356 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:43:41.669356 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:41.669928 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 512/1037] 10.222.0.26 () {56 vars in 1093 bytes} [Sun Oct 2 00:43:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:41.671180 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d9f73-c606-40e3-805b-b02cc0afdc48 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:41.724554 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 526/1038] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:43:41.725461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0c7f8-4048-4826-8487-919128fd9ac3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:41.731946 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:41.823895 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d9f73-c606-40e3-805b-b02cc0afdc48 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:41.867364 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d72e2-988d-4e3a-853d-2ff91bdd0a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:41.871791 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d72e2-988d-4e3a-853d-2ff91bdd0a24 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:41.872160 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d72e2-988d-4e3a-853d-2ff91bdd0a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:41.872575 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d72e2-988d-4e3a-853d-2ff91bdd0a24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:41.873343 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0c7f8-4048-4826-8487-919128fd9ac3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:41.877298 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d72e2-988d-4e3a-853d-2ff91bdd0a24 None admin] RBAC: Adding query filter params (interface=public, service_id=70605e1a9e0b4c8f8b7ecb98fba84d95, region_id=RegionOne) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:41.877298 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d72e2-988d-4e3a-853d-2ff91bdd0a24 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:41.879152 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d72e2-988d-4e3a-853d-2ff91bdd0a24 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:41.900131 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 513/1039] 10.222.0.26 () {56 vars in 1251 bytes} [Sun Oct 2 00:43:41 2022] GET /identity/v3/endpoints?service_id=70605e1a9e0b4c8f8b7ecb98fba84d95&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:41.902848 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d72e2-988d-4e3a-853d-2ff91bdd0a24 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:41.919166 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab0426-3c8a-4c81-8a01-0a9466d3e134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:41.920318 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab0426-3c8a-4c81-8a01-0a9466d3e134 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:41.920614 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab0426-3c8a-4c81-8a01-0a9466d3e134 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:41.920895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab0426-3c8a-4c81-8a01-0a9466d3e134 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:41.921674 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab0426-3c8a-4c81-8a01-0a9466d3e134 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:41.921977 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab0426-3c8a-4c81-8a01-0a9466d3e134 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:41.923459 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:41.923824 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab0426-3c8a-4c81-8a01-0a9466d3e134 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:41.946864 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 527/1040] 10.222.0.26 () {56 vars in 1133 bytes} [Sun Oct 2 00:43:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:41.954129 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab0426-3c8a-4c81-8a01-0a9466d3e134 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:42.053504 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:42.070061 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d72e2-988d-4e3a-853d-2ff91bdd0a24 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:42.108165 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab0426-3c8a-4c81-8a01-0a9466d3e134 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:42.111805 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf507d8b-96b3-4143-8526-3d3f61983a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:42.112501 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf507d8b-96b3-4143-8526-3d3f61983a85 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:42.112845 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf507d8b-96b3-4143-8526-3d3f61983a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:42.113212 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf507d8b-96b3-4143-8526-3d3f61983a85 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:42.113958 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf507d8b-96b3-4143-8526-3d3f61983a85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:42.115431 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf507d8b-96b3-4143-8526-3d3f61983a85 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:42.125711 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 514/1041] 10.222.0.26 () {56 vars in 1087 bytes} [Sun Oct 2 00:43:41 2022] GET /identity/v3/services => generated 1957 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:43:42.126704 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf507d8b-96b3-4143-8526-3d3f61983a85 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:42.158386 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760676b7-219a-4c13-94ef-315743550f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:42.159268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760676b7-219a-4c13-94ef-315743550f89 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:42.159553 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760676b7-219a-4c13-94ef-315743550f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:42.159900 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760676b7-219a-4c13-94ef-315743550f89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:42.238517 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:42.260990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760676b7-219a-4c13-94ef-315743550f89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:42.263672 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760676b7-219a-4c13-94ef-315743550f89 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:42.285404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf507d8b-96b3-4143-8526-3d3f61983a85 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:42.336217 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9a227-8d2a-478e-8645-e92df97520c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:42.337600 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9a227-8d2a-478e-8645-e92df97520c9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:42.338615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9a227-8d2a-478e-8645-e92df97520c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:42.338615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9a227-8d2a-478e-8645-e92df97520c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:42.351493 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9a227-8d2a-478e-8645-e92df97520c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:43:42.356099 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:42.357659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-6ee9a227-8d2a-478e-8645-e92df97520c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:43:42.357659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:42.357659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:42.357659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:42.357659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:42.357659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:42.357659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:42.357659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:42.357659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:42.357659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:42.357659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:42.357659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:42.357659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:43:42.357659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:43:42.357659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:43:42.357659 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:43:42.358977 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:43:42.358977 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:43:42.358977 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:43:42.358977 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:43:42.358977 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:42.358977 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:42.358977 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:42.358977 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:42.358977 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:42.358977 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:42.358977 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:42.358977 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:42.358977 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:42.358977 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:42.358977 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:42.358977 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:42.361951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:42.361951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:42.361951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:42.361951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:42.361951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:43:42.361951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:43:42.361951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:43:42.361951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:43:42.361951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:43:42.361951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:43:42.361951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:43:42.361951 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:42.361951 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 515/1042] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:43:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:42.365616 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9a227-8d2a-478e-8645-e92df97520c9 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:42.436140 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 528/1043] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:43:41 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:43:42.439111 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760676b7-219a-4c13-94ef-315743550f89 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:42.494124 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9a227-8d2a-478e-8645-e92df97520c9 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:42.528650 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:42.536015 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7fdd1-fd7c-4ddd-8459-70cc88b427e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:42.536675 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7fdd1-fd7c-4ddd-8459-70cc88b427e7 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:42.536957 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7fdd1-fd7c-4ddd-8459-70cc88b427e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:42.537267 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7fdd1-fd7c-4ddd-8459-70cc88b427e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:42.537960 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7fdd1-fd7c-4ddd-8459-70cc88b427e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:42.538265 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7fdd1-fd7c-4ddd-8459-70cc88b427e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:42.540166 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7fdd1-fd7c-4ddd-8459-70cc88b427e7 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:42.556381 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 516/1044] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:43:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:42.558076 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7fdd1-fd7c-4ddd-8459-70cc88b427e7 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:42.621613 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760676b7-219a-4c13-94ef-315743550f89 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:42.676932 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b6607-70a7-44cc-83f2-8b4b92d47d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:42.677891 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b6607-70a7-44cc-83f2-8b4b92d47d65 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:42.678452 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b6607-70a7-44cc-83f2-8b4b92d47d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:42.678905 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b6607-70a7-44cc-83f2-8b4b92d47d65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:42.689066 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7fdd1-fd7c-4ddd-8459-70cc88b427e7 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:42.692545 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b6607-70a7-44cc-83f2-8b4b92d47d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:42.694332 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b6607-70a7-44cc-83f2-8b4b92d47d65 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:42.711969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ba5b6607-70a7-44cc-83f2-8b4b92d47d65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:42.711969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:42.711969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:42.711969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:42.711969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:42.711969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:42.711969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:42.711969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:42.711969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:42.711969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:42.711969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:42.711969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:42.711969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:42.711969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:42.711969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:42.711969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:42.713245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:42.713245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:42.713245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:42.713245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:42.713245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:42.713245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:42.713245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:42.713245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:42.713245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:42.713245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:42.713245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:42.713245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:42.713245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:42.713245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:42.713245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:42.713245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:42.713245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:42.714406 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:42.714406 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:42.714406 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:42.715971 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 529/1045] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:42.721958 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b6607-70a7-44cc-83f2-8b4b92d47d65 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:42.744529 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1d30d-cb59-4669-bd22-4a88f651d3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:42.745252 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1d30d-cb59-4669-bd22-4a88f651d3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:42.745530 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1d30d-cb59-4669-bd22-4a88f651d3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:42.745959 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1d30d-cb59-4669-bd22-4a88f651d3a0 None admin] PATH_INFO: `/v3/users/9026b6f481894e7aa3065f7ce2154c36` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:42.752000 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:42.763471 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1d30d-cb59-4669-bd22-4a88f651d3a0 None admin] RBAC: Authorizing `identity:get_user(user_id=9026b6f481894e7aa3065f7ce2154c36)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:42.765285 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1d30d-cb59-4669-bd22-4a88f651d3a0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:42.767762 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 517/1046] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:43:42 2022] GET /identity/v3/users/9026b6f481894e7aa3065f7ce2154c36 => generated 285 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:42.773265 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1d30d-cb59-4669-bd22-4a88f651d3a0 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:42.832565 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:42.888785 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b6607-70a7-44cc-83f2-8b4b92d47d65 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:42.908811 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1d30d-cb59-4669-bd22-4a88f651d3a0 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:42.931213 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51dd25-6b34-4b56-ae73-a6fc6c2bb089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:42.931833 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51dd25-6b34-4b56-ae73-a6fc6c2bb089 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:42.932109 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51dd25-6b34-4b56-ae73-a6fc6c2bb089 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:42.932377 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51dd25-6b34-4b56-ae73-a6fc6c2bb089 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:42.933057 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51dd25-6b34-4b56-ae73-a6fc6c2bb089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:42.933363 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51dd25-6b34-4b56-ae73-a6fc6c2bb089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:42.934746 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51dd25-6b34-4b56-ae73-a6fc6c2bb089 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:42.953237 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 530/1047] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:42.954910 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51dd25-6b34-4b56-ae73-a6fc6c2bb089 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:42.979167 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a3da4-1974-48ff-8dc3-5c1e132b2485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:42.979951 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a3da4-1974-48ff-8dc3-5c1e132b2485 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:42.980449 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a3da4-1974-48ff-8dc3-5c1e132b2485 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:42.980958 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a3da4-1974-48ff-8dc3-5c1e132b2485 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:43.047632 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:43.072487 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a3da4-1974-48ff-8dc3-5c1e132b2485 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:43.074014 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a3da4-1974-48ff-8dc3-5c1e132b2485 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:43.089261 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51dd25-6b34-4b56-ae73-a6fc6c2bb089 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:43.140696 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:43.143715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248808d2-8064-4e58-b5c9-6dab74818f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:43.145136 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248808d2-8064-4e58-b5c9-6dab74818f88 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:43.145606 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248808d2-8064-4e58-b5c9-6dab74818f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:43.146044 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248808d2-8064-4e58-b5c9-6dab74818f88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:43.156535 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248808d2-8064-4e58-b5c9-6dab74818f88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:43.158040 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248808d2-8064-4e58-b5c9-6dab74818f88 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:43.170627 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-248808d2-8064-4e58-b5c9-6dab74818f88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:43.170627 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:43.170627 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:43.170627 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:43.170627 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:43.170627 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:43.170627 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:43.170627 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:43.170627 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:43.170627 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:43.170627 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:43.170627 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:43.170627 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:43:43.170627 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:43:43.170627 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:43:43.172564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:43:43.172564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:43.172564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:43.172564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:43.172564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:43.172564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:43.172564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:43.172564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:43.172564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:43.172564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:43.172564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:43.172564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:43.172564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:43.172564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:43.172564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:43.172564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:43.172564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:43.174466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:43:43.174466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:43:43.174466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:43:43.174466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:43:43.174466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:43:43.174466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:43:43.174466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:43.174466 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:43.174466 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 531/1048] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:43:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:43.181272 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248808d2-8064-4e58-b5c9-6dab74818f88 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:43.227632 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 518/1049] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:43:42 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 02 00:43:43.234070 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a3da4-1974-48ff-8dc3-5c1e132b2485 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:43.334224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248808d2-8064-4e58-b5c9-6dab74818f88 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:43.349443 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a3da4-1974-48ff-8dc3-5c1e132b2485 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:43.382472 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8fdb9-92d6-4508-9496-8f1c12193851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:43.383584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8fdb9-92d6-4508-9496-8f1c12193851 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:43.384086 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8fdb9-92d6-4508-9496-8f1c12193851 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:43.384594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8fdb9-92d6-4508-9496-8f1c12193851 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:43.385885 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8fdb9-92d6-4508-9496-8f1c12193851 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:43.386215 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8fdb9-92d6-4508-9496-8f1c12193851 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:43.389211 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8fdb9-92d6-4508-9496-8f1c12193851 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:43.392254 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:43.393602 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbac83-ef67-45bf-9964-e5f4096ad8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:43.394935 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbac83-ef67-45bf-9964-e5f4096ad8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:43.395429 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbac83-ef67-45bf-9964-e5f4096ad8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:43.395908 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbac83-ef67-45bf-9964-e5f4096ad8e8 None admin] PATH_INFO: `/v3/projects/04a363fd7a054ecb95ae8f4f039f9f62` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:43.397471 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbac83-ef67-45bf-9964-e5f4096ad8e8 None admin] RBAC: Authorizing `identity:get_project(project_id=04a363fd7a054ecb95ae8f4f039f9f62)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:43.400255 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbac83-ef67-45bf-9964-e5f4096ad8e8 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:43.408294 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 519/1050] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:43:43 2022] GET /identity/v3/projects/04a363fd7a054ecb95ae8f4f039f9f62 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:43.409525 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbac83-ef67-45bf-9964-e5f4096ad8e8 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:43.419358 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 532/1051] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:43:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:43.425721 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8fdb9-92d6-4508-9496-8f1c12193851 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:43.443391 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:43.563195 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbac83-ef67-45bf-9964-e5f4096ad8e8 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:43.564052 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8fdb9-92d6-4508-9496-8f1c12193851 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:43.608310 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a4ba5-4f31-4d22-9cc2-95af603c8c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:43.609097 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a4ba5-4f31-4d22-9cc2-95af603c8c39 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:43.609384 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a4ba5-4f31-4d22-9cc2-95af603c8c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:43.609656 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a4ba5-4f31-4d22-9cc2-95af603c8c39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:43.610526 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a4ba5-4f31-4d22-9cc2-95af603c8c39 None admin] RBAC: Adding query filter params (role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.project.id=04a363fd7a054ecb95ae8f4f039f9f62, user.id=9026b6f481894e7aa3065f7ce2154c36) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:43.610841 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a4ba5-4f31-4d22-9cc2-95af603c8c39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:43.612337 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a4ba5-4f31-4d22-9cc2-95af603c8c39 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:43.616648 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a72854-38a7-4e2c-a12e-d36d8dfcc83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:43.617414 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a72854-38a7-4e2c-a12e-d36d8dfcc83e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:43.617876 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a72854-38a7-4e2c-a12e-d36d8dfcc83e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:43.618345 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a72854-38a7-4e2c-a12e-d36d8dfcc83e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:43.619609 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 520/1052] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:43:43 2022] GET /identity/v3/role_assignments?user.id=9026b6f481894e7aa3065f7ce2154c36&scope.project.id=04a363fd7a054ecb95ae8f4f039f9f62&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:43.619796 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a72854-38a7-4e2c-a12e-d36d8dfcc83e None admin] RBAC: Adding query filter params (role.id=64c56800e24e42a496f2aba027c62ab0, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=81e0396b7ba341ce8d02b1a149786d95) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:43.620060 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a72854-38a7-4e2c-a12e-d36d8dfcc83e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:43.621801 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a72854-38a7-4e2c-a12e-d36d8dfcc83e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:43.630515 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 533/1053] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:43:43 2022] GET /identity/v3/role_assignments?user.id=81e0396b7ba341ce8d02b1a149786d95&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=64c56800e24e42a496f2aba027c62ab0 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:44.477973 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc95acb-a583-4f2d-8e99-7124bc4439ba None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:44.478512 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc95acb-a583-4f2d-8e99-7124bc4439ba None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:44.478512 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc95acb-a583-4f2d-8e99-7124bc4439ba None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:44.480091 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 521/1054] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:43:44.485647 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fd6ac-5dac-4f76-9178-492fd861b4e2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:44.486155 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fd6ac-5dac-4f76-9178-492fd861b4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:44.486244 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fd6ac-5dac-4f76-9178-492fd861b4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:44.512393 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-442fd6ac-5dac-4f76-9178-492fd861b4e2 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:44.514718 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-442fd6ac-5dac-4f76-9178-492fd861b4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:44.612458 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:44.633544 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 534/1055] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:43:44.954016 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc95acb-a583-4f2d-8e99-7124bc4439ba None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:45.116466 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:45.147777 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc95acb-a583-4f2d-8e99-7124bc4439ba None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:45.204898 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92283be-8591-4983-a9e0-a666dfbe0ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:45.205867 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92283be-8591-4983-a9e0-a666dfbe0ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:45.206349 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92283be-8591-4983-a9e0-a666dfbe0ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:45.206811 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92283be-8591-4983-a9e0-a666dfbe0ee2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:45.207834 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92283be-8591-4983-a9e0-a666dfbe0ee2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:45.210412 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92283be-8591-4983-a9e0-a666dfbe0ee2 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:45.227506 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-c92283be-8591-4983-a9e0-a666dfbe0ee2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 02 00:43:45.227506 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:45.227506 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:43:45.227506 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:43:45.227506 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:43:45.227506 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:43:45.227506 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:43:45.227506 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:45.227506 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 02 00:43:45.227506 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:45.227506 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:43:45.227506 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:45.227506 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:45.227506 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:45.227506 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:45.227506 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:45.227506 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:45.228645 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:45.228645 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:45.228645 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:45.228645 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:45.228645 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:45.228645 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:45.228645 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:43:45.228645 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:43:45.228645 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:43:45.228645 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:43:45.228645 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:45.228645 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:45.228645 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:45.228645 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:45.228645 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:45.228645 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:45.233657 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:45.233657 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:45.233657 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:45.233657 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:45.233657 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:45.233657 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:45.233657 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:45.233657 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:45.233657 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:45.233657 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:45.233657 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:43:45.233657 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:43:45.233657 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 02 00:43:45.233657 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:45.233657 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 522/1056] 10.222.0.26 () {56 vars in 1105 bytes} [Sun Oct 2 00:43:44 2022] GET /identity/v3/services/image => generated 86 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:45.235949 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fd6ac-5dac-4f76-9178-492fd861b4e2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:45.353417 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fd6ac-5dac-4f76-9178-492fd861b4e2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:45.393421 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b9982-1ffb-4c7a-a44a-9613b1dcaa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:45.394104 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b9982-1ffb-4c7a-a44a-9613b1dcaa41 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:45.394278 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b9982-1ffb-4c7a-a44a-9613b1dcaa41 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:45.394562 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b9982-1ffb-4c7a-a44a-9613b1dcaa41 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:45.395282 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b9982-1ffb-4c7a-a44a-9613b1dcaa41 None admin] RBAC: Adding query filter params (name=image) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:45.395582 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b9982-1ffb-4c7a-a44a-9613b1dcaa41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:45.397006 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b9982-1ffb-4c7a-a44a-9613b1dcaa41 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:45.409116 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 535/1057] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:45.413553 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92283be-8591-4983-a9e0-a666dfbe0ee2 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:45.591801 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92283be-8591-4983-a9e0-a666dfbe0ee2 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:45.648306 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c79d6f-c3f5-4b64-8b46-c84554c95daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:45.649388 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c79d6f-c3f5-4b64-8b46-c84554c95daa None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:45.649864 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c79d6f-c3f5-4b64-8b46-c84554c95daa None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:45.650323 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c79d6f-c3f5-4b64-8b46-c84554c95daa None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:45.651420 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c79d6f-c3f5-4b64-8b46-c84554c95daa None admin] RBAC: Adding query filter params (type=image) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:45.651936 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c79d6f-c3f5-4b64-8b46-c84554c95daa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:45.654484 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c79d6f-c3f5-4b64-8b46-c84554c95daa None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:45.668375 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 523/1058] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:45.670091 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b9982-1ffb-4c7a-a44a-9613b1dcaa41 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:45.765032 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:45.831523 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b9982-1ffb-4c7a-a44a-9613b1dcaa41 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:45.878458 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb13f99-2d2e-4a33-991d-3afddc312693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:45.878966 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb13f99-2d2e-4a33-991d-3afddc312693 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:45.879239 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb13f99-2d2e-4a33-991d-3afddc312693 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:45.879505 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb13f99-2d2e-4a33-991d-3afddc312693 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:45.880178 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb13f99-2d2e-4a33-991d-3afddc312693 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:45.881666 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb13f99-2d2e-4a33-991d-3afddc312693 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:45.913005 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 536/1059] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:43:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:43:45.942986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dfed2-55aa-49aa-938d-bb81fea24a60 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:45.943429 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dfed2-55aa-49aa-938d-bb81fea24a60 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:45.943837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dfed2-55aa-49aa-938d-bb81fea24a60 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:45.946001 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 524/1060] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:45.951948 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b98ef-7fdb-444a-9ac0-15598f8ac23e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:45.952247 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b678b07-e1c7-439c-9c58-34c4453aa43a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:45.952408 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b678b07-e1c7-439c-9c58-34c4453aa43a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:45.952550 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b98ef-7fdb-444a-9ac0-15598f8ac23e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:45.952728 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b678b07-e1c7-439c-9c58-34c4453aa43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:45.952893 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b98ef-7fdb-444a-9ac0-15598f8ac23e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:45.954676 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 537/1061] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:45.961715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e84d48-339b-46c9-bb9a-f3eb8850473c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:45.961987 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e84d48-339b-46c9-bb9a-f3eb8850473c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:45.962537 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e84d48-339b-46c9-bb9a-f3eb8850473c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:45.975062 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4b678b07-e1c7-439c-9c58-34c4453aa43a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:45.977964 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4b678b07-e1c7-439c-9c58-34c4453aa43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:45.985271 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e9e84d48-339b-46c9-bb9a-f3eb8850473c None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:45.986789 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e9e84d48-339b-46c9-bb9a-f3eb8850473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:45.988683 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:46.109290 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 525/1062] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:46.113002 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 538/1063] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:43:46.382008 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b678b07-e1c7-439c-9c58-34c4453aa43a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:46.397853 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e84d48-339b-46c9-bb9a-f3eb8850473c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:46.454251 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:46.537193 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b678b07-e1c7-439c-9c58-34c4453aa43a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:46.542759 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e84d48-339b-46c9-bb9a-f3eb8850473c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:46.590738 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6d99b-1155-4fe7-bfbe-a0e106033188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:46.591738 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6d99b-1155-4fe7-bfbe-a0e106033188 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:46.592101 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6d99b-1155-4fe7-bfbe-a0e106033188 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:46.593094 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6d99b-1155-4fe7-bfbe-a0e106033188 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:46.600426 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904a30a-b63e-4a1b-ad88-8937019f8b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:46.601482 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904a30a-b63e-4a1b-ad88-8937019f8b15 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:46.601883 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904a30a-b63e-4a1b-ad88-8937019f8b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:46.602325 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904a30a-b63e-4a1b-ad88-8937019f8b15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:46.605334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:46.611702 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6d99b-1155-4fe7-bfbe-a0e106033188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:43:46.620817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904a30a-b63e-4a1b-ad88-8937019f8b15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:43:46.621869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-05d6d99b-1155-4fe7-bfbe-a0e106033188 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:43:46.621869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:46.621869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:46.621869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:46.621869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:46.621869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:46.621869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:46.621869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:46.621869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:46.621869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:46.621869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:46.621869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:46.621869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:43:46.621869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:43:46.621869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:43:46.621869 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:43:46.623663 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:43:46.623663 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:43:46.623663 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:43:46.623663 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:43:46.623663 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:46.623663 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:46.623663 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:46.623663 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:46.623663 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:46.623663 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:46.623663 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:46.623663 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:46.623663 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:46.623663 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:46.623663 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:46.623663 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:46.626996 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:46.626996 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:46.626996 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:46.626996 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:46.626996 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:43:46.626996 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:43:46.626996 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:43:46.626996 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:43:46.626996 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:43:46.626996 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:43:46.626996 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:43:46.626996 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:46.626996 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 526/1064] 10.222.0.26 () {56 vars in 1120 bytes} [Sun Oct 2 00:43:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:46.629457 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d904a30a-b63e-4a1b-ad88-8937019f8b15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:43:46.629457 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:46.629457 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:46.629457 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:46.629457 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:46.629457 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:46.629457 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:46.629457 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:46.629457 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:46.629457 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:46.629457 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:46.629457 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:46.629457 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:43:46.629457 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:43:46.629457 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:43:46.629457 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:43:46.631800 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:43:46.631800 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:43:46.631800 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:43:46.631800 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:43:46.631800 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:46.631800 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:46.631800 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:46.631800 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:46.631800 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:46.631800 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:46.631800 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:46.631800 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:46.631800 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:46.631800 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:46.631800 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:46.631800 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:46.636034 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:46.636034 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:46.636034 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:46.636034 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:46.636034 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:43:46.636034 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:43:46.636034 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:43:46.636034 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:43:46.636034 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:43:46.636034 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:43:46.636034 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:43:46.636034 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:46.638934 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6d99b-1155-4fe7-bfbe-a0e106033188 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:46.640113 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 539/1065] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:43:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:46.641182 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904a30a-b63e-4a1b-ad88-8937019f8b15 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:46.769128 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:46.778464 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904a30a-b63e-4a1b-ad88-8937019f8b15 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:46.818845 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14346732-8e6c-43e0-839b-540253cff399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:46.819462 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14346732-8e6c-43e0-839b-540253cff399 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:46.819741 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14346732-8e6c-43e0-839b-540253cff399 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:46.820006 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14346732-8e6c-43e0-839b-540253cff399 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:46.820696 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14346732-8e6c-43e0-839b-540253cff399 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:46.821614 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14346732-8e6c-43e0-839b-540253cff399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:46.822319 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6d99b-1155-4fe7-bfbe-a0e106033188 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:46.823020 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14346732-8e6c-43e0-839b-540253cff399 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:46.832910 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 540/1066] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:43:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:46.839289 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14346732-8e6c-43e0-839b-540253cff399 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:46.872569 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d85c5-8283-4e83-a78c-174de0ca82ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:46.873218 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d85c5-8283-4e83-a78c-174de0ca82ef None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:46.873536 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d85c5-8283-4e83-a78c-174de0ca82ef None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:46.873813 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d85c5-8283-4e83-a78c-174de0ca82ef None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:46.874433 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d85c5-8283-4e83-a78c-174de0ca82ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:46.874741 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d85c5-8283-4e83-a78c-174de0ca82ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:46.876535 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d85c5-8283-4e83-a78c-174de0ca82ef None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:46.887704 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 527/1067] 10.222.0.26 () {56 vars in 1115 bytes} [Sun Oct 2 00:43:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:46.894198 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d85c5-8283-4e83-a78c-174de0ca82ef None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:46.969921 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14346732-8e6c-43e0-839b-540253cff399 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:46.971989 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:47.017627 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22537d42-f101-4acc-9100-b6e2ef91438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:47.018275 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22537d42-f101-4acc-9100-b6e2ef91438c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:47.018547 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22537d42-f101-4acc-9100-b6e2ef91438c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:47.018818 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22537d42-f101-4acc-9100-b6e2ef91438c None admin] PATH_INFO: `/v3/users/9026b6f481894e7aa3065f7ce2154c36` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:47.019998 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22537d42-f101-4acc-9100-b6e2ef91438c None admin] RBAC: Authorizing `identity:get_user(user_id=9026b6f481894e7aa3065f7ce2154c36)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:47.021478 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22537d42-f101-4acc-9100-b6e2ef91438c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:47.023078 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 541/1068] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:43:46 2022] GET /identity/v3/users/9026b6f481894e7aa3065f7ce2154c36 => generated 285 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:47.030481 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22537d42-f101-4acc-9100-b6e2ef91438c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:47.044510 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d85c5-8283-4e83-a78c-174de0ca82ef None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:47.072391 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:47.101324 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d183b-723d-47d5-ba06-667e9fa7886d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:47.102991 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d183b-723d-47d5-ba06-667e9fa7886d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:47.103484 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d183b-723d-47d5-ba06-667e9fa7886d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:47.103975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d183b-723d-47d5-ba06-667e9fa7886d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:47.119646 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d183b-723d-47d5-ba06-667e9fa7886d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:47.121669 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d183b-723d-47d5-ba06-667e9fa7886d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:47.141583 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-7e0d183b-723d-47d5-ba06-667e9fa7886d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:47.141583 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:47.141583 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:47.141583 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:47.141583 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:47.141583 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:47.141583 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:47.141583 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:47.141583 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:47.141583 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:47.141583 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:47.141583 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:47.141583 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:47.141583 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:47.141583 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:47.141583 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:47.151172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:47.151172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:47.151172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:47.151172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:47.151172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:47.151172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:47.151172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:47.151172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:47.151172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:47.151172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:47.151172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:47.151172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:47.151172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:47.151172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:47.151172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:47.151172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:47.151172 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:47.152981 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:47.152981 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:47.152981 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:47.152981 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 528/1069] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:47.152981 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d183b-723d-47d5-ba06-667e9fa7886d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:47.170872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22537d42-f101-4acc-9100-b6e2ef91438c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:47.218450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cb0df-3b4c-403c-a3b8-07b3a0e3116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:47.219486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cb0df-3b4c-403c-a3b8-07b3a0e3116c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:47.219949 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cb0df-3b4c-403c-a3b8-07b3a0e3116c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:47.221074 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cb0df-3b4c-403c-a3b8-07b3a0e3116c None admin] PATH_INFO: `/v3/projects/04a363fd7a054ecb95ae8f4f039f9f62` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:47.223015 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cb0df-3b4c-403c-a3b8-07b3a0e3116c None admin] RBAC: Authorizing `identity:get_project(project_id=04a363fd7a054ecb95ae8f4f039f9f62)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:47.225550 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cb0df-3b4c-403c-a3b8-07b3a0e3116c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:47.228993 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 542/1070] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:43:47 2022] GET /identity/v3/projects/04a363fd7a054ecb95ae8f4f039f9f62 => generated 311 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:47.235331 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cb0df-3b4c-403c-a3b8-07b3a0e3116c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:47.287695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d183b-723d-47d5-ba06-667e9fa7886d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:47.303437 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:47.335367 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453683a-70c9-48a9-b099-80279ec39de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:47.336478 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453683a-70c9-48a9-b099-80279ec39de7 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:47.336984 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453683a-70c9-48a9-b099-80279ec39de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:47.337486 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453683a-70c9-48a9-b099-80279ec39de7 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:47.338677 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453683a-70c9-48a9-b099-80279ec39de7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:47.339117 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453683a-70c9-48a9-b099-80279ec39de7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:47.341754 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453683a-70c9-48a9-b099-80279ec39de7 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:47.368755 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 529/1071] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:47.370320 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453683a-70c9-48a9-b099-80279ec39de7 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:47.375148 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:47.393123 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cb0df-3b4c-403c-a3b8-07b3a0e3116c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:47.454953 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da573a9-86e1-4bf5-8f2c-1c1d3adbb880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:47.456082 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da573a9-86e1-4bf5-8f2c-1c1d3adbb880 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:47.456579 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da573a9-86e1-4bf5-8f2c-1c1d3adbb880 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:47.457125 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da573a9-86e1-4bf5-8f2c-1c1d3adbb880 None admin] PATH_INFO: `/v3/projects/04a363fd7a054ecb95ae8f4f039f9f62/users/9026b6f481894e7aa3065f7ce2154c36/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:47.460275 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da573a9-86e1-4bf5-8f2c-1c1d3adbb880 None admin] RBAC: Authorizing `identity:create_grant(project_id=04a363fd7a054ecb95ae8f4f039f9f62, user_id=9026b6f481894e7aa3065f7ce2154c36, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:47.463159 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da573a9-86e1-4bf5-8f2c-1c1d3adbb880 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:47.486155 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 543/1072] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:43:47 2022] PUT /identity/v3/projects/04a363fd7a054ecb95ae8f4f039f9f62/users/9026b6f481894e7aa3065f7ce2154c36/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:43:47.524923 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453683a-70c9-48a9-b099-80279ec39de7 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:47.592539 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d5104-4044-4c33-ade8-85fd558fcd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:47.593600 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d5104-4044-4c33-ade8-85fd558fcd5a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:47.594010 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d5104-4044-4c33-ade8-85fd558fcd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:47.594470 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d5104-4044-4c33-ade8-85fd558fcd5a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:47.608866 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d5104-4044-4c33-ade8-85fd558fcd5a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:47.611722 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d5104-4044-4c33-ade8-85fd558fcd5a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:47.636243 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-d46d5104-4044-4c33-ade8-85fd558fcd5a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:43:47.636243 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:47.636243 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:47.636243 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:47.636243 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:47.636243 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:47.636243 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:47.636243 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:47.636243 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:47.636243 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:47.636243 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:47.636243 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:47.636243 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:43:47.636243 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:43:47.636243 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:43:47.636243 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:43:47.637954 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:47.637954 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:47.637954 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:43:47.637954 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:47.637954 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:43:47.637954 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:47.637954 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:47.637954 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:47.637954 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:47.637954 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:47.637954 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:47.637954 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:47.637954 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:47.637954 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:47.637954 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:47.637954 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:47.637954 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:47.637954 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:47.639226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:47.639226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:47.639226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:43:47.639226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:43:47.639226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:43:47.639226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:43:47.639226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:43:47.639226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:43:47.639226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:43:47.639226 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:47.641468 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 530/1073] 10.222.0.26 () {56 vars in 1093 bytes} [Sun Oct 2 00:43:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:47.646651 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da573a9-86e1-4bf5-8f2c-1c1d3adbb880 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:47.783959 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da573a9-86e1-4bf5-8f2c-1c1d3adbb880 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:47.835357 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c679fdc-3398-4ae6-b412-eb008be505c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:47.835992 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c679fdc-3398-4ae6-b412-eb008be505c1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:47.836930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c679fdc-3398-4ae6-b412-eb008be505c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:47.837278 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c679fdc-3398-4ae6-b412-eb008be505c1 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:47.837961 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c679fdc-3398-4ae6-b412-eb008be505c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:47.838262 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c679fdc-3398-4ae6-b412-eb008be505c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:47.839746 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c679fdc-3398-4ae6-b412-eb008be505c1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:47.861726 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 544/1074] 10.222.0.26 () {56 vars in 1133 bytes} [Sun Oct 2 00:43:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:47.868264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d5104-4044-4c33-ade8-85fd558fcd5a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:47.906563 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:47.989087 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d5104-4044-4c33-ade8-85fd558fcd5a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:48.037640 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e29de-8dba-4d06-a768-2b174c382918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:48.038399 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e29de-8dba-4d06-a768-2b174c382918 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:48.038683 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e29de-8dba-4d06-a768-2b174c382918 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:48.038960 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e29de-8dba-4d06-a768-2b174c382918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:48.056994 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e29de-8dba-4d06-a768-2b174c382918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:48.058699 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e29de-8dba-4d06-a768-2b174c382918 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:48.075316 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-8e7e29de-8dba-4d06-a768-2b174c382918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:48.075316 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:48.075316 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:48.075316 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:48.075316 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:48.075316 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:48.075316 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:48.075316 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:48.075316 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:48.075316 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:48.075316 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:48.075316 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:48.075316 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:48.075316 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:48.075316 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:48.075316 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:48.076660 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:48.076660 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:48.076660 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:48.076660 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:48.076660 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:48.076660 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:48.076660 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:48.076660 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:48.076660 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:48.076660 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:48.076660 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:48.076660 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:48.076660 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:48.076660 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:48.076660 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:48.076660 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:48.076660 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:48.077982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:48.077982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:48.077982 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:48.083249 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 531/1075] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:48.083414 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c679fdc-3398-4ae6-b412-eb008be505c1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:48.101244 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:48.225906 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c679fdc-3398-4ae6-b412-eb008be505c1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:48.270697 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d6ab9-e6be-4186-925c-47fb9a1957a6 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:48.271109 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d6ab9-e6be-4186-925c-47fb9a1957a6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:48.271549 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d6ab9-e6be-4186-925c-47fb9a1957a6 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:48.273120 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 532/1076] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:43:48.283040 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4702e25-3e05-4899-92e3-22bb8108c418 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:48.283475 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4702e25-3e05-4899-92e3-22bb8108c418 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:48.283923 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4702e25-3e05-4899-92e3-22bb8108c418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:48.301187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b738a-d532-4587-a759-825b07ec05d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:48.302170 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b738a-d532-4587-a759-825b07ec05d0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:48.302628 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b738a-d532-4587-a759-825b07ec05d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:48.303069 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b738a-d532-4587-a759-825b07ec05d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:48.304171 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b738a-d532-4587-a759-825b07ec05d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:48.304671 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b738a-d532-4587-a759-825b07ec05d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:48.307817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b738a-d532-4587-a759-825b07ec05d0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:48.315549 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e4702e25-3e05-4899-92e3-22bb8108c418 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:48.317029 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e4702e25-3e05-4899-92e3-22bb8108c418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:48.324896 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 545/1077] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:48.331882 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b738a-d532-4587-a759-825b07ec05d0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:48.427204 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 533/1078] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:43:48.476616 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:48.523131 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b738a-d532-4587-a759-825b07ec05d0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:48.589297 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485d50d-14ff-4621-bd24-9ebf3b3f369a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:48.590416 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485d50d-14ff-4621-bd24-9ebf3b3f369a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:48.590910 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485d50d-14ff-4621-bd24-9ebf3b3f369a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:48.591438 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485d50d-14ff-4621-bd24-9ebf3b3f369a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:48.604220 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485d50d-14ff-4621-bd24-9ebf3b3f369a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:48.606108 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485d50d-14ff-4621-bd24-9ebf3b3f369a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:48.621819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-7485d50d-14ff-4621-bd24-9ebf3b3f369a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:48.621819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:48.621819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:48.621819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:48.621819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:48.621819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:48.621819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:48.621819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:48.621819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:48.621819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:48.621819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:48.621819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:48.621819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:43:48.621819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:43:48.621819 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:43:48.630141 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:43:48.630141 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:48.630141 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:48.630141 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:48.630141 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:48.630141 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:48.630141 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:48.630141 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:48.630141 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:48.630141 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:48.630141 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:48.630141 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:48.630141 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:48.630141 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:48.630141 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:48.630141 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:48.630141 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:48.632373 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:43:48.632373 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:43:48.632373 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:43:48.632373 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:43:48.632373 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:43:48.632373 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:43:48.632373 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:48.632373 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:48.632373 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 546/1079] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:43:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:48.637623 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4702e25-3e05-4899-92e3-22bb8108c418 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:48.659520 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:48.710606 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485d50d-14ff-4621-bd24-9ebf3b3f369a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:48.787519 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4702e25-3e05-4899-92e3-22bb8108c418 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:48.833159 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5bd84-d433-4c88-90d0-4fd23a0662e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:48.834304 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5bd84-d433-4c88-90d0-4fd23a0662e5 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:48.834715 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5bd84-d433-4c88-90d0-4fd23a0662e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:48.834997 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5bd84-d433-4c88-90d0-4fd23a0662e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:48.835698 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5bd84-d433-4c88-90d0-4fd23a0662e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:48.836275 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5bd84-d433-4c88-90d0-4fd23a0662e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:48.838285 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5bd84-d433-4c88-90d0-4fd23a0662e5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:48.855810 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 534/1080] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:43:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:48.862222 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5bd84-d433-4c88-90d0-4fd23a0662e5 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:48.864082 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485d50d-14ff-4621-bd24-9ebf3b3f369a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:48.931611 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7c677-f86d-432e-b836-ffd78d856752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:48.932587 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7c677-f86d-432e-b836-ffd78d856752 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:48.933125 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7c677-f86d-432e-b836-ffd78d856752 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:48.933610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7c677-f86d-432e-b836-ffd78d856752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:48.938023 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:48.983572 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:49.022904 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5bd84-d433-4c88-90d0-4fd23a0662e5 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:49.043241 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7c677-f86d-432e-b836-ffd78d856752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:49.044591 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7c677-f86d-432e-b836-ffd78d856752 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:49.086761 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfdaee-eb18-479e-be6a-2f3dbc369a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:49.088226 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfdaee-eb18-479e-be6a-2f3dbc369a12 None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:49.088998 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfdaee-eb18-479e-be6a-2f3dbc369a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:49.089497 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfdaee-eb18-479e-be6a-2f3dbc369a12 None admin] PATH_INFO: `/v3/projects/7aec935005514f808eb735bfb01fee6e/users/81e0396b7ba341ce8d02b1a149786d95/roles/64c56800e24e42a496f2aba027c62ab0` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:49.093228 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfdaee-eb18-479e-be6a-2f3dbc369a12 None admin] RBAC: Authorizing `identity:create_grant(project_id=7aec935005514f808eb735bfb01fee6e, user_id=81e0396b7ba341ce8d02b1a149786d95, role_id=64c56800e24e42a496f2aba027c62ab0)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:49.095805 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfdaee-eb18-479e-be6a-2f3dbc369a12 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:49.124570 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 535/1081] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:43:48 2022] PUT /identity/v3/projects/7aec935005514f808eb735bfb01fee6e/users/81e0396b7ba341ce8d02b1a149786d95/roles/64c56800e24e42a496f2aba027c62ab0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:43:49.181891 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 547/1082] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:43:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 02 00:43:49.192136 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfdaee-eb18-479e-be6a-2f3dbc369a12 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:49.325376 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfdaee-eb18-479e-be6a-2f3dbc369a12 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:49.369183 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da39d5-8546-4603-8360-0861a45cf190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:49.369828 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da39d5-8546-4603-8360-0861a45cf190 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:49.370106 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da39d5-8546-4603-8360-0861a45cf190 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:49.370378 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da39d5-8546-4603-8360-0861a45cf190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:49.372442 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:49.385991 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da39d5-8546-4603-8360-0861a45cf190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:49.387732 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da39d5-8546-4603-8360-0861a45cf190 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:49.404693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-77da39d5-8546-4603-8360-0861a45cf190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:49.404693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:49.404693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:49.404693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:49.404693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:49.404693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:49.404693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:49.404693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:49.404693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:49.404693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:49.404693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:49.404693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:49.404693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:49.404693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:49.404693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:49.404693 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:49.406349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:49.406349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:49.406349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:49.406349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:49.406349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:49.406349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:49.406349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:49.406349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:49.406349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:49.406349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:49.406349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:49.406349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:49.406349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:49.406349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:49.406349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:49.406349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:49.406349 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:49.407359 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:49.407359 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:49.407359 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:49.409746 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 536/1083] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:49.412368 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7c677-f86d-432e-b836-ffd78d856752 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:49.453228 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:49.533772 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7c677-f86d-432e-b836-ffd78d856752 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:49.580425 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfbfc9-4ce4-4eb1-be4d-792a62badb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:49.581486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfbfc9-4ce4-4eb1-be4d-792a62badb9c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:49.582000 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfbfc9-4ce4-4eb1-be4d-792a62badb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:49.582499 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfbfc9-4ce4-4eb1-be4d-792a62badb9c None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:49.583352 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfbfc9-4ce4-4eb1-be4d-792a62badb9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:49.583899 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfbfc9-4ce4-4eb1-be4d-792a62badb9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:49.585528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfbfc9-4ce4-4eb1-be4d-792a62badb9c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:49.599085 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 548/1084] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:49.804605 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f0e04-7b4b-489c-ba9a-82cb268162e9 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:49.805532 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f0e04-7b4b-489c-ba9a-82cb268162e9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:49.805532 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f0e04-7b4b-489c-ba9a-82cb268162e9 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:49.806745 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 537/1085] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:49.812310 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d73f77-d2cb-4b8f-9c64-16b25c5f123a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:49.812649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d73f77-d2cb-4b8f-9c64-16b25c5f123a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:49.812870 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d73f77-d2cb-4b8f-9c64-16b25c5f123a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:49.834503 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-15d73f77-d2cb-4b8f-9c64-16b25c5f123a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:49.835615 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-15d73f77-d2cb-4b8f-9c64-16b25c5f123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:49.912750 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 549/1086] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:50.189305 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f0e04-7b4b-489c-ba9a-82cb268162e9 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:50.293788 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f0e04-7b4b-489c-ba9a-82cb268162e9 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:50.329084 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd751f0f-8ecf-4914-9cc0-c4ef4df3d6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:50.329710 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd751f0f-8ecf-4914-9cc0-c4ef4df3d6ec None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:50.329986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd751f0f-8ecf-4914-9cc0-c4ef4df3d6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:50.330254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd751f0f-8ecf-4914-9cc0-c4ef4df3d6ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:50.340504 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd751f0f-8ecf-4914-9cc0-c4ef4df3d6ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:43:50.345302 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-dd751f0f-8ecf-4914-9cc0-c4ef4df3d6ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:43:50.345302 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:50.345302 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:50.345302 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:50.345302 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:50.345302 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:50.345302 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:50.345302 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:50.345302 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:50.345302 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:50.345302 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:50.345302 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:50.345302 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:43:50.345302 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:43:50.345302 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:43:50.345302 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:43:50.346257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:43:50.346257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:43:50.346257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:43:50.346257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:43:50.346257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:50.346257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:50.346257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:50.346257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:50.346257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:50.346257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:50.346257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:50.346257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:50.346257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:50.346257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:50.346257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:50.346257 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:50.347115 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:50.347115 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:50.347115 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:50.347115 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:50.347115 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:43:50.347115 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:43:50.347115 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:43:50.347115 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:43:50.347115 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:43:50.347115 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:43:50.347115 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:43:50.347115 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:50.347115 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 538/1087] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:43:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:50.353467 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d73f77-d2cb-4b8f-9c64-16b25c5f123a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:50.378507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:50.480397 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d73f77-d2cb-4b8f-9c64-16b25c5f123a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:50.518703 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa133d-a3dd-46db-b263-a77b665ec7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:50.519311 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa133d-a3dd-46db-b263-a77b665ec7fd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:50.519591 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa133d-a3dd-46db-b263-a77b665ec7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:50.519863 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa133d-a3dd-46db-b263-a77b665ec7fd None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:50.520530 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa133d-a3dd-46db-b263-a77b665ec7fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:50.520831 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa133d-a3dd-46db-b263-a77b665ec7fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:50.522229 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa133d-a3dd-46db-b263-a77b665ec7fd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:50.535496 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 550/1088] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:43:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:50.536698 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd751f0f-8ecf-4914-9cc0-c4ef4df3d6ec None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:50.590774 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:50.646625 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd751f0f-8ecf-4914-9cc0-c4ef4df3d6ec None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:50.681901 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554a1c1-c0bc-4601-8445-2a1e22a656ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:50.682546 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554a1c1-c0bc-4601-8445-2a1e22a656ef None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:50.682826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554a1c1-c0bc-4601-8445-2a1e22a656ef None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:50.683099 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554a1c1-c0bc-4601-8445-2a1e22a656ef None admin] PATH_INFO: `/v3/users/9026b6f481894e7aa3065f7ce2154c36` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:50.684294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554a1c1-c0bc-4601-8445-2a1e22a656ef None admin] RBAC: Authorizing `identity:get_user(user_id=9026b6f481894e7aa3065f7ce2154c36)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:50.685771 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554a1c1-c0bc-4601-8445-2a1e22a656ef None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:50.687372 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 539/1089] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:43:50 2022] GET /identity/v3/users/9026b6f481894e7aa3065f7ce2154c36 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:50.696815 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa133d-a3dd-46db-b263-a77b665ec7fd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:50.793292 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:50.810007 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa133d-a3dd-46db-b263-a77b665ec7fd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:50.845014 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a6b49-ca1d-47f1-97ea-c63c08befff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:50.845619 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a6b49-ca1d-47f1-97ea-c63c08befff1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:50.845895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a6b49-ca1d-47f1-97ea-c63c08befff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:50.846162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a6b49-ca1d-47f1-97ea-c63c08befff1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:50.913045 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a6b49-ca1d-47f1-97ea-c63c08befff1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:50.914673 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a6b49-ca1d-47f1-97ea-c63c08befff1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:50.998849 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:51.015103 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 551/1090] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:43:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:43:51.021008 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554a1c1-c0bc-4601-8445-2a1e22a656ef None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:51.133489 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554a1c1-c0bc-4601-8445-2a1e22a656ef None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:51.151129 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:51.173580 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb3e9d-505a-4726-94c0-8335aea77126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:51.174310 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb3e9d-505a-4726-94c0-8335aea77126 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:51.174591 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb3e9d-505a-4726-94c0-8335aea77126 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:51.174862 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb3e9d-505a-4726-94c0-8335aea77126 None admin] PATH_INFO: `/v3/projects/04a363fd7a054ecb95ae8f4f039f9f62` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:51.176005 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb3e9d-505a-4726-94c0-8335aea77126 None admin] RBAC: Authorizing `identity:get_project(project_id=04a363fd7a054ecb95ae8f4f039f9f62)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:51.177516 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb3e9d-505a-4726-94c0-8335aea77126 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:51.179156 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 540/1091] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:43:51 2022] GET /identity/v3/projects/04a363fd7a054ecb95ae8f4f039f9f62 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:51.186159 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a6b49-ca1d-47f1-97ea-c63c08befff1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:51.291779 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a6b49-ca1d-47f1-97ea-c63c08befff1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:51.330051 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ef033-c73f-40f9-a2d1-ed7cce004567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:51.330657 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ef033-c73f-40f9-a2d1-ed7cce004567 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:51.330931 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ef033-c73f-40f9-a2d1-ed7cce004567 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:51.331197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ef033-c73f-40f9-a2d1-ed7cce004567 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:51.331916 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ef033-c73f-40f9-a2d1-ed7cce004567 None admin] RBAC: Adding query filter params (role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.project.id=04a363fd7a054ecb95ae8f4f039f9f62, user.id=9026b6f481894e7aa3065f7ce2154c36) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:51.332212 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ef033-c73f-40f9-a2d1-ed7cce004567 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:51.333665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ef033-c73f-40f9-a2d1-ed7cce004567 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:51.340449 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 552/1092] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:43:51 2022] GET /identity/v3/role_assignments?user.id=9026b6f481894e7aa3065f7ce2154c36&scope.project.id=04a363fd7a054ecb95ae8f4f039f9f62&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:51.412560 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eab7a0-1243-4653-aacf-5a4982f9d75c None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:51.412671 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eab7a0-1243-4653-aacf-5a4982f9d75c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:51.412864 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eab7a0-1243-4653-aacf-5a4982f9d75c None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:51.415159 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 541/1093] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:51.420884 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7b651-9008-4541-8729-6dc646f5655f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:51.421459 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7b651-9008-4541-8729-6dc646f5655f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:51.421459 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7b651-9008-4541-8729-6dc646f5655f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:51.442118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-16a7b651-9008-4541-8729-6dc646f5655f None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:51.443597 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-16a7b651-9008-4541-8729-6dc646f5655f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:51.499454 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:51.524898 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 553/1094] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:51.793589 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eab7a0-1243-4653-aacf-5a4982f9d75c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:51.912123 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eab7a0-1243-4653-aacf-5a4982f9d75c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:51.952378 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d19bef-19f2-4adc-be92-ecbb1c7d8c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:51.953063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d19bef-19f2-4adc-be92-ecbb1c7d8c9f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:51.953345 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d19bef-19f2-4adc-be92-ecbb1c7d8c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:51.953614 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d19bef-19f2-4adc-be92-ecbb1c7d8c9f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:51.967192 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d19bef-19f2-4adc-be92-ecbb1c7d8c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:43:51.973248 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-a2d19bef-19f2-4adc-be92-ecbb1c7d8c9f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:43:51.973248 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:51.973248 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:51.973248 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:51.973248 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:51.973248 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:51.973248 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:51.973248 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:51.973248 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:51.973248 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:51.973248 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:51.973248 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:51.973248 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:43:51.973248 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:43:51.973248 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:43:51.973248 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:43:51.974562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:43:51.974562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:43:51.974562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:43:51.974562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:43:51.974562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:51.974562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:51.974562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:51.974562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:51.974562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:51.974562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:51.974562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:51.974562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:51.974562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:51.974562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:51.974562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:51.974562 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:51.975898 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:51.975898 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:51.975898 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:51.975898 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:51.975898 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:43:51.975898 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:43:51.975898 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:43:51.975898 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:43:51.975898 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:43:51.975898 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:43:51.975898 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:43:51.975898 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:51.975898 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 542/1095] 10.222.0.26 () {56 vars in 1120 bytes} [Sun Oct 2 00:43:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:51.981139 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7b651-9008-4541-8729-6dc646f5655f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:52.094824 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7b651-9008-4541-8729-6dc646f5655f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:52.132166 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115f4e6-a063-4efd-b2c9-34e67b76e739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:52.132897 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115f4e6-a063-4efd-b2c9-34e67b76e739 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:52.133609 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115f4e6-a063-4efd-b2c9-34e67b76e739 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:52.133772 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115f4e6-a063-4efd-b2c9-34e67b76e739 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:52.134459 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115f4e6-a063-4efd-b2c9-34e67b76e739 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:52.134772 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115f4e6-a063-4efd-b2c9-34e67b76e739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:52.136158 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115f4e6-a063-4efd-b2c9-34e67b76e739 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:52.145059 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 554/1096] 10.222.0.26 () {56 vars in 1115 bytes} [Sun Oct 2 00:43:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:52.151679 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d19bef-19f2-4adc-be92-ecbb1c7d8c9f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:52.204932 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:52.268795 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d19bef-19f2-4adc-be92-ecbb1c7d8c9f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:52.308367 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e75ce-9c4a-471d-b9fb-1f31942190cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:52.309031 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e75ce-9c4a-471d-b9fb-1f31942190cf None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:52.309316 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e75ce-9c4a-471d-b9fb-1f31942190cf None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:52.309586 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e75ce-9c4a-471d-b9fb-1f31942190cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:52.319874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e75ce-9c4a-471d-b9fb-1f31942190cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:52.321913 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e75ce-9c4a-471d-b9fb-1f31942190cf None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:52.337191 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-fd8e75ce-9c4a-471d-b9fb-1f31942190cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:52.337191 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:52.337191 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:52.337191 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:52.337191 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:52.337191 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:52.337191 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:52.337191 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:52.337191 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:52.337191 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:52.337191 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:52.337191 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:52.337191 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:52.337191 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:52.337191 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:52.337191 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:52.338370 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:52.338370 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:52.338370 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:52.338370 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:52.338370 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:52.338370 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:52.338370 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:52.338370 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:52.338370 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:52.338370 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:52.338370 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:52.338370 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:52.338370 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:52.338370 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:52.338370 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:52.338370 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:52.338370 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:52.339462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:52.339462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:52.339462 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:52.339462 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 543/1097] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:52.344250 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115f4e6-a063-4efd-b2c9-34e67b76e739 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:52.393209 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:52.460758 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115f4e6-a063-4efd-b2c9-34e67b76e739 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:52.497077 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310f401-1b8e-4b0e-bb78-5808bb7a2c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:52.497683 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310f401-1b8e-4b0e-bb78-5808bb7a2c81 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:52.497965 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310f401-1b8e-4b0e-bb78-5808bb7a2c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:52.498235 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310f401-1b8e-4b0e-bb78-5808bb7a2c81 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:52.498875 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310f401-1b8e-4b0e-bb78-5808bb7a2c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:52.499182 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310f401-1b8e-4b0e-bb78-5808bb7a2c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:52.500550 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310f401-1b8e-4b0e-bb78-5808bb7a2c81 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:52.513653 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 555/1098] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:52.519300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e75ce-9c4a-471d-b9fb-1f31942190cf None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:52.623679 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:52.633156 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e75ce-9c4a-471d-b9fb-1f31942190cf None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:52.677491 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef8715-5124-45b2-8500-7cffc5920b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:52.678141 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef8715-5124-45b2-8500-7cffc5920b95 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:52.678638 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef8715-5124-45b2-8500-7cffc5920b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:52.678920 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef8715-5124-45b2-8500-7cffc5920b95 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:52.689561 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef8715-5124-45b2-8500-7cffc5920b95 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:52.691026 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef8715-5124-45b2-8500-7cffc5920b95 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:52.703463 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-baef8715-5124-45b2-8500-7cffc5920b95 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:43:52.703463 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:52.703463 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:52.703463 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:52.703463 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:52.703463 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:52.703463 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:52.703463 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:52.703463 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:52.703463 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:52.703463 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:52.703463 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:52.703463 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:43:52.703463 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:43:52.703463 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:43:52.703463 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:43:52.709925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:52.709925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:52.709925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:43:52.709925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:52.709925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:43:52.709925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:43:52.709925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:52.709925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:52.709925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:52.709925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:52.709925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:52.709925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:52.709925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:52.709925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:52.709925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:52.709925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:52.709925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:52.709925 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:52.711091 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:52.711091 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:52.711091 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:43:52.711091 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:43:52.711091 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:43:52.711091 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:43:52.711091 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:43:52.711091 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:43:52.711091 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:43:52.711091 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:52.711091 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 544/1099] 10.222.0.26 () {56 vars in 1093 bytes} [Sun Oct 2 00:43:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:43:52.712151 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310f401-1b8e-4b0e-bb78-5808bb7a2c81 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:52.833833 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310f401-1b8e-4b0e-bb78-5808bb7a2c81 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:52.835469 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:52.872669 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b1a9e-e34e-423b-b5b3-5ac548e61f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:52.873313 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b1a9e-e34e-423b-b5b3-5ac548e61f57 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:52.873594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b1a9e-e34e-423b-b5b3-5ac548e61f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:52.873867 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b1a9e-e34e-423b-b5b3-5ac548e61f57 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:52.874598 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b1a9e-e34e-423b-b5b3-5ac548e61f57 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:52.874907 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b1a9e-e34e-423b-b5b3-5ac548e61f57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:52.876346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b1a9e-e34e-423b-b5b3-5ac548e61f57 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:52.894525 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 556/1100] 10.222.0.26 () {56 vars in 1133 bytes} [Sun Oct 2 00:43:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:52.902034 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef8715-5124-45b2-8500-7cffc5920b95 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:53.010195 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef8715-5124-45b2-8500-7cffc5920b95 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:53.045157 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ade09-ca69-491a-a9ce-c0e01fccddd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:53.045759 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ade09-ca69-491a-a9ce-c0e01fccddd0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:53.046036 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ade09-ca69-491a-a9ce-c0e01fccddd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:53.046303 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ade09-ca69-491a-a9ce-c0e01fccddd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:53.072789 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:53.120497 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ade09-ca69-491a-a9ce-c0e01fccddd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:53.122010 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ade09-ca69-491a-a9ce-c0e01fccddd0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:53.232967 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 545/1101] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:43:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:43:53.238934 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b1a9e-e34e-423b-b5b3-5ac548e61f57 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:53.347352 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b1a9e-e34e-423b-b5b3-5ac548e61f57 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:53.383610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f921aba-6d51-47ec-85cc-379f4aff1d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:53.384245 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f921aba-6d51-47ec-85cc-379f4aff1d51 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:53.384525 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f921aba-6d51-47ec-85cc-379f4aff1d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:53.384824 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f921aba-6d51-47ec-85cc-379f4aff1d51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:53.395786 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f921aba-6d51-47ec-85cc-379f4aff1d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:53.397292 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f921aba-6d51-47ec-85cc-379f4aff1d51 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:53.417349 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4f921aba-6d51-47ec-85cc-379f4aff1d51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:53.417349 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:53.417349 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:53.417349 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:53.417349 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:53.417349 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:53.417349 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:53.417349 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:53.417349 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:53.417349 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:53.417349 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:53.417349 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:53.417349 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:43:53.417349 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:43:53.417349 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:43:53.417349 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:43:53.418394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:53.418394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:53.418394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:53.418394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:53.418394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:53.418394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:53.418394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:53.418394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:53.418394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:53.418394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:53.418394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:53.418394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:53.418394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:53.418394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:53.418394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:53.418394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:53.418394 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:43:53.419324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:43:53.419324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:43:53.419324 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:43:53.419324 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 557/1102] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:53.424343 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ade09-ca69-491a-a9ce-c0e01fccddd0 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:53.499911 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:53.549303 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ade09-ca69-491a-a9ce-c0e01fccddd0 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:53.586725 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a28a5c-6653-42d3-bc36-0178dccffd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:53.587460 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a28a5c-6653-42d3-bc36-0178dccffd9f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:53.587737 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a28a5c-6653-42d3-bc36-0178dccffd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:53.588006 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a28a5c-6653-42d3-bc36-0178dccffd9f None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:53.588648 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a28a5c-6653-42d3-bc36-0178dccffd9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:53.588971 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a28a5c-6653-42d3-bc36-0178dccffd9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:53.590377 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a28a5c-6653-42d3-bc36-0178dccffd9f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:53.591862 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e57c5-ccea-4b5d-afed-23b8c23d6e2a None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:53.592091 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e57c5-ccea-4b5d-afed-23b8c23d6e2a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:53.592369 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e57c5-ccea-4b5d-afed-23b8c23d6e2a None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:53.593755 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 558/1103] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:43:53.599465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3436c3-154b-4a14-ba11-7df88da07a77 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:53.599678 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3436c3-154b-4a14-ba11-7df88da07a77 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:53.599951 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3436c3-154b-4a14-ba11-7df88da07a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:53.608000 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 546/1104] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:53.609270 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a28a5c-6653-42d3-bc36-0178dccffd9f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:53.621540 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1a3436c3-154b-4a14-ba11-7df88da07a77 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:53.622759 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1a3436c3-154b-4a14-ba11-7df88da07a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:53.631421 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:53.695945 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 559/1105] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:43:53.721032 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a28a5c-6653-42d3-bc36-0178dccffd9f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:53.737574 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:53.759194 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89dc041-41b9-4f38-b42e-f0aeb2dd1282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:53.759826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dc041-41b9-4f38-b42e-f0aeb2dd1282 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:53.760094 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dc041-41b9-4f38-b42e-f0aeb2dd1282 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:53.760360 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dc041-41b9-4f38-b42e-f0aeb2dd1282 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:53.767613 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89dc041-41b9-4f38-b42e-f0aeb2dd1282 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:53.769101 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89dc041-41b9-4f38-b42e-f0aeb2dd1282 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:53.781926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-a89dc041-41b9-4f38-b42e-f0aeb2dd1282 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:53.781926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:43:53.781926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:43:53.781926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:43:53.781926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:43:53.781926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:43:53.781926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:43:53.781926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:43:53.781926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:43:53.781926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:43:53.781926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:43:53.781926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:43:53.781926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:43:53.781926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:43:53.781926 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:43:53.783323 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:43:53.783323 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:43:53.783323 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:43:53.783323 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:43:53.783323 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:43:53.783323 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:43:53.783323 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:43:53.783323 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:43:53.783323 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:43:53.783323 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:43:53.783323 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:43:53.783323 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:43:53.783323 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:43:53.783323 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:43:53.783323 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:43:53.783323 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:43:53.783323 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:43:53.784628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:43:53.784628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:43:53.784628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:43:53.784628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:43:53.784628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:43:53.784628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:43:53.784628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:43:53.784628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:43:53.784628 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 547/1106] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:43:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:43:53.789844 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3436c3-154b-4a14-ba11-7df88da07a77 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:53.895148 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3436c3-154b-4a14-ba11-7df88da07a77 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:53.931786 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113d480-1c16-4a6d-8dda-453954b7f4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:53.932610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113d480-1c16-4a6d-8dda-453954b7f4ee None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:53.932897 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113d480-1c16-4a6d-8dda-453954b7f4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:53.933207 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113d480-1c16-4a6d-8dda-453954b7f4ee None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:53.934141 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113d480-1c16-4a6d-8dda-453954b7f4ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:53.934453 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113d480-1c16-4a6d-8dda-453954b7f4ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:53.936098 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113d480-1c16-4a6d-8dda-453954b7f4ee None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:53.948925 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 560/1107] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:43:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:53.955528 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89dc041-41b9-4f38-b42e-f0aeb2dd1282 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:53.968200 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113d480-1c16-4a6d-8dda-453954b7f4ee None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:53.971137 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:54.075935 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89dc041-41b9-4f38-b42e-f0aeb2dd1282 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:54.082712 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113d480-1c16-4a6d-8dda-453954b7f4ee None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:54.116603 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e97848-5e19-406c-bd5c-ef7a5094080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:54.117639 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e97848-5e19-406c-bd5c-ef7a5094080a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:54.118074 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e97848-5e19-406c-bd5c-ef7a5094080a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:54.118754 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e97848-5e19-406c-bd5c-ef7a5094080a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:54.120402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e97848-5e19-406c-bd5c-ef7a5094080a None admin] RBAC: Adding query filter params (role.id=64c56800e24e42a496f2aba027c62ab0, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=81e0396b7ba341ce8d02b1a149786d95) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:54.120819 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e97848-5e19-406c-bd5c-ef7a5094080a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:54.123025 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e97848-5e19-406c-bd5c-ef7a5094080a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:54.125022 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecccbf-df83-4486-8f62-ea4aa368dd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:54.125590 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecccbf-df83-4486-8f62-ea4aa368dd89 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:54.125872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecccbf-df83-4486-8f62-ea4aa368dd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:54.126153 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecccbf-df83-4486-8f62-ea4aa368dd89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:54.127294 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecccbf-df83-4486-8f62-ea4aa368dd89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:54.128739 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecccbf-df83-4486-8f62-ea4aa368dd89 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:54.129496 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 548/1108] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:43:53 2022] GET /identity/v3/role_assignments?user.id=81e0396b7ba341ce8d02b1a149786d95&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=64c56800e24e42a496f2aba027c62ab0 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:54.133281 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 561/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:43:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:43:54.136851 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e97848-5e19-406c-bd5c-ef7a5094080a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:54.185201 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:54.258954 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e97848-5e19-406c-bd5c-ef7a5094080a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:54.299467 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce508b-4545-4871-9962-d0464846b099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:54.300093 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce508b-4545-4871-9962-d0464846b099 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:54.300375 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce508b-4545-4871-9962-d0464846b099 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:54.300645 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce508b-4545-4871-9962-d0464846b099 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:54.301352 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce508b-4545-4871-9962-d0464846b099 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:54.302841 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce508b-4545-4871-9962-d0464846b099 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:54.327611 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 549/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Oct 2 00:43:54 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:43:56.657664 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab181a8-772a-45fa-aafb-6ab1cf824fd3 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:56.658209 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab181a8-772a-45fa-aafb-6ab1cf824fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:56.658209 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab181a8-772a-45fa-aafb-6ab1cf824fd3 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:56.659599 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 562/1111] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:43:56.665036 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760d508-0e0d-4ec9-920f-df34469e7d1b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:56.665491 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760d508-0e0d-4ec9-920f-df34469e7d1b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:56.665585 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760d508-0e0d-4ec9-920f-df34469e7d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:56.685427 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-c760d508-0e0d-4ec9-920f-df34469e7d1b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:43:56.686647 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c760d508-0e0d-4ec9-920f-df34469e7d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:43:56.752958 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 550/1112] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:43:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:43:57.023092 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab181a8-772a-45fa-aafb-6ab1cf824fd3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:57.093806 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:57.127702 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab181a8-772a-45fa-aafb-6ab1cf824fd3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:57.160725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843e832-7552-4b39-bba8-fe722b4df365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:57.161370 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843e832-7552-4b39-bba8-fe722b4df365 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:57.161648 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843e832-7552-4b39-bba8-fe722b4df365 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:57.161915 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843e832-7552-4b39-bba8-fe722b4df365 None admin] PATH_INFO: `/v3/roles/030fcd169fb44f759772ef3101c07012` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:57.163286 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843e832-7552-4b39-bba8-fe722b4df365 None admin] RBAC: Authorizing `identity:get_role(role_id=030fcd169fb44f759772ef3101c07012)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:57.165519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843e832-7552-4b39-bba8-fe722b4df365 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:57.166804 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 563/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:43:57 2022] GET /identity/v3/roles/030fcd169fb44f759772ef3101c07012 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:57.172671 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760d508-0e0d-4ec9-920f-df34469e7d1b None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:57.198282 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:57.276239 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760d508-0e0d-4ec9-920f-df34469e7d1b None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:57.309394 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707d51d-5422-4a79-974d-280059c99eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:57.310015 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707d51d-5422-4a79-974d-280059c99eda None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:57.310295 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707d51d-5422-4a79-974d-280059c99eda None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:57.310569 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707d51d-5422-4a79-974d-280059c99eda None admin] PATH_INFO: `/v3/users/ac86540fb5704de1ba171fe81351b679` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:57.323482 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707d51d-5422-4a79-974d-280059c99eda None admin] RBAC: Authorizing `identity:get_user(user_id=ac86540fb5704de1ba171fe81351b679)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:57.324922 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707d51d-5422-4a79-974d-280059c99eda None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:57.326552 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 551/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:43:57 2022] GET /identity/v3/users/ac86540fb5704de1ba171fe81351b679 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:57.332508 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843e832-7552-4b39-bba8-fe722b4df365 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:57.432854 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843e832-7552-4b39-bba8-fe722b4df365 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:57.468357 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c24d7-16b1-4dd8-a9e6-e2f0e417da54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:57.468974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c24d7-16b1-4dd8-a9e6-e2f0e417da54 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:57.469271 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c24d7-16b1-4dd8-a9e6-e2f0e417da54 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:57.469529 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c24d7-16b1-4dd8-a9e6-e2f0e417da54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:57.478890 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:57.537452 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c24d7-16b1-4dd8-a9e6-e2f0e417da54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:57.538899 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c24d7-16b1-4dd8-a9e6-e2f0e417da54 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:57.634069 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 564/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:43:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:43:57.640360 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707d51d-5422-4a79-974d-280059c99eda None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:57.722471 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:57.740831 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707d51d-5422-4a79-974d-280059c99eda None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:57.775845 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df11aea-290f-45e2-b166-ffa708129850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:57.776470 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df11aea-290f-45e2-b166-ffa708129850 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:57.776748 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df11aea-290f-45e2-b166-ffa708129850 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:57.777058 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df11aea-290f-45e2-b166-ffa708129850 None admin] PATH_INFO: `/v3/projects/04a363fd7a054ecb95ae8f4f039f9f62` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:57.778154 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df11aea-290f-45e2-b166-ffa708129850 None admin] RBAC: Authorizing `identity:get_project(project_id=04a363fd7a054ecb95ae8f4f039f9f62)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:57.779588 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df11aea-290f-45e2-b166-ffa708129850 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:57.781246 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 552/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:43:57 2022] GET /identity/v3/projects/04a363fd7a054ecb95ae8f4f039f9f62 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:43:57.787562 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c24d7-16b1-4dd8-a9e6-e2f0e417da54 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:43:57.827434 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:43:57.891984 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c24d7-16b1-4dd8-a9e6-e2f0e417da54 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:43:57.925935 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dcc0c-c3ad-4dbe-9f6a-efc75ca75705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:43:57.926528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dcc0c-c3ad-4dbe-9f6a-efc75ca75705 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:57.926811 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dcc0c-c3ad-4dbe-9f6a-efc75ca75705 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:57.927081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dcc0c-c3ad-4dbe-9f6a-efc75ca75705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:57.927792 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016dcc0c-c3ad-4dbe-9f6a-efc75ca75705 None admin] RBAC: Adding query filter params (role.id=030fcd169fb44f759772ef3101c07012, scope.project.id=04a363fd7a054ecb95ae8f4f039f9f62, user.id=ac86540fb5704de1ba171fe81351b679) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:43:57.928097 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016dcc0c-c3ad-4dbe-9f6a-efc75ca75705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:43:57.930249 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016dcc0c-c3ad-4dbe-9f6a-efc75ca75705 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:43:57.935903 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 565/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:43:57 2022] GET /identity/v3/role_assignments?user.id=ac86540fb5704de1ba171fe81351b679&scope.project.id=04a363fd7a054ecb95ae8f4f039f9f62&role.id=030fcd169fb44f759772ef3101c07012 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:00.102666 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935626f-4118-4ea3-99a3-0eed3f6883a6 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:00.103227 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935626f-4118-4ea3-99a3-0eed3f6883a6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:00.103227 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935626f-4118-4ea3-99a3-0eed3f6883a6 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:00.104548 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 553/1118] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:00.109823 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fd490-ac02-44b3-8ac9-084db46f6252 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:00.110252 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fd490-ac02-44b3-8ac9-084db46f6252 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:00.110403 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fd490-ac02-44b3-8ac9-084db46f6252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:00.128249 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c05fd490-ac02-44b3-8ac9-084db46f6252 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:00.129454 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c05fd490-ac02-44b3-8ac9-084db46f6252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:00.193514 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 566/1119] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:44:00.466413 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935626f-4118-4ea3-99a3-0eed3f6883a6 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:00.569011 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935626f-4118-4ea3-99a3-0eed3f6883a6 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:00.603116 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d13dde-c880-4ff3-a74e-500aefcce474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:00.603732 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d13dde-c880-4ff3-a74e-500aefcce474 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:00.604011 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d13dde-c880-4ff3-a74e-500aefcce474 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:00.604280 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d13dde-c880-4ff3-a74e-500aefcce474 None admin] PATH_INFO: `/v3/roles/030fcd169fb44f759772ef3101c07012` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:00.605659 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d13dde-c880-4ff3-a74e-500aefcce474 None admin] RBAC: Authorizing `identity:get_role(role_id=030fcd169fb44f759772ef3101c07012)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:00.607032 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d13dde-c880-4ff3-a74e-500aefcce474 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:00.608341 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 554/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:00 2022] GET /identity/v3/roles/030fcd169fb44f759772ef3101c07012 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:00.614243 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fd490-ac02-44b3-8ac9-084db46f6252 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:00.645323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:00.716055 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fd490-ac02-44b3-8ac9-084db46f6252 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:00.750922 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285331a-acf7-4a2c-9d39-91cc5b671375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:00.751545 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285331a-acf7-4a2c-9d39-91cc5b671375 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:00.751825 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285331a-acf7-4a2c-9d39-91cc5b671375 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:00.752098 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285331a-acf7-4a2c-9d39-91cc5b671375 None admin] PATH_INFO: `/v3/users/ac86540fb5704de1ba171fe81351b679` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:00.753234 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285331a-acf7-4a2c-9d39-91cc5b671375 None admin] RBAC: Authorizing `identity:get_user(user_id=ac86540fb5704de1ba171fe81351b679)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:00.754668 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285331a-acf7-4a2c-9d39-91cc5b671375 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:00.756247 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 567/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:00 2022] GET /identity/v3/users/ac86540fb5704de1ba171fe81351b679 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:00.762827 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d13dde-c880-4ff3-a74e-500aefcce474 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:00.783381 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:00.867430 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d13dde-c880-4ff3-a74e-500aefcce474 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:00.902145 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b5780-2a53-4aed-ad5e-db75a2009b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:00.902770 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b5780-2a53-4aed-ad5e-db75a2009b8b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:00.903053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b5780-2a53-4aed-ad5e-db75a2009b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:00.903334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b5780-2a53-4aed-ad5e-db75a2009b8b None admin] PATH_INFO: `/v3/projects/04a363fd7a054ecb95ae8f4f039f9f62` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:00.904440 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b5780-2a53-4aed-ad5e-db75a2009b8b None admin] RBAC: Authorizing `identity:get_project(project_id=04a363fd7a054ecb95ae8f4f039f9f62)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:00.905887 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b5780-2a53-4aed-ad5e-db75a2009b8b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:00.907519 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 555/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:00 2022] GET /identity/v3/projects/04a363fd7a054ecb95ae8f4f039f9f62 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:00.913669 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285331a-acf7-4a2c-9d39-91cc5b671375 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:01.006317 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:01.010519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285331a-acf7-4a2c-9d39-91cc5b671375 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:01.044770 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1db2ad-41f5-43a9-98e3-f03376605c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:01.045443 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1db2ad-41f5-43a9-98e3-f03376605c5e None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:01.045726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1db2ad-41f5-43a9-98e3-f03376605c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:01.045999 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1db2ad-41f5-43a9-98e3-f03376605c5e None admin] PATH_INFO: `/v3/projects/04a363fd7a054ecb95ae8f4f039f9f62/users/ac86540fb5704de1ba171fe81351b679/roles/030fcd169fb44f759772ef3101c07012` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:01.048134 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1db2ad-41f5-43a9-98e3-f03376605c5e None admin] RBAC: Authorizing `identity:create_grant(project_id=04a363fd7a054ecb95ae8f4f039f9f62, user_id=ac86540fb5704de1ba171fe81351b679, role_id=030fcd169fb44f759772ef3101c07012)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:01.049630 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1db2ad-41f5-43a9-98e3-f03376605c5e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:01.063977 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 568/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:44:00 2022] PUT /identity/v3/projects/04a363fd7a054ecb95ae8f4f039f9f62/users/ac86540fb5704de1ba171fe81351b679/roles/030fcd169fb44f759772ef3101c07012 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:44:03.245429 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3e51e-09da-40a5-b020-f32134f2e9b3 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:03.245968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3e51e-09da-40a5-b020-f32134f2e9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:03.245968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3e51e-09da-40a5-b020-f32134f2e9b3 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:03.247298 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 556/1124] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:03.252731 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267f4e3-0f0b-41d3-ad0d-316b1b05902d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:03.253195 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267f4e3-0f0b-41d3-ad0d-316b1b05902d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:03.253288 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267f4e3-0f0b-41d3-ad0d-316b1b05902d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:03.271905 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9267f4e3-0f0b-41d3-ad0d-316b1b05902d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:03.274146 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9267f4e3-0f0b-41d3-ad0d-316b1b05902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:03.345367 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 569/1125] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:44:03.624601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3e51e-09da-40a5-b020-f32134f2e9b3 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:03.723538 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:03.740204 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3e51e-09da-40a5-b020-f32134f2e9b3 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:03.774549 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff0761-f099-4bed-ada9-8624f4b9c7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:03.775178 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff0761-f099-4bed-ada9-8624f4b9c7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:03.775458 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff0761-f099-4bed-ada9-8624f4b9c7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:03.775731 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff0761-f099-4bed-ada9-8624f4b9c7b7 None admin] PATH_INFO: `/v3/roles/030fcd169fb44f759772ef3101c07012` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:03.777147 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff0761-f099-4bed-ada9-8624f4b9c7b7 None admin] RBAC: Authorizing `identity:get_role(role_id=030fcd169fb44f759772ef3101c07012)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:03.778528 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff0761-f099-4bed-ada9-8624f4b9c7b7 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:03.779845 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 557/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:03 2022] GET /identity/v3/roles/030fcd169fb44f759772ef3101c07012 => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:03.785874 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267f4e3-0f0b-41d3-ad0d-316b1b05902d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:03.874718 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:03.886798 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267f4e3-0f0b-41d3-ad0d-316b1b05902d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:03.920679 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbd296-de68-4e92-88c5-9fb607bdd821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:03.921322 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbd296-de68-4e92-88c5-9fb607bdd821 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:03.921600 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbd296-de68-4e92-88c5-9fb607bdd821 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:03.921869 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbd296-de68-4e92-88c5-9fb607bdd821 None admin] PATH_INFO: `/v3/users/ac86540fb5704de1ba171fe81351b679` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:03.922961 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbd296-de68-4e92-88c5-9fb607bdd821 None admin] RBAC: Authorizing `identity:get_user(user_id=ac86540fb5704de1ba171fe81351b679)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:03.924399 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbd296-de68-4e92-88c5-9fb607bdd821 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:03.925994 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 570/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:03 2022] GET /identity/v3/users/ac86540fb5704de1ba171fe81351b679 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:03.931975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff0761-f099-4bed-ada9-8624f4b9c7b7 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:04.034026 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff0761-f099-4bed-ada9-8624f4b9c7b7 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:04.067726 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5350a-e2da-4777-bfcb-8573e738baea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:04.068324 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5350a-e2da-4777-bfcb-8573e738baea None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:04.068603 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5350a-e2da-4777-bfcb-8573e738baea None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:04.068872 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5350a-e2da-4777-bfcb-8573e738baea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:04.097173 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:04.146333 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5350a-e2da-4777-bfcb-8573e738baea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:04.147697 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5350a-e2da-4777-bfcb-8573e738baea None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:04.251852 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 558/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:44:04.258202 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbd296-de68-4e92-88c5-9fb607bdd821 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:04.358458 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbd296-de68-4e92-88c5-9fb607bdd821 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:04.392544 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c06a7-3d61-45a7-9c4e-294f21726d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:04.393198 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c06a7-3d61-45a7-9c4e-294f21726d84 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:04.393479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c06a7-3d61-45a7-9c4e-294f21726d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:04.393752 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c06a7-3d61-45a7-9c4e-294f21726d84 None admin] PATH_INFO: `/v3/projects/04a363fd7a054ecb95ae8f4f039f9f62` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:04.394852 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c06a7-3d61-45a7-9c4e-294f21726d84 None admin] RBAC: Authorizing `identity:get_project(project_id=04a363fd7a054ecb95ae8f4f039f9f62)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:04.396276 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c06a7-3d61-45a7-9c4e-294f21726d84 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:04.398457 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 571/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:04 2022] GET /identity/v3/projects/04a363fd7a054ecb95ae8f4f039f9f62 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:04.405034 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5350a-e2da-4777-bfcb-8573e738baea None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:04.465005 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:04.511502 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5350a-e2da-4777-bfcb-8573e738baea None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:04.546462 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6b66e-d61f-41b1-ac53-79e54fba1741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:04.547063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6b66e-d61f-41b1-ac53-79e54fba1741 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:04.547342 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6b66e-d61f-41b1-ac53-79e54fba1741 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:04.547615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6b66e-d61f-41b1-ac53-79e54fba1741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:04.548333 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6b66e-d61f-41b1-ac53-79e54fba1741 None admin] RBAC: Adding query filter params (role.id=030fcd169fb44f759772ef3101c07012, scope.project.id=04a363fd7a054ecb95ae8f4f039f9f62, user.id=ac86540fb5704de1ba171fe81351b679) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:04.548639 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6b66e-d61f-41b1-ac53-79e54fba1741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:04.550102 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6b66e-d61f-41b1-ac53-79e54fba1741 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:04.556860 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 559/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:04 2022] GET /identity/v3/role_assignments?user.id=ac86540fb5704de1ba171fe81351b679&scope.project.id=04a363fd7a054ecb95ae8f4f039f9f62&role.id=030fcd169fb44f759772ef3101c07012 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:06.898282 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a66fef-ce1b-4fca-8d53-b852392b4a62 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:06.898797 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a66fef-ce1b-4fca-8d53-b852392b4a62 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:06.898797 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a66fef-ce1b-4fca-8d53-b852392b4a62 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:06.900131 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 572/1131] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:06.905381 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be9137-0054-4a76-9450-8bba36b04816 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:06.905771 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be9137-0054-4a76-9450-8bba36b04816 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:06.905944 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be9137-0054-4a76-9450-8bba36b04816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:06.925059 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-19be9137-0054-4a76-9450-8bba36b04816 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:06.926251 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-19be9137-0054-4a76-9450-8bba36b04816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:06.994863 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 560/1132] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:44:07.270440 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a66fef-ce1b-4fca-8d53-b852392b4a62 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:07.298740 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:07.373900 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a66fef-ce1b-4fca-8d53-b852392b4a62 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:07.414778 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ed14e-5ed4-4d30-ad51-5fc7941ad999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:07.415443 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ed14e-5ed4-4d30-ad51-5fc7941ad999 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:07.415725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ed14e-5ed4-4d30-ad51-5fc7941ad999 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:07.416004 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ed14e-5ed4-4d30-ad51-5fc7941ad999 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:07.417152 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ed14e-5ed4-4d30-ad51-5fc7941ad999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:07.418600 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ed14e-5ed4-4d30-ad51-5fc7941ad999 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:07.420166 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 573/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:07.426198 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be9137-0054-4a76-9450-8bba36b04816 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:07.475592 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:07.529319 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be9137-0054-4a76-9450-8bba36b04816 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:07.563961 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdb311-0998-47f2-a6ad-318f7b98c4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:07.564564 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdb311-0998-47f2-a6ad-318f7b98c4ac None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:07.564844 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdb311-0998-47f2-a6ad-318f7b98c4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:07.565304 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdb311-0998-47f2-a6ad-318f7b98c4ac None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:07.565960 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdb311-0998-47f2-a6ad-318f7b98c4ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:07.567498 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdb311-0998-47f2-a6ad-318f7b98c4ac None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:07.595286 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 561/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Oct 2 00:44:07 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:44:09.808396 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd46531-2a48-4d94-a337-307288dc7a8c None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:09.808976 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd46531-2a48-4d94-a337-307288dc7a8c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:09.808976 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd46531-2a48-4d94-a337-307288dc7a8c None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:09.810221 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 574/1135] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:09.815569 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f11012-b712-435c-b881-50f529c0d6e9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:09.816001 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f11012-b712-435c-b881-50f529c0d6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:09.816103 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f11012-b712-435c-b881-50f529c0d6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:09.834431 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-45f11012-b712-435c-b881-50f529c0d6e9 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:09.836180 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-45f11012-b712-435c-b881-50f529c0d6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:09.902800 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 562/1136] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:44:10.178869 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd46531-2a48-4d94-a337-307288dc7a8c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:10.270429 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:10.278777 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd46531-2a48-4d94-a337-307288dc7a8c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:10.312723 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dd3c4-d728-435c-bb92-90d540624f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:10.313372 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dd3c4-d728-435c-bb92-90d540624f0c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:10.313652 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dd3c4-d728-435c-bb92-90d540624f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:10.313926 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dd3c4-d728-435c-bb92-90d540624f0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:10.315132 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dd3c4-d728-435c-bb92-90d540624f0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:10.316585 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dd3c4-d728-435c-bb92-90d540624f0c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:10.318209 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 575/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:10.324104 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f11012-b712-435c-b881-50f529c0d6e9 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:10.353682 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:10.426719 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f11012-b712-435c-b881-50f529c0d6e9 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:10.461709 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86d8e3-ada0-4c05-b8da-fe502dc71f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:10.462223 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d8e3-ada0-4c05-b8da-fe502dc71f20 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:10.462497 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d8e3-ada0-4c05-b8da-fe502dc71f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:10.462764 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d8e3-ada0-4c05-b8da-fe502dc71f20 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:10.463416 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86d8e3-ada0-4c05-b8da-fe502dc71f20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:10.464844 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86d8e3-ada0-4c05-b8da-fe502dc71f20 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:10.486220 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 563/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Oct 2 00:44:10 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:44:12.724495 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb99ce3-ad5a-45c8-9d9c-4cd06029cdb7 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:12.725048 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb99ce3-ad5a-45c8-9d9c-4cd06029cdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:12.725048 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb99ce3-ad5a-45c8-9d9c-4cd06029cdb7 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:12.726833 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 576/1139] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:12.732264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e48c0-51b2-46c6-a9bc-0a188a74307b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:12.732705 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e48c0-51b2-46c6-a9bc-0a188a74307b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:12.732810 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e48c0-51b2-46c6-a9bc-0a188a74307b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:12.750801 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-280e48c0-51b2-46c6-a9bc-0a188a74307b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:12.752000 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-280e48c0-51b2-46c6-a9bc-0a188a74307b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:12.817956 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 564/1140] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:44:13.092987 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb99ce3-ad5a-45c8-9d9c-4cd06029cdb7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:13.190128 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb99ce3-ad5a-45c8-9d9c-4cd06029cdb7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:13.223731 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09369c62-26ae-4167-a1c0-69f8e499f503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:13.224347 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09369c62-26ae-4167-a1c0-69f8e499f503 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:13.224618 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09369c62-26ae-4167-a1c0-69f8e499f503 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:13.224883 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09369c62-26ae-4167-a1c0-69f8e499f503 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:13.234703 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09369c62-26ae-4167-a1c0-69f8e499f503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:13.239473 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-09369c62-26ae-4167-a1c0-69f8e499f503 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:13.239473 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:13.239473 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:13.239473 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:13.239473 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:13.239473 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:13.239473 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:13.239473 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:13.239473 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:13.239473 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:13.239473 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:13.239473 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:13.239473 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:13.239473 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:13.239473 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:13.239473 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:13.240662 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:13.240662 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:13.240662 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:13.240662 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:13.240662 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:13.240662 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:13.240662 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:13.240662 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:13.240662 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:13.240662 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:13.240662 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:13.240662 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:13.240662 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:13.240662 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:13.240662 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:13.240662 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:13.242420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:13.242420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:13.242420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:13.242420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:13.242420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:13.242420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:13.242420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:13.242420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:13.242420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:13.242420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:13.242420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:13.242420 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:44:13.242420 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 577/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:44:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:13.247206 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e48c0-51b2-46c6-a9bc-0a188a74307b None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:13.265328 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:13.347968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e48c0-51b2-46c6-a9bc-0a188a74307b None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:13.383306 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd88b5-88db-45b4-a343-3693ff2d8c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:13.383909 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd88b5-88db-45b4-a343-3693ff2d8c33 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:13.384192 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd88b5-88db-45b4-a343-3693ff2d8c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:13.384467 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd88b5-88db-45b4-a343-3693ff2d8c33 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:13.385167 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd88b5-88db-45b4-a343-3693ff2d8c33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:13.385473 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd88b5-88db-45b4-a343-3693ff2d8c33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:13.386850 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd88b5-88db-45b4-a343-3693ff2d8c33 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:13.395229 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 565/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:13.401877 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09369c62-26ae-4167-a1c0-69f8e499f503 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:13.427292 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:13.503978 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09369c62-26ae-4167-a1c0-69f8e499f503 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:13.538485 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e325b7-a6e2-4b9c-bf48-8b9f00345580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:13.539120 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e325b7-a6e2-4b9c-bf48-8b9f00345580 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:13.539404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e325b7-a6e2-4b9c-bf48-8b9f00345580 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:13.539682 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e325b7-a6e2-4b9c-bf48-8b9f00345580 None admin] PATH_INFO: `/v3/users/2e2797705a564882a056e879734a8f8c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:13.552704 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e325b7-a6e2-4b9c-bf48-8b9f00345580 None admin] RBAC: Authorizing `identity:get_user(user_id=2e2797705a564882a056e879734a8f8c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:13.554352 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e325b7-a6e2-4b9c-bf48-8b9f00345580 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:13.555965 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 578/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:13 2022] GET /identity/v3/users/2e2797705a564882a056e879734a8f8c => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:13.561874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd88b5-88db-45b4-a343-3693ff2d8c33 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:13.640920 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:13.662439 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd88b5-88db-45b4-a343-3693ff2d8c33 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:13.697245 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09fd96-ae13-42b4-b825-9c2b6afbbce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:13.697865 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09fd96-ae13-42b4-b825-9c2b6afbbce4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:13.698144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09fd96-ae13-42b4-b825-9c2b6afbbce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:13.698418 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09fd96-ae13-42b4-b825-9c2b6afbbce4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:13.768588 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09fd96-ae13-42b4-b825-9c2b6afbbce4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:13.770083 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09fd96-ae13-42b4-b825-9c2b6afbbce4 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:13.847884 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:13.871946 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 566/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:44:13.877950 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e325b7-a6e2-4b9c-bf48-8b9f00345580 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:13.956767 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:13.976150 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e325b7-a6e2-4b9c-bf48-8b9f00345580 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:14.009162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6d398-1ce8-4fd4-a3a9-61d303468e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:14.009773 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6d398-1ce8-4fd4-a3a9-61d303468e7c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:14.010049 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6d398-1ce8-4fd4-a3a9-61d303468e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:14.010315 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6d398-1ce8-4fd4-a3a9-61d303468e7c None admin] PATH_INFO: `/v3/projects/4a1f4f4d4b8b48d5bb3c7b0dbf054c43` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:14.011399 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6d398-1ce8-4fd4-a3a9-61d303468e7c None admin] RBAC: Authorizing `identity:get_project(project_id=4a1f4f4d4b8b48d5bb3c7b0dbf054c43)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:14.013110 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6d398-1ce8-4fd4-a3a9-61d303468e7c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:14.014709 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 579/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:13 2022] GET /identity/v3/projects/4a1f4f4d4b8b48d5bb3c7b0dbf054c43 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:14.020922 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09fd96-ae13-42b4-b825-9c2b6afbbce4 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:14.120264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09fd96-ae13-42b4-b825-9c2b6afbbce4 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:14.159798 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ed12c-af12-47ab-a834-f8e2b113618f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:14.160398 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ed12c-af12-47ab-a834-f8e2b113618f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:14.160678 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ed12c-af12-47ab-a834-f8e2b113618f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:14.160973 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ed12c-af12-47ab-a834-f8e2b113618f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:14.161862 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ed12c-af12-47ab-a834-f8e2b113618f None admin] RBAC: Adding query filter params (role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.project.id=4a1f4f4d4b8b48d5bb3c7b0dbf054c43, user.id=2e2797705a564882a056e879734a8f8c) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:14.162285 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ed12c-af12-47ab-a834-f8e2b113618f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:14.164264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ed12c-af12-47ab-a834-f8e2b113618f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:14.169727 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 567/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:14 2022] GET /identity/v3/role_assignments?user.id=2e2797705a564882a056e879734a8f8c&scope.project.id=4a1f4f4d4b8b48d5bb3c7b0dbf054c43&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:16.348133 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07d874-5700-45b7-a160-3ff7a1705dee None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:16.348665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07d874-5700-45b7-a160-3ff7a1705dee None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:16.348665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07d874-5700-45b7-a160-3ff7a1705dee None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:16.350018 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 580/1147] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:16.356237 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e0a7f-b16b-4471-af60-ac3a67982d12 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:16.356717 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e0a7f-b16b-4471-af60-ac3a67982d12 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:16.356895 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e0a7f-b16b-4471-af60-ac3a67982d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:16.375489 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-1b4e0a7f-b16b-4471-af60-ac3a67982d12 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:16.376666 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1b4e0a7f-b16b-4471-af60-ac3a67982d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:16.412210 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:16.443912 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 568/1148] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:44:16.714046 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07d874-5700-45b7-a160-3ff7a1705dee None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:16.816076 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07d874-5700-45b7-a160-3ff7a1705dee None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:16.850988 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a06b9-a665-46db-8194-271fd8dc8e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:16.851623 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a06b9-a665-46db-8194-271fd8dc8e96 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:16.851895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a06b9-a665-46db-8194-271fd8dc8e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:16.852168 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a06b9-a665-46db-8194-271fd8dc8e96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:16.861994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a06b9-a665-46db-8194-271fd8dc8e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:16.867077 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-111a06b9-a665-46db-8194-271fd8dc8e96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:16.867077 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:16.867077 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:16.867077 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:16.867077 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:16.867077 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:16.867077 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:16.867077 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:16.867077 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:16.867077 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:16.867077 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:16.867077 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:16.867077 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:16.867077 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:16.867077 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:16.867077 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:16.868514 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:16.868514 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:16.868514 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:16.868514 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:16.868514 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:16.868514 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:16.868514 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:16.868514 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:16.868514 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:16.868514 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:16.868514 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:16.868514 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:16.868514 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:16.868514 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:16.868514 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:16.868514 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:16.869846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:16.869846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:16.869846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:16.869846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:16.869846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:16.869846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:16.869846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:16.869846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:16.869846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:16.869846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:16.869846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:16.869846 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:44:16.869846 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 581/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:44:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:16.875153 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e0a7f-b16b-4471-af60-ac3a67982d12 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:16.975680 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e0a7f-b16b-4471-af60-ac3a67982d12 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:17.010056 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca74ff-4f48-4de2-9c1d-de9e588c4390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:17.010657 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca74ff-4f48-4de2-9c1d-de9e588c4390 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:17.010935 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca74ff-4f48-4de2-9c1d-de9e588c4390 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:17.011204 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca74ff-4f48-4de2-9c1d-de9e588c4390 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:17.011857 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca74ff-4f48-4de2-9c1d-de9e588c4390 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:17.012409 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca74ff-4f48-4de2-9c1d-de9e588c4390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:17.013796 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca74ff-4f48-4de2-9c1d-de9e588c4390 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:17.021717 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 569/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:17.027585 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a06b9-a665-46db-8194-271fd8dc8e96 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:17.039030 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:17.130151 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a06b9-a665-46db-8194-271fd8dc8e96 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:17.168572 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a5996-cd5d-45f1-b441-ed2aa84db455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:17.169234 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a5996-cd5d-45f1-b441-ed2aa84db455 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:17.169514 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a5996-cd5d-45f1-b441-ed2aa84db455 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:17.169785 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a5996-cd5d-45f1-b441-ed2aa84db455 None admin] PATH_INFO: `/v3/users/2e2797705a564882a056e879734a8f8c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:17.170954 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a5996-cd5d-45f1-b441-ed2aa84db455 None admin] RBAC: Authorizing `identity:get_user(user_id=2e2797705a564882a056e879734a8f8c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:17.172393 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a5996-cd5d-45f1-b441-ed2aa84db455 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:17.174017 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 582/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:17 2022] GET /identity/v3/users/2e2797705a564882a056e879734a8f8c => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:17.180890 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca74ff-4f48-4de2-9c1d-de9e588c4390 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:17.216198 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:17.286544 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca74ff-4f48-4de2-9c1d-de9e588c4390 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:17.321242 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09e35f-237b-4194-b0fc-cd85abc95286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:17.321875 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09e35f-237b-4194-b0fc-cd85abc95286 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:17.322153 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09e35f-237b-4194-b0fc-cd85abc95286 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:17.322452 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09e35f-237b-4194-b0fc-cd85abc95286 None admin] PATH_INFO: `/v3/projects/4a1f4f4d4b8b48d5bb3c7b0dbf054c43` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:17.323566 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09e35f-237b-4194-b0fc-cd85abc95286 None admin] RBAC: Authorizing `identity:get_project(project_id=4a1f4f4d4b8b48d5bb3c7b0dbf054c43)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:17.325038 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09e35f-237b-4194-b0fc-cd85abc95286 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:17.326669 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 570/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:17 2022] GET /identity/v3/projects/4a1f4f4d4b8b48d5bb3c7b0dbf054c43 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:17.332692 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a5996-cd5d-45f1-b441-ed2aa84db455 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:17.414427 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:17.438566 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a5996-cd5d-45f1-b441-ed2aa84db455 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:17.473330 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b29c3-04b5-4c02-be46-71e80a8a841d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:17.473986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b29c3-04b5-4c02-be46-71e80a8a841d None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:17.474265 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b29c3-04b5-4c02-be46-71e80a8a841d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:17.474532 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b29c3-04b5-4c02-be46-71e80a8a841d None admin] PATH_INFO: `/v3/projects/4a1f4f4d4b8b48d5bb3c7b0dbf054c43/users/2e2797705a564882a056e879734a8f8c/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:17.477175 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b29c3-04b5-4c02-be46-71e80a8a841d None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1f4f4d4b8b48d5bb3c7b0dbf054c43, user_id=2e2797705a564882a056e879734a8f8c, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:17.478735 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b29c3-04b5-4c02-be46-71e80a8a841d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:17.492811 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 583/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:44:17 2022] PUT /identity/v3/projects/4a1f4f4d4b8b48d5bb3c7b0dbf054c43/users/2e2797705a564882a056e879734a8f8c/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:44:19.680439 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48121e60-2bde-48d2-b796-9d636c4f669f None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:19.680983 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48121e60-2bde-48d2-b796-9d636c4f669f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:19.680983 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48121e60-2bde-48d2-b796-9d636c4f669f None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:19.682362 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 571/1154] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:19.687634 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d3e4f-c079-450d-bfa1-18f6038b6438 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:19.688039 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d3e4f-c079-450d-bfa1-18f6038b6438 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:19.688184 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d3e4f-c079-450d-bfa1-18f6038b6438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:19.706738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-986d3e4f-c079-450d-bfa1-18f6038b6438 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:19.707926 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-986d3e4f-c079-450d-bfa1-18f6038b6438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:19.774631 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 584/1155] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:44:20.047580 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48121e60-2bde-48d2-b796-9d636c4f669f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:20.150513 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48121e60-2bde-48d2-b796-9d636c4f669f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:20.152059 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:20.186300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4224a-6310-44fc-bfb4-cdd1904f41a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:20.186924 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4224a-6310-44fc-bfb4-cdd1904f41a4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:20.187205 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4224a-6310-44fc-bfb4-cdd1904f41a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:20.187481 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4224a-6310-44fc-bfb4-cdd1904f41a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:20.198041 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4224a-6310-44fc-bfb4-cdd1904f41a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:20.203086 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-5bf4224a-6310-44fc-bfb4-cdd1904f41a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:20.203086 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:20.203086 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:20.203086 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:20.203086 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:20.203086 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:20.203086 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:20.203086 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:20.203086 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:20.203086 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:20.203086 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:20.203086 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:20.203086 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:20.203086 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:20.203086 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:20.203086 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:20.204339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:20.204339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:20.204339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:20.204339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:20.204339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:20.204339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:20.204339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:20.204339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:20.204339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:20.204339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:20.204339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:20.204339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:20.204339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:20.204339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:20.204339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:20.204339 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:20.205420 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:20.205420 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:20.205420 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:20.205420 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:20.205420 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:20.205420 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:20.205420 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:20.205420 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:20.205420 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:20.205420 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:20.205420 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:20.205420 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:44:20.205420 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 572/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:44:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:20.210963 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d3e4f-c079-450d-bfa1-18f6038b6438 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:20.277810 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:20.313183 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d3e4f-c079-450d-bfa1-18f6038b6438 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:20.350852 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb36d9-c947-4d8f-98eb-17923ba69776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:20.351554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb36d9-c947-4d8f-98eb-17923ba69776 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:20.351778 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb36d9-c947-4d8f-98eb-17923ba69776 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:20.352043 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb36d9-c947-4d8f-98eb-17923ba69776 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:20.352703 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb36d9-c947-4d8f-98eb-17923ba69776 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:20.353018 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb36d9-c947-4d8f-98eb-17923ba69776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:20.354383 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb36d9-c947-4d8f-98eb-17923ba69776 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:20.362601 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 585/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:20.369189 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4224a-6310-44fc-bfb4-cdd1904f41a4 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:20.470387 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4224a-6310-44fc-bfb4-cdd1904f41a4 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:20.504511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751be91-5209-48c6-ba0d-f3d6845cfc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:20.505147 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751be91-5209-48c6-ba0d-f3d6845cfc00 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:20.505423 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751be91-5209-48c6-ba0d-f3d6845cfc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:20.505689 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751be91-5209-48c6-ba0d-f3d6845cfc00 None admin] PATH_INFO: `/v3/users/2e2797705a564882a056e879734a8f8c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:20.506817 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751be91-5209-48c6-ba0d-f3d6845cfc00 None admin] RBAC: Authorizing `identity:get_user(user_id=2e2797705a564882a056e879734a8f8c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:20.508236 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751be91-5209-48c6-ba0d-f3d6845cfc00 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:20.509808 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 573/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:20 2022] GET /identity/v3/users/2e2797705a564882a056e879734a8f8c => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:20.515986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb36d9-c947-4d8f-98eb-17923ba69776 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:20.618255 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb36d9-c947-4d8f-98eb-17923ba69776 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:20.643720 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:20.652234 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a95341-eda7-486d-ba11-40b93af5f33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:20.652835 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a95341-eda7-486d-ba11-40b93af5f33d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:20.653146 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a95341-eda7-486d-ba11-40b93af5f33d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:20.653420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a95341-eda7-486d-ba11-40b93af5f33d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:20.719337 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a95341-eda7-486d-ba11-40b93af5f33d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:20.720794 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a95341-eda7-486d-ba11-40b93af5f33d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:20.818424 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 586/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:44:20.824517 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751be91-5209-48c6-ba0d-f3d6845cfc00 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:20.860474 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:20.931657 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751be91-5209-48c6-ba0d-f3d6845cfc00 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:20.966238 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb0635-dff9-4c03-9965-8829fe081a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:20.966858 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb0635-dff9-4c03-9965-8829fe081a6e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:20.967140 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb0635-dff9-4c03-9965-8829fe081a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:20.967413 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb0635-dff9-4c03-9965-8829fe081a6e None admin] PATH_INFO: `/v3/projects/4a1f4f4d4b8b48d5bb3c7b0dbf054c43` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:20.968531 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb0635-dff9-4c03-9965-8829fe081a6e None admin] RBAC: Authorizing `identity:get_project(project_id=4a1f4f4d4b8b48d5bb3c7b0dbf054c43)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:20.970005 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb0635-dff9-4c03-9965-8829fe081a6e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:20.971635 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 574/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:20 2022] GET /identity/v3/projects/4a1f4f4d4b8b48d5bb3c7b0dbf054c43 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:20.978768 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a95341-eda7-486d-ba11-40b93af5f33d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:21.006550 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:21.082606 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a95341-eda7-486d-ba11-40b93af5f33d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:21.118396 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5527f-ae06-4968-878f-b7b6b4785a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:21.118999 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5527f-ae06-4968-878f-b7b6b4785a32 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:21.119279 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5527f-ae06-4968-878f-b7b6b4785a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:21.119550 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5527f-ae06-4968-878f-b7b6b4785a32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:21.120268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5527f-ae06-4968-878f-b7b6b4785a32 None admin] RBAC: Adding query filter params (role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.project.id=4a1f4f4d4b8b48d5bb3c7b0dbf054c43, user.id=2e2797705a564882a056e879734a8f8c) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:21.120575 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5527f-ae06-4968-878f-b7b6b4785a32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:21.122031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5527f-ae06-4968-878f-b7b6b4785a32 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:21.127894 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 587/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:20 2022] GET /identity/v3/role_assignments?user.id=2e2797705a564882a056e879734a8f8c&scope.project.id=4a1f4f4d4b8b48d5bb3c7b0dbf054c43&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:23.343855 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ae19b-5401-4d0f-a1e8-ba374b8978ba None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:23.344386 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ae19b-5401-4d0f-a1e8-ba374b8978ba None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:23.344386 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ae19b-5401-4d0f-a1e8-ba374b8978ba None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:23.345777 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 575/1162] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:23.351559 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2f3fc-2007-4718-ba75-45c3a7835c51 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:23.351961 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2f3fc-2007-4718-ba75-45c3a7835c51 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:23.352102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2f3fc-2007-4718-ba75-45c3a7835c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:23.370559 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cce2f3fc-2007-4718-ba75-45c3a7835c51 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:23.371736 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cce2f3fc-2007-4718-ba75-45c3a7835c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:23.437343 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 588/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:44:23.708705 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ae19b-5401-4d0f-a1e8-ba374b8978ba None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:23.807956 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:23.813297 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ae19b-5401-4d0f-a1e8-ba374b8978ba None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:23.847687 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881af634-4a6a-4d1d-80e6-e8214617b8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:23.848282 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881af634-4a6a-4d1d-80e6-e8214617b8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:23.848561 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881af634-4a6a-4d1d-80e6-e8214617b8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:23.848830 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881af634-4a6a-4d1d-80e6-e8214617b8f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:23.917692 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881af634-4a6a-4d1d-80e6-e8214617b8f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:23.919147 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881af634-4a6a-4d1d-80e6-e8214617b8f4 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:24.014820 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:24.019540 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 576/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:44:24.025541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2f3fc-2007-4718-ba75-45c3a7835c51 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:24.049304 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:24.124597 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2f3fc-2007-4718-ba75-45c3a7835c51 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:24.158956 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b724c8-48e0-46e8-ba51-d2fca5b61796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:24.159582 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b724c8-48e0-46e8-ba51-d2fca5b61796 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:24.159863 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b724c8-48e0-46e8-ba51-d2fca5b61796 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:24.160136 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b724c8-48e0-46e8-ba51-d2fca5b61796 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:24.167398 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b724c8-48e0-46e8-ba51-d2fca5b61796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:24.168843 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b724c8-48e0-46e8-ba51-d2fca5b61796 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:24.180969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-86b724c8-48e0-46e8-ba51-d2fca5b61796 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 02 00:44:24.180969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:24.180969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 00:44:24.180969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 00:44:24.180969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:44:24.180969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:44:24.180969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:44:24.180969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:44:24.180969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 02 00:44:24.180969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:44:24.180969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:44:24.180969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:44:24.180969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:24.180969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:24.180969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:24.180969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:24.180969 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:24.182332 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:24.182332 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:24.182332 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:24.182332 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:24.182332 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:24.182332 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:24.182332 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:44:24.182332 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:44:24.182332 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:44:24.182332 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:44:24.182332 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:24.182332 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:24.182332 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:24.182332 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:24.182332 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:24.182332 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:24.183378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:24.183378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:24.183378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:24.183378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:24.183378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:24.183378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:24.183378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:24.183378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:24.183378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:24.183378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:24.183378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 00:44:24.183378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:44:24.183378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 02 00:44:24.183378 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:44:24.183378 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 589/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Oct 2 00:44:24 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:24.188218 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881af634-4a6a-4d1d-80e6-e8214617b8f4 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:24.293718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881af634-4a6a-4d1d-80e6-e8214617b8f4 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:24.329468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f6302-8488-435d-a642-e4c139868e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:24.330072 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f6302-8488-435d-a642-e4c139868e48 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:24.330351 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f6302-8488-435d-a642-e4c139868e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:24.330619 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f6302-8488-435d-a642-e4c139868e48 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:24.331254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f6302-8488-435d-a642-e4c139868e48 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:24.331553 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f6302-8488-435d-a642-e4c139868e48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:24.332913 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f6302-8488-435d-a642-e4c139868e48 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:24.340145 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 577/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Sun Oct 2 00:44:24 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:26.508722 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02abbc-ba02-4a7e-89d3-e3ec0c657e87 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:26.509297 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02abbc-ba02-4a7e-89d3-e3ec0c657e87 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:26.509297 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02abbc-ba02-4a7e-89d3-e3ec0c657e87 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:26.510612 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 590/1167] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:26.516326 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de49cfd-f006-4df5-bb84-5858fd57896c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:26.516734 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de49cfd-f006-4df5-bb84-5858fd57896c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:26.516880 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de49cfd-f006-4df5-bb84-5858fd57896c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:26.534758 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4de49cfd-f006-4df5-bb84-5858fd57896c None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:26.535947 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4de49cfd-f006-4df5-bb84-5858fd57896c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:26.591852 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:26.603177 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 578/1168] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:44:26.877200 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02abbc-ba02-4a7e-89d3-e3ec0c657e87 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:26.959012 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:26.978646 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02abbc-ba02-4a7e-89d3-e3ec0c657e87 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:27.013327 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b68fc-4db7-4f40-bd07-ebbfa16d2605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:27.013928 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b68fc-4db7-4f40-bd07-ebbfa16d2605 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:27.014205 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b68fc-4db7-4f40-bd07-ebbfa16d2605 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:27.014475 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b68fc-4db7-4f40-bd07-ebbfa16d2605 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:27.015131 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b68fc-4db7-4f40-bd07-ebbfa16d2605 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:27.016497 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b68fc-4db7-4f40-bd07-ebbfa16d2605 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:27.032036 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 591/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Sun Oct 2 00:44:26 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:44:29.199202 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7161aa-4480-402b-8bb3-65dda5b217f5 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:29.199735 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7161aa-4480-402b-8bb3-65dda5b217f5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:29.199735 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7161aa-4480-402b-8bb3-65dda5b217f5 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:29.201123 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 579/1170] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:29.206609 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44de396-a8c1-40d2-b4e4-2777953fb16b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:29.207011 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44de396-a8c1-40d2-b4e4-2777953fb16b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:29.207156 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44de396-a8c1-40d2-b4e4-2777953fb16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:29.227639 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f44de396-a8c1-40d2-b4e4-2777953fb16b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:29.228902 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f44de396-a8c1-40d2-b4e4-2777953fb16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:29.296244 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 592/1171] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:44:29.570320 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7161aa-4480-402b-8bb3-65dda5b217f5 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:29.670880 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7161aa-4480-402b-8bb3-65dda5b217f5 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:29.707887 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d9fc8-3187-4b9a-a41f-ca77eccdcfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:29.708606 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d9fc8-3187-4b9a-a41f-ca77eccdcfe5 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:29.708892 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d9fc8-3187-4b9a-a41f-ca77eccdcfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:29.709390 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d9fc8-3187-4b9a-a41f-ca77eccdcfe5 None admin] PATH_INFO: `/v3/domains/f21b17e0b6184382ad6a13265cf5447b` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:29.720027 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d9fc8-3187-4b9a-a41f-ca77eccdcfe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f21b17e0b6184382ad6a13265cf5447b)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:29.721535 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d9fc8-3187-4b9a-a41f-ca77eccdcfe5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:29.723131 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 580/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Sun Oct 2 00:44:29 2022] GET /identity/v3/domains/f21b17e0b6184382ad6a13265cf5447b => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:29.729167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44de396-a8c1-40d2-b4e4-2777953fb16b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:29.804110 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:29.834480 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44de396-a8c1-40d2-b4e4-2777953fb16b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:29.866699 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853d1d5-a338-410a-86e5-d874e5b85d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:29.867289 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853d1d5-a338-410a-86e5-d874e5b85d0e None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:29.867604 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853d1d5-a338-410a-86e5-d874e5b85d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:29.867832 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853d1d5-a338-410a-86e5-d874e5b85d0e None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:29.868463 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853d1d5-a338-410a-86e5-d874e5b85d0e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:29.869911 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853d1d5-a338-410a-86e5-d874e5b85d0e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:29.896330 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 593/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Oct 2 00:44:29 2022] POST /identity/v3/projects => generated 361 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:44:32.119787 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fca42-ccf9-4784-a1ff-9520e015bcb5 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:32.120318 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fca42-ccf9-4784-a1ff-9520e015bcb5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:32.120318 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fca42-ccf9-4784-a1ff-9520e015bcb5 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:32.121715 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 581/1174] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:32.126864 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27783adf-8b21-4a6b-b7c1-d78730203e48 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:32.127285 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27783adf-8b21-4a6b-b7c1-d78730203e48 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:32.127404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27783adf-8b21-4a6b-b7c1-d78730203e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:32.146190 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-27783adf-8b21-4a6b-b7c1-d78730203e48 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:32.147905 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-27783adf-8b21-4a6b-b7c1-d78730203e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:32.212246 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 594/1175] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:44:32.480296 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fca42-ccf9-4784-a1ff-9520e015bcb5 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:32.537902 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:32.586027 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fca42-ccf9-4784-a1ff-9520e015bcb5 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:32.620197 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e769f-84f8-48ec-8dae-0459b3e9d393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:32.620823 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e769f-84f8-48ec-8dae-0459b3e9d393 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:32.621131 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e769f-84f8-48ec-8dae-0459b3e9d393 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:32.621405 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e769f-84f8-48ec-8dae-0459b3e9d393 None admin] PATH_INFO: `/v3/domains/f21b17e0b6184382ad6a13265cf5447b` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:32.622512 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e769f-84f8-48ec-8dae-0459b3e9d393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f21b17e0b6184382ad6a13265cf5447b)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:32.623946 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e769f-84f8-48ec-8dae-0459b3e9d393 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:32.625545 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 582/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Sun Oct 2 00:44:32 2022] GET /identity/v3/domains/f21b17e0b6184382ad6a13265cf5447b => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:32.631627 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27783adf-8b21-4a6b-b7c1-d78730203e48 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:32.686497 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:32.731902 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27783adf-8b21-4a6b-b7c1-d78730203e48 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:32.766353 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661f260-a322-484f-b9a3-714b3e4c9234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:32.766954 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661f260-a322-484f-b9a3-714b3e4c9234 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:32.767234 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661f260-a322-484f-b9a3-714b3e4c9234 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:32.767507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661f260-a322-484f-b9a3-714b3e4c9234 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:32.768227 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661f260-a322-484f-b9a3-714b3e4c9234 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:32.769697 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661f260-a322-484f-b9a3-714b3e4c9234 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:32.796831 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 595/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Oct 2 00:44:32 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:44:35.048503 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b7ca9-25e4-47a6-a043-59cc22585530 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:35.049061 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b7ca9-25e4-47a6-a043-59cc22585530 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:35.049191 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b7ca9-25e4-47a6-a043-59cc22585530 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:35.050430 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 583/1178] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:35.056254 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a09102-4e68-442e-8f8b-138ce0b43005 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:35.056690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a09102-4e68-442e-8f8b-138ce0b43005 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:35.056783 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a09102-4e68-442e-8f8b-138ce0b43005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:35.076049 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-03a09102-4e68-442e-8f8b-138ce0b43005 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:35.077278 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-03a09102-4e68-442e-8f8b-138ce0b43005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:35.158830 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 596/1179] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:44:35.430807 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b7ca9-25e4-47a6-a043-59cc22585530 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:35.533961 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b7ca9-25e4-47a6-a043-59cc22585530 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:35.554758 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:35.569873 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3e0aa-9091-45ec-a200-ec75be816d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:35.570493 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3e0aa-9091-45ec-a200-ec75be816d48 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:35.570774 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3e0aa-9091-45ec-a200-ec75be816d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:35.571046 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3e0aa-9091-45ec-a200-ec75be816d48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:35.581173 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3e0aa-9091-45ec-a200-ec75be816d48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:35.586003 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-74c3e0aa-9091-45ec-a200-ec75be816d48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:35.586003 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:35.586003 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:35.586003 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:35.586003 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:35.586003 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:35.586003 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:35.586003 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:35.586003 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:35.586003 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:35.586003 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:35.586003 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:35.586003 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:35.586003 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:35.586003 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:35.586003 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:35.587108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:35.587108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:35.587108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:35.587108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:35.587108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:35.587108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:35.587108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:35.587108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:35.587108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:35.587108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:35.587108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:35.587108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:35.587108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:35.587108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:35.587108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:35.587108 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:35.588209 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:35.588209 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:35.588209 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:35.588209 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:35.588209 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:35.588209 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:35.588209 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:35.588209 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:35.588209 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:35.588209 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:35.588209 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:35.588209 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:44:35.588209 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 584/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:44:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:35.593237 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a09102-4e68-442e-8f8b-138ce0b43005 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:35.635014 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:35.692290 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a09102-4e68-442e-8f8b-138ce0b43005 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:35.726999 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f272a-2c8e-4fad-9ac6-404cdff25d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:35.727604 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f272a-2c8e-4fad-9ac6-404cdff25d30 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:35.727886 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f272a-2c8e-4fad-9ac6-404cdff25d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:35.728159 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f272a-2c8e-4fad-9ac6-404cdff25d30 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:35.728823 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f272a-2c8e-4fad-9ac6-404cdff25d30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:35.729159 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f272a-2c8e-4fad-9ac6-404cdff25d30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:35.730521 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f272a-2c8e-4fad-9ac6-404cdff25d30 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:35.738581 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 597/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:35.744980 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3e0aa-9091-45ec-a200-ec75be816d48 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:35.844989 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3e0aa-9091-45ec-a200-ec75be816d48 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:35.879066 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a176d3d-9e40-4eb0-a022-09e2eb367566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:35.879688 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a176d3d-9e40-4eb0-a022-09e2eb367566 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:35.879968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a176d3d-9e40-4eb0-a022-09e2eb367566 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:35.880241 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a176d3d-9e40-4eb0-a022-09e2eb367566 None admin] PATH_INFO: `/v3/users/1a692d227d1c461a9064d07b6a249b6d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:35.893559 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a176d3d-9e40-4eb0-a022-09e2eb367566 None admin] RBAC: Authorizing `identity:get_user(user_id=1a692d227d1c461a9064d07b6a249b6d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:35.895011 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a176d3d-9e40-4eb0-a022-09e2eb367566 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:35.897157 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 585/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:35 2022] GET /identity/v3/users/1a692d227d1c461a9064d07b6a249b6d => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:35.903160 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f272a-2c8e-4fad-9ac6-404cdff25d30 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:36.012799 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f272a-2c8e-4fad-9ac6-404cdff25d30 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:36.014512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:36.049981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d7f10-1e12-4475-9a5d-0ebc94c1778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:36.050578 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d7f10-1e12-4475-9a5d-0ebc94c1778a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:36.050855 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d7f10-1e12-4475-9a5d-0ebc94c1778a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:36.051125 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d7f10-1e12-4475-9a5d-0ebc94c1778a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:36.117158 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d7f10-1e12-4475-9a5d-0ebc94c1778a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:36.118604 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d7f10-1e12-4475-9a5d-0ebc94c1778a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:36.216648 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 598/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:44:36.222717 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a176d3d-9e40-4eb0-a022-09e2eb367566 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:36.264416 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:36.324243 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a176d3d-9e40-4eb0-a022-09e2eb367566 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:36.358887 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6588dd-f7ed-4bec-ac5d-2d25357d1107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:36.359506 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6588dd-f7ed-4bec-ac5d-2d25357d1107 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:36.359790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6588dd-f7ed-4bec-ac5d-2d25357d1107 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:36.360064 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6588dd-f7ed-4bec-ac5d-2d25357d1107 None admin] PATH_INFO: `/v3/projects/1c51fa5f22f6406c98499c5f59822980` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:36.361200 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6588dd-f7ed-4bec-ac5d-2d25357d1107 None admin] RBAC: Authorizing `identity:get_project(project_id=1c51fa5f22f6406c98499c5f59822980)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:36.362635 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6588dd-f7ed-4bec-ac5d-2d25357d1107 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:36.364253 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 586/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:36 2022] GET /identity/v3/projects/1c51fa5f22f6406c98499c5f59822980 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:36.372535 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d7f10-1e12-4475-9a5d-0ebc94c1778a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:36.375013 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:36.472489 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d7f10-1e12-4475-9a5d-0ebc94c1778a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:36.505236 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6e1cb-82da-46fe-86d4-27e9f9edc31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:36.505981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6e1cb-82da-46fe-86d4-27e9f9edc31d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:36.506292 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6e1cb-82da-46fe-86d4-27e9f9edc31d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:36.506564 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6e1cb-82da-46fe-86d4-27e9f9edc31d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:36.507284 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6e1cb-82da-46fe-86d4-27e9f9edc31d None admin] RBAC: Adding query filter params (role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.project.id=1c51fa5f22f6406c98499c5f59822980, user.id=1a692d227d1c461a9064d07b6a249b6d) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:36.507584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6e1cb-82da-46fe-86d4-27e9f9edc31d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:36.509222 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6e1cb-82da-46fe-86d4-27e9f9edc31d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:36.515584 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 599/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:36 2022] GET /identity/v3/role_assignments?user.id=1a692d227d1c461a9064d07b6a249b6d&scope.project.id=1c51fa5f22f6406c98499c5f59822980&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:38.701554 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7318225-ee97-43a8-8c4c-4ebe53800f9c None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:38.702057 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7318225-ee97-43a8-8c4c-4ebe53800f9c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:38.702057 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7318225-ee97-43a8-8c4c-4ebe53800f9c None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:38.703348 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 587/1186] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:38.708554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019fd63-57ce-428b-90e7-83db028a978b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:38.709661 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019fd63-57ce-428b-90e7-83db028a978b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:38.709661 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019fd63-57ce-428b-90e7-83db028a978b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:38.727948 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4019fd63-57ce-428b-90e7-83db028a978b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:38.729169 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4019fd63-57ce-428b-90e7-83db028a978b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:38.788013 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:38.795552 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 600/1187] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:44:39.068238 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7318225-ee97-43a8-8c4c-4ebe53800f9c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:39.176323 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7318225-ee97-43a8-8c4c-4ebe53800f9c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:39.184357 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:39.210636 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01953dc-2b5d-41e0-9c0d-58e474f12400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:39.211260 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01953dc-2b5d-41e0-9c0d-58e474f12400 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:39.211540 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01953dc-2b5d-41e0-9c0d-58e474f12400 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:39.211814 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01953dc-2b5d-41e0-9c0d-58e474f12400 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:39.221711 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01953dc-2b5d-41e0-9c0d-58e474f12400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:39.227452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e01953dc-2b5d-41e0-9c0d-58e474f12400 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:39.227452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:39.227452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:39.227452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:39.227452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:39.227452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:39.227452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:39.227452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:39.227452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:39.227452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:39.227452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:39.227452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:39.227452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:39.227452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:39.227452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:39.227452 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:39.228608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:39.228608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:39.228608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:39.228608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:39.228608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:39.228608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:39.228608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:39.228608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:39.228608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:39.228608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:39.228608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:39.228608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:39.228608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:39.228608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:39.228608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:39.228608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:39.229740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:39.229740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:39.229740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:39.229740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:39.229740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:39.229740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:39.229740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:39.229740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:39.229740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:39.229740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:39.229740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:39.229740 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:44:39.229740 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 588/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:44:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:39.234633 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019fd63-57ce-428b-90e7-83db028a978b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:39.330075 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019fd63-57ce-428b-90e7-83db028a978b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:39.362348 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf64f7-2e33-4290-ad52-676177ccdb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:39.362940 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf64f7-2e33-4290-ad52-676177ccdb95 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:39.363212 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf64f7-2e33-4290-ad52-676177ccdb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:39.363478 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf64f7-2e33-4290-ad52-676177ccdb95 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:39.364127 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf64f7-2e33-4290-ad52-676177ccdb95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:39.364420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf64f7-2e33-4290-ad52-676177ccdb95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:39.366399 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf64f7-2e33-4290-ad52-676177ccdb95 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:39.374185 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 601/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:39.380037 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01953dc-2b5d-41e0-9c0d-58e474f12400 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:39.489253 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01953dc-2b5d-41e0-9c0d-58e474f12400 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:39.526642 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c6c9f-8276-4db1-8a6f-a75e5e74d4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:39.527276 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c6c9f-8276-4db1-8a6f-a75e5e74d4cd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:39.527555 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c6c9f-8276-4db1-8a6f-a75e5e74d4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:39.527825 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c6c9f-8276-4db1-8a6f-a75e5e74d4cd None admin] PATH_INFO: `/v3/users/1a692d227d1c461a9064d07b6a249b6d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:39.528961 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c6c9f-8276-4db1-8a6f-a75e5e74d4cd None admin] RBAC: Authorizing `identity:get_user(user_id=1a692d227d1c461a9064d07b6a249b6d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:39.530399 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c6c9f-8276-4db1-8a6f-a75e5e74d4cd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:39.531988 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 589/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:39 2022] GET /identity/v3/users/1a692d227d1c461a9064d07b6a249b6d => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:39.538223 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf64f7-2e33-4290-ad52-676177ccdb95 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:39.599958 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:39.642959 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf64f7-2e33-4290-ad52-676177ccdb95 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:39.676635 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307cbfa-3a5a-4254-a1a8-0fbe2b39dd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:39.677296 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307cbfa-3a5a-4254-a1a8-0fbe2b39dd62 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:39.677613 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307cbfa-3a5a-4254-a1a8-0fbe2b39dd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:39.677890 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307cbfa-3a5a-4254-a1a8-0fbe2b39dd62 None admin] PATH_INFO: `/v3/projects/1c51fa5f22f6406c98499c5f59822980` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:39.679119 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307cbfa-3a5a-4254-a1a8-0fbe2b39dd62 None admin] RBAC: Authorizing `identity:get_project(project_id=1c51fa5f22f6406c98499c5f59822980)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:39.680550 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307cbfa-3a5a-4254-a1a8-0fbe2b39dd62 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:39.682220 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 602/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:39 2022] GET /identity/v3/projects/1c51fa5f22f6406c98499c5f59822980 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:39.688188 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c6c9f-8276-4db1-8a6f-a75e5e74d4cd None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:39.722845 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:39.789794 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c6c9f-8276-4db1-8a6f-a75e5e74d4cd None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:39.823707 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82cb6e-66f9-47c0-a335-8e3528183354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:39.824351 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82cb6e-66f9-47c0-a335-8e3528183354 None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:39.824625 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82cb6e-66f9-47c0-a335-8e3528183354 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:39.824896 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82cb6e-66f9-47c0-a335-8e3528183354 None admin] PATH_INFO: `/v3/projects/1c51fa5f22f6406c98499c5f59822980/users/1a692d227d1c461a9064d07b6a249b6d/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:39.826800 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82cb6e-66f9-47c0-a335-8e3528183354 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c51fa5f22f6406c98499c5f59822980, user_id=1a692d227d1c461a9064d07b6a249b6d, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:39.828221 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82cb6e-66f9-47c0-a335-8e3528183354 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:39.841596 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 590/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:44:39 2022] PUT /identity/v3/projects/1c51fa5f22f6406c98499c5f59822980/users/1a692d227d1c461a9064d07b6a249b6d/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:44:42.019688 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68213c-4430-4681-92d1-e90097358e70 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:42.020241 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68213c-4430-4681-92d1-e90097358e70 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:42.020241 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68213c-4430-4681-92d1-e90097358e70 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:42.021657 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 603/1193] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:42.026918 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867803c-1222-4804-8154-f5bb30ff0456 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:42.027319 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867803c-1222-4804-8154-f5bb30ff0456 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:42.027466 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867803c-1222-4804-8154-f5bb30ff0456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:42.046198 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8867803c-1222-4804-8154-f5bb30ff0456 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:42.047383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8867803c-1222-4804-8154-f5bb30ff0456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:42.115481 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 591/1194] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:44:42.402080 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68213c-4430-4681-92d1-e90097358e70 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:42.506260 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68213c-4430-4681-92d1-e90097358e70 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:42.534472 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:42.543834 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcd1c9-8a39-4d0a-8c00-a7ccb421b140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:42.544463 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcd1c9-8a39-4d0a-8c00-a7ccb421b140 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:42.544744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcd1c9-8a39-4d0a-8c00-a7ccb421b140 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:42.545042 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcd1c9-8a39-4d0a-8c00-a7ccb421b140 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:42.554980 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcd1c9-8a39-4d0a-8c00-a7ccb421b140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:42.559820 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-91fcd1c9-8a39-4d0a-8c00-a7ccb421b140 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:42.559820 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:42.559820 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:42.559820 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:42.559820 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:42.559820 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:42.559820 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:42.559820 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:42.559820 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:42.559820 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:42.559820 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:42.559820 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:42.559820 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:42.559820 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:42.559820 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:42.559820 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:42.561005 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:42.561005 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:42.561005 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:42.561005 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:42.561005 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:42.561005 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:42.561005 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:42.561005 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:42.561005 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:42.561005 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:42.561005 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:42.561005 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:42.561005 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:42.561005 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:42.561005 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:42.561005 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:42.562307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:42.562307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:42.562307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:42.562307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:42.562307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:42.562307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:42.562307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:42.562307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:42.562307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:42.562307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:42.562307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:42.562307 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:44:42.562307 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 604/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:44:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:42.567008 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867803c-1222-4804-8154-f5bb30ff0456 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:42.592642 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:42.670311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867803c-1222-4804-8154-f5bb30ff0456 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:42.704461 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960fdca-1c9c-41fc-a980-02b7ceb4b8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:42.705089 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960fdca-1c9c-41fc-a980-02b7ceb4b8bd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:42.705420 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960fdca-1c9c-41fc-a980-02b7ceb4b8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:42.705642 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960fdca-1c9c-41fc-a980-02b7ceb4b8bd None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:42.706308 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960fdca-1c9c-41fc-a980-02b7ceb4b8bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:42.706610 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960fdca-1c9c-41fc-a980-02b7ceb4b8bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:42.707972 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960fdca-1c9c-41fc-a980-02b7ceb4b8bd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:42.717767 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 592/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:42.723681 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcd1c9-8a39-4d0a-8c00-a7ccb421b140 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:42.819584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcd1c9-8a39-4d0a-8c00-a7ccb421b140 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:42.852541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92b99c-d142-44f9-bbcf-abb11aeeb94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:42.853190 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92b99c-d142-44f9-bbcf-abb11aeeb94b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:42.853471 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92b99c-d142-44f9-bbcf-abb11aeeb94b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:42.853742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92b99c-d142-44f9-bbcf-abb11aeeb94b None admin] PATH_INFO: `/v3/users/1a692d227d1c461a9064d07b6a249b6d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:42.854846 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92b99c-d142-44f9-bbcf-abb11aeeb94b None admin] RBAC: Authorizing `identity:get_user(user_id=1a692d227d1c461a9064d07b6a249b6d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:42.856304 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92b99c-d142-44f9-bbcf-abb11aeeb94b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:42.857894 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 605/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:42 2022] GET /identity/v3/users/1a692d227d1c461a9064d07b6a249b6d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:42.863901 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960fdca-1c9c-41fc-a980-02b7ceb4b8bd None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:42.949579 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:42.965136 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960fdca-1c9c-41fc-a980-02b7ceb4b8bd None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:42.999254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc462d-8148-49cb-9e61-f65017a34922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:42.999856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc462d-8148-49cb-9e61-f65017a34922 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:43.000136 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc462d-8148-49cb-9e61-f65017a34922 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:43.000404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc462d-8148-49cb-9e61-f65017a34922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:43.069970 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc462d-8148-49cb-9e61-f65017a34922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:43.071408 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc462d-8148-49cb-9e61-f65017a34922 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:43.155281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:43.171507 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 593/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:44:43.178074 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92b99c-d142-44f9-bbcf-abb11aeeb94b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:43.232977 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:43.279118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92b99c-d142-44f9-bbcf-abb11aeeb94b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:43.313626 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2be1d5-6620-41f5-8f3e-8d7f2904c2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:43.314256 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2be1d5-6620-41f5-8f3e-8d7f2904c2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:43.314533 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2be1d5-6620-41f5-8f3e-8d7f2904c2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:43.314801 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2be1d5-6620-41f5-8f3e-8d7f2904c2a7 None admin] PATH_INFO: `/v3/projects/1c51fa5f22f6406c98499c5f59822980` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:43.315908 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2be1d5-6620-41f5-8f3e-8d7f2904c2a7 None admin] RBAC: Authorizing `identity:get_project(project_id=1c51fa5f22f6406c98499c5f59822980)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:43.317380 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2be1d5-6620-41f5-8f3e-8d7f2904c2a7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:43.319911 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 606/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:43 2022] GET /identity/v3/projects/1c51fa5f22f6406c98499c5f59822980 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:43.326296 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc462d-8148-49cb-9e61-f65017a34922 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:43.428652 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc462d-8148-49cb-9e61-f65017a34922 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:43.463158 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f34d01-afc6-48e2-9cb4-84c9cce426a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:43.463753 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f34d01-afc6-48e2-9cb4-84c9cce426a7 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:43.464020 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f34d01-afc6-48e2-9cb4-84c9cce426a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:43.464283 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f34d01-afc6-48e2-9cb4-84c9cce426a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:43.465021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f34d01-afc6-48e2-9cb4-84c9cce426a7 None admin] RBAC: Adding query filter params (role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.project.id=1c51fa5f22f6406c98499c5f59822980, user.id=1a692d227d1c461a9064d07b6a249b6d) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:43.465323 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f34d01-afc6-48e2-9cb4-84c9cce426a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:43.466744 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f34d01-afc6-48e2-9cb4-84c9cce426a7 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:43.472517 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 594/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:43 2022] GET /identity/v3/role_assignments?user.id=1a692d227d1c461a9064d07b6a249b6d&scope.project.id=1c51fa5f22f6406c98499c5f59822980&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:53.309524 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=39 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:53.469950 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=75 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:41.238181 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5496d9-871e-444b-999c-ac713c29b64f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:41.238181 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5496d9-871e-444b-999c-ac713c29b64f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:41.238181 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5496d9-871e-444b-999c-ac713c29b64f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:41.240750 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 607/1201] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:45:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:41.257012 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a3dfb-72e2-4251-8919-76b5576a83d4 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:41.257012 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a3dfb-72e2-4251-8919-76b5576a83d4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:41.257012 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a3dfb-72e2-4251-8919-76b5576a83d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:41.287476 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-c92a3dfb-72e2-4251-8919-76b5576a83d4 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:41.290376 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c92a3dfb-72e2-4251-8919-76b5576a83d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:41.454483 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 595/1202] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:45:41.974662 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5496d9-871e-444b-999c-ac713c29b64f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:42.185185 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5496d9-871e-444b-999c-ac713c29b64f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:42.243471 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b05ed-de1d-4e32-809e-cdd36e4a2f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:42.244434 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b05ed-de1d-4e32-809e-cdd36e4a2f05 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:42.244434 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b05ed-de1d-4e32-809e-cdd36e4a2f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:42.244716 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b05ed-de1d-4e32-809e-cdd36e4a2f05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:42.257976 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b05ed-de1d-4e32-809e-cdd36e4a2f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:42.259462 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b05ed-de1d-4e32-809e-cdd36e4a2f05 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:42.276489 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-b53b05ed-de1d-4e32-809e-cdd36e4a2f05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:42.276489 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:42.276489 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:42.276489 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:42.276489 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:42.276489 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:42.276489 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:42.276489 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:42.276489 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:42.276489 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:42.276489 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:42.276489 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:42.276489 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:42.276489 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:42.276489 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:42.276489 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:42.279483 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:42.279483 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:42.279483 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:42.279483 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:42.279483 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:42.279483 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:42.279483 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:42.279483 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:42.279483 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:42.279483 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:42.279483 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:42.279483 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:42.279483 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:42.279483 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:42.279483 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:42.279483 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:42.279483 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:42.282459 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:42.282459 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:42.282459 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:45:42.287792 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 608/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:42.288084 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a3dfb-72e2-4251-8919-76b5576a83d4 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:42.496364 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a3dfb-72e2-4251-8919-76b5576a83d4 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:42.567985 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:42.579779 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a9dfb-e018-4270-87fb-7f43f730f12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:42.581284 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a9dfb-e018-4270-87fb-7f43f730f12b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:42.581284 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a9dfb-e018-4270-87fb-7f43f730f12b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:42.581960 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a9dfb-e018-4270-87fb-7f43f730f12b None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:42.583145 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a9dfb-e018-4270-87fb-7f43f730f12b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:42.583803 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a9dfb-e018-4270-87fb-7f43f730f12b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:42.586502 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a9dfb-e018-4270-87fb-7f43f730f12b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:42.606071 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 596/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:42.615713 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b05ed-de1d-4e32-809e-cdd36e4a2f05 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:42.738077 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:42.832137 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b05ed-de1d-4e32-809e-cdd36e4a2f05 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:42.904372 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc55a75-5b71-46fe-8cb4-bb3d3c931deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:42.905367 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc55a75-5b71-46fe-8cb4-bb3d3c931deb None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:42.905710 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc55a75-5b71-46fe-8cb4-bb3d3c931deb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:42.906057 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc55a75-5b71-46fe-8cb4-bb3d3c931deb None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:42.906792 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc55a75-5b71-46fe-8cb4-bb3d3c931deb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:42.908514 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc55a75-5b71-46fe-8cb4-bb3d3c931deb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:42.943031 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 609/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Oct 2 00:45:42 2022] POST /identity/v3/users => generated 251 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:45:45.660007 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8141e9-4686-452d-bd4f-3387b609d300 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:45.661448 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8141e9-4686-452d-bd4f-3387b609d300 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:45.661448 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8141e9-4686-452d-bd4f-3387b609d300 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:45.662030 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 597/1206] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:45.668192 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713f314-a5ea-412b-b744-38fbf9113a6b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:45.669020 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713f314-a5ea-412b-b744-38fbf9113a6b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:45.669020 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713f314-a5ea-412b-b744-38fbf9113a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:45.692901 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0713f314-a5ea-412b-b744-38fbf9113a6b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:45.695083 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0713f314-a5ea-412b-b744-38fbf9113a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:45.837886 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 610/1207] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:45:46.378838 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8141e9-4686-452d-bd4f-3387b609d300 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:46.539292 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8141e9-4686-452d-bd4f-3387b609d300 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:46.591761 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa7365-400f-470d-894f-ec513bb7b4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:46.592447 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa7365-400f-470d-894f-ec513bb7b4bc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:46.592813 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa7365-400f-470d-894f-ec513bb7b4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:46.593052 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa7365-400f-470d-894f-ec513bb7b4bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:46.608692 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa7365-400f-470d-894f-ec513bb7b4bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:46.614955 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-84fa7365-400f-470d-894f-ec513bb7b4bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:46.614955 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:46.614955 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:46.614955 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:46.614955 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:46.614955 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:46.614955 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:46.614955 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:46.614955 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:46.614955 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:46.614955 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:46.614955 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:46.614955 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:46.614955 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:46.614955 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:46.614955 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:46.616468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:46.616468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:46.616468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:46.616468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:46.616468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:46.616468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:46.616468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:46.616468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:46.616468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:46.616468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:46.616468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:46.616468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:46.616468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:46.616468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:46.616468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:46.616468 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:46.617444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:46.617444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:46.617444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:46.617444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:46.617444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:46.617444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:46.617444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:46.617444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:46.617444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:46.617444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:46.617444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:46.617444 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:45:46.617444 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 598/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:46.623742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713f314-a5ea-412b-b744-38fbf9113a6b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:46.672665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:46.759470 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713f314-a5ea-412b-b744-38fbf9113a6b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:46.809548 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf5a20-f354-420d-acad-993ca88df8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:46.810674 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf5a20-f354-420d-acad-993ca88df8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:46.811029 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf5a20-f354-420d-acad-993ca88df8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:46.811363 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf5a20-f354-420d-acad-993ca88df8f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:46.812053 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf5a20-f354-420d-acad-993ca88df8f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:46.812376 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf5a20-f354-420d-acad-993ca88df8f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:46.813921 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf5a20-f354-420d-acad-993ca88df8f4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:46.828296 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 611/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:46.836315 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa7365-400f-470d-894f-ec513bb7b4bc None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:46.925848 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:47.027282 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa7365-400f-470d-894f-ec513bb7b4bc None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:47.098656 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b3a0d-8971-4242-b856-7c9937c03555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:47.099778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b3a0d-8971-4242-b856-7c9937c03555 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:47.100301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b3a0d-8971-4242-b856-7c9937c03555 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:47.100805 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b3a0d-8971-4242-b856-7c9937c03555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:47.122229 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b3a0d-8971-4242-b856-7c9937c03555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:47.124820 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b3a0d-8971-4242-b856-7c9937c03555 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:47.151602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-235b3a0d-8971-4242-b856-7c9937c03555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:47.151602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:47.151602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:47.151602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:47.151602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:47.151602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:47.151602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:47.151602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:47.151602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:47.151602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:47.151602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:47.151602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:47.151602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:47.151602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:47.151602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:47.151602 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:47.157723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:47.157723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:47.157723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:47.157723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:47.157723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:47.157723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:47.157723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:47.157723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:47.157723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:47.157723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:47.157723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:47.157723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:47.157723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:47.157723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:47.157723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:47.157723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:47.157723 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:47.159046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:47.159046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:47.159046 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:45:47.159046 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 599/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:47.160970 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf5a20-f354-420d-acad-993ca88df8f4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:47.328051 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:47.331837 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf5a20-f354-420d-acad-993ca88df8f4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:47.383763 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa109d-0502-47e2-9276-71f58db73641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:47.384373 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa109d-0502-47e2-9276-71f58db73641 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:47.384672 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa109d-0502-47e2-9276-71f58db73641 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:47.385133 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa109d-0502-47e2-9276-71f58db73641 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:47.386055 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa109d-0502-47e2-9276-71f58db73641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:47.386387 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa109d-0502-47e2-9276-71f58db73641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:47.388016 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa109d-0502-47e2-9276-71f58db73641 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:47.410335 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 612/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:47.413118 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b3a0d-8971-4242-b856-7c9937c03555 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:47.584720 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b3a0d-8971-4242-b856-7c9937c03555 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:47.587085 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:47.665499 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba66b9-c0a3-47e2-8682-36bd83e9f9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:47.667002 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba66b9-c0a3-47e2-8682-36bd83e9f9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:47.667468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba66b9-c0a3-47e2-8682-36bd83e9f9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:47.667962 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba66b9-c0a3-47e2-8682-36bd83e9f9f2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:47.686813 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba66b9-c0a3-47e2-8682-36bd83e9f9f2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:47.690877 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba66b9-c0a3-47e2-8682-36bd83e9f9f2 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:47.715989 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-2cba66b9-c0a3-47e2-8682-36bd83e9f9f2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:45:47.715989 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:47.715989 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:47.715989 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:47.715989 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:47.715989 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:47.715989 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:47.715989 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:47.715989 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:47.715989 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:47.715989 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:47.715989 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:47.715989 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:47.715989 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:47.715989 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:47.715989 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:47.717424 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:47.717424 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:47.717424 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:47.717424 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:47.717424 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:47.717424 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:47.717424 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:47.717424 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:47.717424 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:47.717424 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:47.717424 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:47.717424 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:47.717424 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:47.717424 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:47.717424 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:47.717424 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:47.717424 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:47.717424 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:47.727947 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:47.727947 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:47.727947 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:47.727947 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:47.727947 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:47.727947 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:47.727947 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:47.727947 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:47.727947 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:45:47.727947 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:45:47.727947 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 600/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:47.729705 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa109d-0502-47e2-9276-71f58db73641 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:47.911846 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa109d-0502-47e2-9276-71f58db73641 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:47.974323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11e164-1284-4af6-8555-43d869773224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:47.975748 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11e164-1284-4af6-8555-43d869773224 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:47.976754 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11e164-1284-4af6-8555-43d869773224 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:47.977642 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11e164-1284-4af6-8555-43d869773224 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:47.980025 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11e164-1284-4af6-8555-43d869773224 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:47.981146 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11e164-1284-4af6-8555-43d869773224 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:47.984986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11e164-1284-4af6-8555-43d869773224 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:48.030155 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 613/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Sun Oct 2 00:45:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:48.039884 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba66b9-c0a3-47e2-8682-36bd83e9f9f2 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:48.230510 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba66b9-c0a3-47e2-8682-36bd83e9f9f2 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:48.293510 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089835a-c39d-47d5-9efa-ad8d0a640e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:48.294707 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089835a-c39d-47d5-9efa-ad8d0a640e83 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:48.295293 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089835a-c39d-47d5-9efa-ad8d0a640e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:48.295876 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089835a-c39d-47d5-9efa-ad8d0a640e83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:48.338968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:48.395074 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089835a-c39d-47d5-9efa-ad8d0a640e83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:48.396566 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089835a-c39d-47d5-9efa-ad8d0a640e83 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:48.561151 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 601/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 02 00:45:48.563427 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11e164-1284-4af6-8555-43d869773224 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:48.587227 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:48.716695 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11e164-1284-4af6-8555-43d869773224 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:48.777156 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e7405-825f-414b-99fb-94d59d24b183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:48.778240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e7405-825f-414b-99fb-94d59d24b183 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:48.778240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e7405-825f-414b-99fb-94d59d24b183 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:48.778523 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e7405-825f-414b-99fb-94d59d24b183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:48.793205 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e7405-825f-414b-99fb-94d59d24b183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:48.795186 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e7405-825f-414b-99fb-94d59d24b183 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:48.816956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-049e7405-825f-414b-99fb-94d59d24b183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:48.816956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:48.816956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:48.816956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:48.816956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:48.816956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:48.816956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:48.816956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:48.816956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:48.816956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:48.816956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:48.816956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:48.816956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:48.816956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:48.816956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:48.816956 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:48.818845 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:48.818845 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:48.818845 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:48.818845 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:48.818845 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:48.818845 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:48.818845 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:48.818845 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:48.818845 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:48.818845 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:48.818845 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:48.818845 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:48.818845 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:48.818845 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:48.818845 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:48.818845 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:48.818845 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:48.820720 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:48.820720 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:48.820720 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:45:48.820720 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 614/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:48.826986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089835a-c39d-47d5-9efa-ad8d0a640e83 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:48.956802 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:49.056725 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089835a-c39d-47d5-9efa-ad8d0a640e83 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:49.128395 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe960e9-c5f6-47e2-920c-f75b54e16d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:49.129662 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe960e9-c5f6-47e2-920c-f75b54e16d63 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:49.130184 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe960e9-c5f6-47e2-920c-f75b54e16d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:49.130657 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe960e9-c5f6-47e2-920c-f75b54e16d63 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:49.131738 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe960e9-c5f6-47e2-920c-f75b54e16d63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:49.132303 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe960e9-c5f6-47e2-920c-f75b54e16d63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:49.134537 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe960e9-c5f6-47e2-920c-f75b54e16d63 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:49.166102 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 602/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:49.172551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e7405-825f-414b-99fb-94d59d24b183 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:49.302107 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:49.341591 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e7405-825f-414b-99fb-94d59d24b183 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:49.397901 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75867b0-6514-47c1-9094-74a0c9459378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:49.398992 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75867b0-6514-47c1-9094-74a0c9459378 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:49.399556 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75867b0-6514-47c1-9094-74a0c9459378 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:49.400029 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75867b0-6514-47c1-9094-74a0c9459378 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:49.415703 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75867b0-6514-47c1-9094-74a0c9459378 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:49.418516 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75867b0-6514-47c1-9094-74a0c9459378 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:49.432766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f75867b0-6514-47c1-9094-74a0c9459378 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:49.432766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:49.432766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:49.432766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:49.432766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:49.432766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:49.432766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:49.432766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:49.432766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:49.432766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:49.432766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:49.432766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:49.432766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:49.432766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:49.432766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:49.434121 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:49.434121 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:49.434121 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:49.434121 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:49.434121 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:49.434121 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:49.434121 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:49.434121 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:49.434121 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:49.434121 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:49.434121 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:49.434121 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:49.434121 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:49.434121 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:49.434121 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:49.434121 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:49.434121 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:49.435641 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:49.435641 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:49.435641 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:49.435641 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:49.435641 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:49.435641 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:49.435641 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:49.435641 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:45:49.435641 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 615/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:49.444767 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe960e9-c5f6-47e2-920c-f75b54e16d63 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:49.584060 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe960e9-c5f6-47e2-920c-f75b54e16d63 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:49.612440 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:49.629236 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e7a82-6019-44f6-aa75-5b2472e93cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:49.630102 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e7a82-6019-44f6-aa75-5b2472e93cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:49.630313 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e7a82-6019-44f6-aa75-5b2472e93cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:49.630610 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e7a82-6019-44f6-aa75-5b2472e93cb1 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:49.631381 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e7a82-6019-44f6-aa75-5b2472e93cb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:49.631721 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e7a82-6019-44f6-aa75-5b2472e93cb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:49.633242 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e7a82-6019-44f6-aa75-5b2472e93cb1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:49.648627 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 603/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:49.655102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75867b0-6514-47c1-9094-74a0c9459378 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:49.774840 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75867b0-6514-47c1-9094-74a0c9459378 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:49.819087 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:49.828249 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36ed87-ce21-437a-b6cc-d6b47f9552d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:49.829124 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36ed87-ce21-437a-b6cc-d6b47f9552d0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:49.829414 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36ed87-ce21-437a-b6cc-d6b47f9552d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:49.829730 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36ed87-ce21-437a-b6cc-d6b47f9552d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:49.831414 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36ed87-ce21-437a-b6cc-d6b47f9552d0 None admin] RBAC: Adding query filter params (role.id=714239b608694824a75962d8cbb39f70, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=a78481cceebd4138b893eba7e51c9c5b) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:49.831846 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36ed87-ce21-437a-b6cc-d6b47f9552d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:49.834426 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36ed87-ce21-437a-b6cc-d6b47f9552d0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:49.856979 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 616/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:45:49 2022] GET /identity/v3/role_assignments?user.id=a78481cceebd4138b893eba7e51c9c5b&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=714239b608694824a75962d8cbb39f70 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:52.273831 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b4921-7bde-41c0-bc72-abb11fe33bc1 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:52.274410 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b4921-7bde-41c0-bc72-abb11fe33bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:52.274410 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b4921-7bde-41c0-bc72-abb11fe33bc1 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:52.275927 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 604/1220] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:52.281793 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054e439-6706-4fc7-993e-14f0877036ac None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:52.282311 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054e439-6706-4fc7-993e-14f0877036ac None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:52.282403 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054e439-6706-4fc7-993e-14f0877036ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:52.306399 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7054e439-6706-4fc7-993e-14f0877036ac None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:52.307793 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7054e439-6706-4fc7-993e-14f0877036ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:52.401811 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 617/1221] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:45:52.710436 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b4921-7bde-41c0-bc72-abb11fe33bc1 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:52.858959 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b4921-7bde-41c0-bc72-abb11fe33bc1 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:52.918423 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425b52d-4043-4988-a1cd-43c32a3d048f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:52.919141 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425b52d-4043-4988-a1cd-43c32a3d048f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:52.919415 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425b52d-4043-4988-a1cd-43c32a3d048f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:52.919686 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425b52d-4043-4988-a1cd-43c32a3d048f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:52.934112 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425b52d-4043-4988-a1cd-43c32a3d048f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:52.939924 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-4425b52d-4043-4988-a1cd-43c32a3d048f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:52.939924 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:52.939924 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:52.939924 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:52.939924 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:52.939924 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:52.939924 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:52.939924 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:52.939924 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:52.939924 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:52.939924 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:52.939924 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:52.939924 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:52.939924 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:52.939924 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:52.939924 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:52.941362 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:52.941362 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:52.941362 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:52.941362 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:52.941362 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:52.941362 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:52.941362 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:52.941362 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:52.941362 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:52.941362 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:52.941362 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:52.941362 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:52.941362 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:52.941362 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:52.941362 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:52.941362 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:52.942253 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:52.942253 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:52.942253 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:52.942253 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:52.942253 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:52.942253 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:52.942253 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:52.942253 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:52.942253 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:52.942253 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:52.942253 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:52.942253 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:45:52.942253 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 605/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:52.948031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054e439-6706-4fc7-993e-14f0877036ac None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:53.076978 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054e439-6706-4fc7-993e-14f0877036ac None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:53.105320 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:53.122276 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c6624-27ba-4a4c-97e3-2d5ed4cd8f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:53.123280 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c6624-27ba-4a4c-97e3-2d5ed4cd8f3e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:53.123734 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c6624-27ba-4a4c-97e3-2d5ed4cd8f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:53.124215 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c6624-27ba-4a4c-97e3-2d5ed4cd8f3e None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:53.125503 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c6624-27ba-4a4c-97e3-2d5ed4cd8f3e None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:53.125950 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c6624-27ba-4a4c-97e3-2d5ed4cd8f3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:53.128366 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c6624-27ba-4a4c-97e3-2d5ed4cd8f3e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:53.141655 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 618/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:53.149257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425b52d-4043-4988-a1cd-43c32a3d048f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:53.214408 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:53.297450 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425b52d-4043-4988-a1cd-43c32a3d048f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:53.353967 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33551fab-8790-4395-9c30-fe377e380f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:53.354771 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33551fab-8790-4395-9c30-fe377e380f02 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:53.355058 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33551fab-8790-4395-9c30-fe377e380f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:53.355359 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33551fab-8790-4395-9c30-fe377e380f02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:53.371263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33551fab-8790-4395-9c30-fe377e380f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:53.373284 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33551fab-8790-4395-9c30-fe377e380f02 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:53.390941 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-33551fab-8790-4395-9c30-fe377e380f02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:53.390941 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:53.390941 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:53.390941 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:53.390941 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:53.390941 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:53.390941 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:53.390941 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:53.390941 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:53.390941 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:53.390941 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:53.390941 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:53.390941 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:53.390941 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:53.390941 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:53.390941 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:53.393902 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:53.393902 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:53.393902 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:53.393902 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:53.393902 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:53.393902 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:53.393902 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:53.393902 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:53.393902 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:53.393902 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:53.393902 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:53.393902 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:53.393902 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:53.393902 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:53.393902 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:53.393902 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:53.393902 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:53.396000 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:53.396000 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:53.396000 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:45:53.397393 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 606/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:45:53.398556 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c6624-27ba-4a4c-97e3-2d5ed4cd8f3e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:53.522874 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c6624-27ba-4a4c-97e3-2d5ed4cd8f3e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:53.572464 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836797aa-e842-43fb-981b-73df87702c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:53.573119 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836797aa-e842-43fb-981b-73df87702c7d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:53.573396 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836797aa-e842-43fb-981b-73df87702c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:53.573662 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836797aa-e842-43fb-981b-73df87702c7d None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:53.574319 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836797aa-e842-43fb-981b-73df87702c7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:53.574669 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836797aa-e842-43fb-981b-73df87702c7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:53.576181 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836797aa-e842-43fb-981b-73df87702c7d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:53.590809 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 619/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:53.597825 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33551fab-8790-4395-9c30-fe377e380f02 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:53.734603 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:53.744027 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33551fab-8790-4395-9c30-fe377e380f02 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:53.792899 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df78d2-4502-4460-b8f7-3b0806c5c6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:53.793676 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df78d2-4502-4460-b8f7-3b0806c5c6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:53.793999 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df78d2-4502-4460-b8f7-3b0806c5c6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:53.794352 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df78d2-4502-4460-b8f7-3b0806c5c6a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:53.804399 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df78d2-4502-4460-b8f7-3b0806c5c6a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:53.805914 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df78d2-4502-4460-b8f7-3b0806c5c6a9 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:53.826960 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-01df78d2-4502-4460-b8f7-3b0806c5c6a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:45:53.826960 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:53.826960 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:53.826960 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:53.826960 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:53.826960 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:53.826960 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:53.826960 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:53.826960 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:53.826960 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:53.826960 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:53.826960 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:53.826960 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:53.826960 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:53.826960 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:53.826960 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:53.828193 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:53.828193 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:53.828193 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:53.828193 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:53.828193 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:53.828193 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:53.828193 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:53.828193 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:53.828193 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:53.828193 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:53.828193 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:53.828193 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:53.828193 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:53.828193 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:53.828193 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:53.828193 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:53.828193 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:53.828193 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:53.829353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:53.829353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:53.829353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:53.829353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:53.829353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:53.829353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:53.829353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:53.829353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:53.829353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:45:53.829353 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:45:53.830606 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 607/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:45:53.836898 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836797aa-e842-43fb-981b-73df87702c7d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:53.907823 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:53.990690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836797aa-e842-43fb-981b-73df87702c7d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:54.039917 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070300b-f5be-4657-b8b6-20f7576a2526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:54.040576 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070300b-f5be-4657-b8b6-20f7576a2526 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:54.041253 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070300b-f5be-4657-b8b6-20f7576a2526 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:54.041776 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070300b-f5be-4657-b8b6-20f7576a2526 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:54.042604 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070300b-f5be-4657-b8b6-20f7576a2526 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:54.042996 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070300b-f5be-4657-b8b6-20f7576a2526 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:54.044548 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070300b-f5be-4657-b8b6-20f7576a2526 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:54.069662 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 620/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Sun Oct 2 00:45:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:54.077060 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df78d2-4502-4460-b8f7-3b0806c5c6a9 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:54.241347 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df78d2-4502-4460-b8f7-3b0806c5c6a9 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:54.287462 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa3266-93e2-4b30-8eb3-01dc3d493f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:54.288408 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa3266-93e2-4b30-8eb3-01dc3d493f79 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:54.288860 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa3266-93e2-4b30-8eb3-01dc3d493f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:54.289220 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa3266-93e2-4b30-8eb3-01dc3d493f79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:54.304243 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa3266-93e2-4b30-8eb3-01dc3d493f79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:54.306948 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa3266-93e2-4b30-8eb3-01dc3d493f79 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:54.325611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-a7fa3266-93e2-4b30-8eb3-01dc3d493f79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:54.325611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:54.325611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:54.325611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:54.325611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:54.325611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:54.325611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:54.325611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:54.325611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:54.325611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:54.325611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:54.325611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:54.325611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:54.325611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:54.325611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:54.325611 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:54.327346 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:54.327346 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:54.327346 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:54.327346 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:54.327346 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:54.327346 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:54.327346 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:54.327346 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:54.327346 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:54.327346 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:54.327346 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:54.327346 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:54.327346 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:54.327346 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:54.327346 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:54.327346 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:54.327346 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:54.330898 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:54.330898 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:54.330898 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:45:54.330898 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 608/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:54.335668 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070300b-f5be-4657-b8b6-20f7576a2526 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:54.482947 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070300b-f5be-4657-b8b6-20f7576a2526 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:54.486190 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:54.530625 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3110460-0559-448c-8270-0b6e5e3afa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:54.531554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3110460-0559-448c-8270-0b6e5e3afa1f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:54.532034 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3110460-0559-448c-8270-0b6e5e3afa1f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:54.532453 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3110460-0559-448c-8270-0b6e5e3afa1f None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:54.534464 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3110460-0559-448c-8270-0b6e5e3afa1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:54.534464 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3110460-0559-448c-8270-0b6e5e3afa1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:54.536540 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3110460-0559-448c-8270-0b6e5e3afa1f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:54.552974 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 621/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:54.558884 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa3266-93e2-4b30-8eb3-01dc3d493f79 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:54.569896 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:54.706986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa3266-93e2-4b30-8eb3-01dc3d493f79 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:54.754579 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3128b-237b-4f69-be7d-bf9e84d3ae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:54.755305 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3128b-237b-4f69-be7d-bf9e84d3ae08 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:54.755766 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3128b-237b-4f69-be7d-bf9e84d3ae08 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:54.756012 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3128b-237b-4f69-be7d-bf9e84d3ae08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:54.766096 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3128b-237b-4f69-be7d-bf9e84d3ae08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:54.768627 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3128b-237b-4f69-be7d-bf9e84d3ae08 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:54.782717 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-bdb3128b-237b-4f69-be7d-bf9e84d3ae08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:54.782717 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:54.782717 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:54.782717 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:54.782717 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:54.782717 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:54.782717 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:54.782717 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:54.782717 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:54.782717 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:54.782717 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:54.782717 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:54.782717 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:54.782717 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:54.782717 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:54.784620 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:54.784620 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:54.784620 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:54.784620 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:54.784620 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:54.784620 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:54.784620 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:54.784620 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:54.784620 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:54.784620 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:54.784620 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:54.784620 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:54.784620 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:54.784620 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:54.784620 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:54.784620 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:54.784620 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:54.785901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:54.785901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:54.785901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:54.785901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:54.785901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:54.785901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:54.785901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:54.785901 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:45:54.785901 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 609/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:54.796824 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3110460-0559-448c-8270-0b6e5e3afa1f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:54.931628 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3110460-0559-448c-8270-0b6e5e3afa1f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:54.973676 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bdf1c-514b-4ba9-be27-e4233f216287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:54.974295 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bdf1c-514b-4ba9-be27-e4233f216287 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:54.974571 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bdf1c-514b-4ba9-be27-e4233f216287 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:54.974903 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bdf1c-514b-4ba9-be27-e4233f216287 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:54.975705 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bdf1c-514b-4ba9-be27-e4233f216287 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:54.975980 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bdf1c-514b-4ba9-be27-e4233f216287 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:54.977538 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bdf1c-514b-4ba9-be27-e4233f216287 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:54.995281 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 622/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:55.002572 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3128b-237b-4f69-be7d-bf9e84d3ae08 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:55.105191 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:55.157155 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3128b-237b-4f69-be7d-bf9e84d3ae08 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:55.213695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e27c5-627e-497d-8e86-9fda95fc6682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:55.214369 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e27c5-627e-497d-8e86-9fda95fc6682 None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:55.214654 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e27c5-627e-497d-8e86-9fda95fc6682 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:55.214929 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e27c5-627e-497d-8e86-9fda95fc6682 None admin] PATH_INFO: `/v3/projects/7aec935005514f808eb735bfb01fee6e/users/a78481cceebd4138b893eba7e51c9c5b/roles/714239b608694824a75962d8cbb39f70` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:55.232703 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e27c5-627e-497d-8e86-9fda95fc6682 None admin] RBAC: Authorizing `identity:create_grant(project_id=7aec935005514f808eb735bfb01fee6e, user_id=a78481cceebd4138b893eba7e51c9c5b, role_id=714239b608694824a75962d8cbb39f70)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:55.234576 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e27c5-627e-497d-8e86-9fda95fc6682 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:55.250162 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 610/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:45:55 2022] PUT /identity/v3/projects/7aec935005514f808eb735bfb01fee6e/users/a78481cceebd4138b893eba7e51c9c5b/roles/714239b608694824a75962d8cbb39f70 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:45:57.706722 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe76a25-d516-46a6-8c17-7f455210f61e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:57.706722 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe76a25-d516-46a6-8c17-7f455210f61e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:57.706722 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe76a25-d516-46a6-8c17-7f455210f61e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:57.708244 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 623/1233] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:45:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:57.717899 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc43ee3-3436-4d1f-b96d-8477e06a1c8d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:57.718705 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc43ee3-3436-4d1f-b96d-8477e06a1c8d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:57.719327 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc43ee3-3436-4d1f-b96d-8477e06a1c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:57.745750 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-2dc43ee3-3436-4d1f-b96d-8477e06a1c8d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:57.746986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2dc43ee3-3436-4d1f-b96d-8477e06a1c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:57.842350 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 611/1234] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:45:58.190389 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe76a25-d516-46a6-8c17-7f455210f61e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:58.232635 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:58.338610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe76a25-d516-46a6-8c17-7f455210f61e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:58.392488 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b7e4c-b7d6-467d-98a7-be3b6b31fdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:58.393247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b7e4c-b7d6-467d-98a7-be3b6b31fdcd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:58.393552 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b7e4c-b7d6-467d-98a7-be3b6b31fdcd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:58.393805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b7e4c-b7d6-467d-98a7-be3b6b31fdcd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:58.408916 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b7e4c-b7d6-467d-98a7-be3b6b31fdcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:58.413774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-3c2b7e4c-b7d6-467d-98a7-be3b6b31fdcd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:58.413774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:58.413774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:58.413774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:58.413774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:58.413774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:58.413774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:58.413774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:58.413774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:58.413774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:58.413774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:58.413774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:58.413774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:58.413774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:58.413774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:58.413774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:58.415008 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:58.415008 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:58.415008 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:58.415008 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:58.415008 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:58.415008 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:58.415008 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:58.415008 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:58.415008 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:58.415008 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:58.415008 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:58.415008 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:58.415008 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:58.415008 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:58.415008 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:58.415008 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:58.416194 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:58.416194 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:58.416194 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:58.416194 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:58.416194 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:58.416194 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:58.416194 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:58.416194 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:58.416194 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:58.416194 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:58.416194 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:58.416194 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:45:58.416194 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 624/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:58.421121 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc43ee3-3436-4d1f-b96d-8477e06a1c8d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:58.480549 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:58.546565 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc43ee3-3436-4d1f-b96d-8477e06a1c8d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:58.593919 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2f7b4-ea07-45b4-95e8-104b1afa4107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:58.594546 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2f7b4-ea07-45b4-95e8-104b1afa4107 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:58.594825 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2f7b4-ea07-45b4-95e8-104b1afa4107 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:58.595097 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2f7b4-ea07-45b4-95e8-104b1afa4107 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:58.595894 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2f7b4-ea07-45b4-95e8-104b1afa4107 None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:58.596404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2f7b4-ea07-45b4-95e8-104b1afa4107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:58.597924 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2f7b4-ea07-45b4-95e8-104b1afa4107 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:58.607672 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 612/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:58.614156 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b7e4c-b7d6-467d-98a7-be3b6b31fdcd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:58.729337 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:58.751314 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b7e4c-b7d6-467d-98a7-be3b6b31fdcd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:58.800702 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1fc17-e7d1-489d-be2b-0575c6ff3ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:58.801363 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1fc17-e7d1-489d-be2b-0575c6ff3ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:58.801642 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1fc17-e7d1-489d-be2b-0575c6ff3ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:58.802015 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1fc17-e7d1-489d-be2b-0575c6ff3ed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:58.815267 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1fc17-e7d1-489d-be2b-0575c6ff3ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:58.816930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1fc17-e7d1-489d-be2b-0575c6ff3ed4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:58.845091 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-71a1fc17-e7d1-489d-be2b-0575c6ff3ed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:58.845091 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:58.845091 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:58.845091 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:58.845091 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:58.845091 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:58.845091 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:58.845091 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:58.845091 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:58.845091 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:58.845091 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:58.845091 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:58.845091 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:58.845091 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:58.845091 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:58.845091 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:58.847162 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:58.847162 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:58.847162 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:58.847162 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:58.847162 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:58.847162 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:58.847162 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:58.847162 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:58.847162 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:58.847162 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:58.847162 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:58.847162 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:58.847162 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:58.847162 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:58.847162 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:58.847162 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:58.847162 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:58.848646 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:58.848646 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:58.848646 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:45:58.848646 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 625/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:45:58.853778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2f7b4-ea07-45b4-95e8-104b1afa4107 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:58.991302 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2f7b4-ea07-45b4-95e8-104b1afa4107 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:59.005567 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:59.048090 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bf590-51a6-4366-97f2-1de3e50c1fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:59.048836 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bf590-51a6-4366-97f2-1de3e50c1fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:59.049169 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bf590-51a6-4366-97f2-1de3e50c1fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:59.049580 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bf590-51a6-4366-97f2-1de3e50c1fe4 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:59.050728 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bf590-51a6-4366-97f2-1de3e50c1fe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:59.051093 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bf590-51a6-4366-97f2-1de3e50c1fe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:59.053380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bf590-51a6-4366-97f2-1de3e50c1fe4 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:59.070736 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 613/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:59.077822 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1fc17-e7d1-489d-be2b-0575c6ff3ed4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:59.207349 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1fc17-e7d1-489d-be2b-0575c6ff3ed4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:59.245174 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cfd69-c36d-44d4-becf-82f4f0267486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:59.245880 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cfd69-c36d-44d4-becf-82f4f0267486 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:59.246210 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cfd69-c36d-44d4-becf-82f4f0267486 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:59.246490 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cfd69-c36d-44d4-becf-82f4f0267486 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:59.250596 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:59.260514 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588cfd69-c36d-44d4-becf-82f4f0267486 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:59.262264 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588cfd69-c36d-44d4-becf-82f4f0267486 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:59.276094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-588cfd69-c36d-44d4-becf-82f4f0267486 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:45:59.276094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:59.276094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:59.276094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:59.276094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:59.276094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:59.276094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:59.276094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:59.276094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:59.276094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:59.276094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:59.276094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:59.276094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:59.276094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:59.276094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:59.276094 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:59.277356 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:59.277356 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:59.277356 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:59.277356 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:59.277356 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:59.277356 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:59.277356 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:59.277356 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:59.277356 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:59.277356 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:59.277356 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:59.277356 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:59.277356 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:59.277356 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:59.277356 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:59.277356 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:59.277356 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:59.277356 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:59.283623 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:59.283623 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:59.283623 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:59.283623 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:59.283623 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:59.283623 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:59.283623 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:59.283623 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:59.283623 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:45:59.283623 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:45:59.283623 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 626/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:59.284603 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bf590-51a6-4366-97f2-1de3e50c1fe4 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:59.426210 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bf590-51a6-4366-97f2-1de3e50c1fe4 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:59.469074 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2339f7-0683-472f-8b8a-854b6d1b1149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:59.469811 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2339f7-0683-472f-8b8a-854b6d1b1149 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:59.470062 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2339f7-0683-472f-8b8a-854b6d1b1149 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:59.470916 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2339f7-0683-472f-8b8a-854b6d1b1149 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:59.471742 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2339f7-0683-472f-8b8a-854b6d1b1149 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:59.472135 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2339f7-0683-472f-8b8a-854b6d1b1149 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:59.473830 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2339f7-0683-472f-8b8a-854b6d1b1149 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:59.502396 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 614/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Sun Oct 2 00:45:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:59.508461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cfd69-c36d-44d4-becf-82f4f0267486 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:59.669657 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cfd69-c36d-44d4-becf-82f4f0267486 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:59.722081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6746d8-28e8-4e05-9e2e-c6933df3d0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:59.722744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6746d8-28e8-4e05-9e2e-c6933df3d0ec None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:59.723103 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6746d8-28e8-4e05-9e2e-c6933df3d0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:59.723375 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6746d8-28e8-4e05-9e2e-c6933df3d0ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:59.805758 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:59.814649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6746d8-28e8-4e05-9e2e-c6933df3d0ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:59.816798 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6746d8-28e8-4e05-9e2e-c6933df3d0ec None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:59.952224 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 627/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:45:59.959885 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2339f7-0683-472f-8b8a-854b6d1b1149 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:59.989059 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:00.114580 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2339f7-0683-472f-8b8a-854b6d1b1149 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:00.168122 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c93a4-5260-4cb7-b1ae-631f69098f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:00.168763 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c93a4-5260-4cb7-b1ae-631f69098f3d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:00.169080 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c93a4-5260-4cb7-b1ae-631f69098f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:00.169351 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c93a4-5260-4cb7-b1ae-631f69098f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:00.185278 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c93a4-5260-4cb7-b1ae-631f69098f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:00.186774 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c93a4-5260-4cb7-b1ae-631f69098f3d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:00.203435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-4d9c93a4-5260-4cb7-b1ae-631f69098f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:00.203435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:00.203435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:00.203435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:00.203435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:00.203435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:00.203435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:00.203435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:00.203435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:00.203435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:00.203435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:00.203435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:00.203435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:00.203435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:00.203435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:00.203435 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:00.206125 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:00.206125 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:00.206125 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:00.206125 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:00.206125 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:00.206125 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:00.206125 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:00.206125 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:00.206125 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:00.206125 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:00.206125 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:00.206125 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:00.206125 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:00.206125 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:00.206125 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:00.206125 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:00.206125 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:00.207429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:00.207429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:00.207429 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:46:00.207429 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 615/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:00.212307 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6746d8-28e8-4e05-9e2e-c6933df3d0ec None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:00.334873 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:00.341919 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6746d8-28e8-4e05-9e2e-c6933df3d0ec None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:00.384995 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e76c9-1392-46bf-8a3b-68ecdb052681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:00.385878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e76c9-1392-46bf-8a3b-68ecdb052681 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:00.386153 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e76c9-1392-46bf-8a3b-68ecdb052681 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:00.386425 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e76c9-1392-46bf-8a3b-68ecdb052681 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:00.387117 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e76c9-1392-46bf-8a3b-68ecdb052681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:00.387656 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e76c9-1392-46bf-8a3b-68ecdb052681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:00.389514 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e76c9-1392-46bf-8a3b-68ecdb052681 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:00.410620 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 628/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:00.416748 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c93a4-5260-4cb7-b1ae-631f69098f3d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:00.533219 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:00.559334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c93a4-5260-4cb7-b1ae-631f69098f3d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:00.605267 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b887f-5622-4682-b16e-9cb1bb7489f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:00.606063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b887f-5622-4682-b16e-9cb1bb7489f2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:00.606470 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b887f-5622-4682-b16e-9cb1bb7489f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:00.606847 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b887f-5622-4682-b16e-9cb1bb7489f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:00.616466 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b887f-5622-4682-b16e-9cb1bb7489f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:00.618249 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b887f-5622-4682-b16e-9cb1bb7489f2 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:00.635656 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-5c3b887f-5622-4682-b16e-9cb1bb7489f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:00.635656 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:00.635656 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:00.635656 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:00.635656 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:00.635656 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:00.635656 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:00.635656 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:00.635656 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:00.635656 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:00.635656 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:00.635656 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:00.635656 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:46:00.635656 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:46:00.635656 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:46:00.637216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:46:00.637216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:00.637216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:00.637216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:00.637216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:00.637216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:00.637216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:00.637216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:00.637216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:00.637216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:00.637216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:00.637216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:00.637216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:00.637216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:00.637216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:00.637216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:00.637216 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:00.638628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:46:00.638628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:46:00.638628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:46:00.638628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:46:00.638628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:46:00.638628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:46:00.638628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:00.638628 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:46:00.638628 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 616/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:46:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:46:00.644526 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e76c9-1392-46bf-8a3b-68ecdb052681 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:00.781845 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e76c9-1392-46bf-8a3b-68ecdb052681 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:00.826277 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189d299-d570-40dd-972a-724c58451d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:00.827199 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189d299-d570-40dd-972a-724c58451d6a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:00.827686 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189d299-d570-40dd-972a-724c58451d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:00.828161 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189d299-d570-40dd-972a-724c58451d6a None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:00.829831 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e189d299-d570-40dd-972a-724c58451d6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:00.830757 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e189d299-d570-40dd-972a-724c58451d6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:00.833967 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e189d299-d570-40dd-972a-724c58451d6a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:00.851322 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 629/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:46:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:00.859394 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b887f-5622-4682-b16e-9cb1bb7489f2 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:01.003992 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b887f-5622-4682-b16e-9cb1bb7489f2 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:01.053233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148a618-b1a0-4a1e-a90b-2b313141292d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:01.053849 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148a618-b1a0-4a1e-a90b-2b313141292d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:01.054128 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148a618-b1a0-4a1e-a90b-2b313141292d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:01.054402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148a618-b1a0-4a1e-a90b-2b313141292d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:01.055154 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148a618-b1a0-4a1e-a90b-2b313141292d None admin] RBAC: Adding query filter params (role.id=714239b608694824a75962d8cbb39f70, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=a78481cceebd4138b893eba7e51c9c5b) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:01.055463 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148a618-b1a0-4a1e-a90b-2b313141292d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:01.056953 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148a618-b1a0-4a1e-a90b-2b313141292d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:01.063703 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 617/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:46:00 2022] GET /identity/v3/role_assignments?user.id=a78481cceebd4138b893eba7e51c9c5b&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=714239b608694824a75962d8cbb39f70 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:03.711518 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d054a1-3943-4497-9a11-58d3d0fa0093 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:03.712335 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d054a1-3943-4497-9a11-58d3d0fa0093 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:03.712335 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d054a1-3943-4497-9a11-58d3d0fa0093 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:03.714017 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 630/1247] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:03.722585 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4a2b8-2cee-4fe1-8dfb-b28b9571278e None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:03.723214 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4a2b8-2cee-4fe1-8dfb-b28b9571278e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:03.723214 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4a2b8-2cee-4fe1-8dfb-b28b9571278e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:03.730685 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:03.746530 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a8b4a2b8-2cee-4fe1-8dfb-b28b9571278e None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:03.747825 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a8b4a2b8-2cee-4fe1-8dfb-b28b9571278e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:03.842347 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 618/1248] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:04.149699 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d054a1-3943-4497-9a11-58d3d0fa0093 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:04.176523 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:04.292861 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d054a1-3943-4497-9a11-58d3d0fa0093 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:04.336741 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7c8ee-3bd1-4447-bbe1-a960014f8c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:04.337528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7c8ee-3bd1-4447-bbe1-a960014f8c3f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:04.337852 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7c8ee-3bd1-4447-bbe1-a960014f8c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:04.338365 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7c8ee-3bd1-4447-bbe1-a960014f8c3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:04.354056 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7c8ee-3bd1-4447-bbe1-a960014f8c3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:46:04.359259 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-26f7c8ee-3bd1-4447-bbe1-a960014f8c3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:46:04.359259 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:04.359259 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:04.359259 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:04.359259 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:04.359259 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:04.359259 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:04.359259 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:04.359259 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:04.359259 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:04.359259 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:04.359259 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:04.359259 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:46:04.359259 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:46:04.359259 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:46:04.359259 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:46:04.360317 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:46:04.360317 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:46:04.360317 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:46:04.360317 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:46:04.360317 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:04.360317 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:04.360317 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:04.360317 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:04.360317 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:04.360317 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:04.360317 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:04.360317 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:04.360317 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:04.360317 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:04.360317 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:04.360317 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:04.361278 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:04.361278 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:04.361278 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:04.361278 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:04.361278 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:46:04.361278 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:46:04.361278 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:46:04.361278 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:46:04.361278 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:46:04.361278 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:46:04.361278 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:46:04.361278 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:46:04.361278 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 631/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:46:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:04.367139 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4a2b8-2cee-4fe1-8dfb-b28b9571278e None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:04.503232 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4a2b8-2cee-4fe1-8dfb-b28b9571278e None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:04.542971 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:04.551445 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364ea68-6288-46c3-8994-b0cdc14ea8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:04.552531 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364ea68-6288-46c3-8994-b0cdc14ea8ec None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:04.553033 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364ea68-6288-46c3-8994-b0cdc14ea8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:04.553483 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364ea68-6288-46c3-8994-b0cdc14ea8ec None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:04.554486 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364ea68-6288-46c3-8994-b0cdc14ea8ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:04.554964 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364ea68-6288-46c3-8994-b0cdc14ea8ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:04.557068 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364ea68-6288-46c3-8994-b0cdc14ea8ec None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:04.570667 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 619/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:46:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:04.578133 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7c8ee-3bd1-4447-bbe1-a960014f8c3f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:04.696761 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:04.724553 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7c8ee-3bd1-4447-bbe1-a960014f8c3f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:04.773423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee2cfd-ac7a-4905-a5c1-478c4781baea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:04.774362 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee2cfd-ac7a-4905-a5c1-478c4781baea None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:04.774938 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee2cfd-ac7a-4905-a5c1-478c4781baea None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:04.775321 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee2cfd-ac7a-4905-a5c1-478c4781baea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:04.789582 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee2cfd-ac7a-4905-a5c1-478c4781baea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:04.791418 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee2cfd-ac7a-4905-a5c1-478c4781baea None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:04.807707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f4ee2cfd-ac7a-4905-a5c1-478c4781baea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:04.807707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:04.807707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:04.807707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:04.807707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:04.807707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:04.807707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:04.807707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:04.807707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:04.807707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:04.807707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:04.807707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:04.807707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:04.807707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:04.807707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:04.807707 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:04.809702 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:04.809702 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:04.809702 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:04.809702 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:04.809702 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:04.809702 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:04.809702 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:04.809702 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:04.809702 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:04.809702 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:04.809702 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:04.809702 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:04.809702 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:04.809702 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:04.809702 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:04.809702 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:04.809702 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:04.811456 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:04.811456 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:04.811456 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:46:04.811456 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 632/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:04.817385 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364ea68-6288-46c3-8994-b0cdc14ea8ec None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:04.976358 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364ea68-6288-46c3-8994-b0cdc14ea8ec None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:05.027547 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2eebc-f1ac-4105-af26-ade0f457190d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:05.028894 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2eebc-f1ac-4105-af26-ade0f457190d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:05.029588 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2eebc-f1ac-4105-af26-ade0f457190d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:05.030809 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2eebc-f1ac-4105-af26-ade0f457190d None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:05.031065 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2eebc-f1ac-4105-af26-ade0f457190d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:05.031573 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2eebc-f1ac-4105-af26-ade0f457190d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:05.034161 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2eebc-f1ac-4105-af26-ade0f457190d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:05.053883 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 620/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:05.061182 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee2cfd-ac7a-4905-a5c1-478c4781baea None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:05.209847 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee2cfd-ac7a-4905-a5c1-478c4781baea None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:05.248386 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:05.261101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ba85f-912b-409d-b61d-ea7d7f866956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:05.261842 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ba85f-912b-409d-b61d-ea7d7f866956 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:05.262160 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ba85f-912b-409d-b61d-ea7d7f866956 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:05.262582 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ba85f-912b-409d-b61d-ea7d7f866956 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:05.272452 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ba85f-912b-409d-b61d-ea7d7f866956 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:05.274161 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ba85f-912b-409d-b61d-ea7d7f866956 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:05.288895 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d19ba85f-912b-409d-b61d-ea7d7f866956 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:46:05.288895 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:05.288895 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:05.288895 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:05.288895 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:05.288895 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:05.288895 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:05.288895 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:05.288895 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:05.288895 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:05.288895 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:05.288895 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:05.288895 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:46:05.288895 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:46:05.288895 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:46:05.288895 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:46:05.291910 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:05.291910 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:05.291910 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:46:05.291910 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:05.291910 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:46:05.291910 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:05.291910 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:05.291910 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:05.291910 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:05.291910 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:05.291910 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:05.291910 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:05.291910 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:05.291910 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:05.291910 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:05.291910 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:05.291910 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:05.291910 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:05.292917 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:05.292917 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:05.292917 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:46:05.292917 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:46:05.292917 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:46:05.292917 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:46:05.292917 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:46:05.292917 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:46:05.292917 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:46:05.292917 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:46:05.292917 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 633/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:05.297950 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2eebc-f1ac-4105-af26-ade0f457190d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:05.365686 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:05.430228 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2eebc-f1ac-4105-af26-ade0f457190d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:05.490319 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27358c69-84d3-4e4d-bc13-cd0d46d92a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:05.491163 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27358c69-84d3-4e4d-bc13-cd0d46d92a56 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:05.491635 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27358c69-84d3-4e4d-bc13-cd0d46d92a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:05.492121 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27358c69-84d3-4e4d-bc13-cd0d46d92a56 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:05.493579 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27358c69-84d3-4e4d-bc13-cd0d46d92a56 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:05.494172 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27358c69-84d3-4e4d-bc13-cd0d46d92a56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:05.496765 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27358c69-84d3-4e4d-bc13-cd0d46d92a56 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:05.525161 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 621/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Sun Oct 2 00:46:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:05.532218 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ba85f-912b-409d-b61d-ea7d7f866956 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:05.688668 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ba85f-912b-409d-b61d-ea7d7f866956 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:05.730326 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6273b5-da49-450a-ac6e-aacf48308858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:05.730999 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6273b5-da49-450a-ac6e-aacf48308858 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:05.731218 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6273b5-da49-450a-ac6e-aacf48308858 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:05.731536 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6273b5-da49-450a-ac6e-aacf48308858 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:05.807153 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:05.827899 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6273b5-da49-450a-ac6e-aacf48308858 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:05.830354 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6273b5-da49-450a-ac6e-aacf48308858 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:05.978235 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 634/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:46:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:46:05.986919 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27358c69-84d3-4e4d-bc13-cd0d46d92a56 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:06.119500 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27358c69-84d3-4e4d-bc13-cd0d46d92a56 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:06.136671 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:06.163988 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176319f-4094-4f33-96fc-a78fa49e847a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:06.164643 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176319f-4094-4f33-96fc-a78fa49e847a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:06.164924 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176319f-4094-4f33-96fc-a78fa49e847a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:06.165232 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176319f-4094-4f33-96fc-a78fa49e847a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:06.176979 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176319f-4094-4f33-96fc-a78fa49e847a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:06.178463 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176319f-4094-4f33-96fc-a78fa49e847a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:06.195608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-7176319f-4094-4f33-96fc-a78fa49e847a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:06.195608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:06.195608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:06.195608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:06.195608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:06.195608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:06.195608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:06.195608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:06.195608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:06.195608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:06.195608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:06.195608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:06.195608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:06.195608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:06.195608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:06.195608 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:06.196714 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:06.196714 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:06.196714 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:06.196714 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:06.196714 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:06.196714 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:06.196714 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:06.196714 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:06.196714 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:06.196714 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:06.196714 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:06.196714 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:06.196714 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:06.196714 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:06.196714 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:06.196714 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:06.196714 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:06.197763 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:06.197763 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:06.197763 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:46:06.197763 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 622/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:06.202996 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6273b5-da49-450a-ac6e-aacf48308858 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:06.328545 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:06.342591 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6273b5-da49-450a-ac6e-aacf48308858 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:06.385247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377fc83-006e-4101-a351-1c8c1b7c118a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:06.385782 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377fc83-006e-4101-a351-1c8c1b7c118a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:06.386062 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377fc83-006e-4101-a351-1c8c1b7c118a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:06.386326 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377fc83-006e-4101-a351-1c8c1b7c118a None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:06.386974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377fc83-006e-4101-a351-1c8c1b7c118a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:06.387869 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377fc83-006e-4101-a351-1c8c1b7c118a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:06.388855 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377fc83-006e-4101-a351-1c8c1b7c118a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:06.406100 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 635/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:06.413467 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176319f-4094-4f33-96fc-a78fa49e847a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:06.546695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176319f-4094-4f33-96fc-a78fa49e847a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:06.591732 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135434b8-8214-4d4e-98b2-acd5956be029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:06.592806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135434b8-8214-4d4e-98b2-acd5956be029 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:06.593265 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135434b8-8214-4d4e-98b2-acd5956be029 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:06.593620 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135434b8-8214-4d4e-98b2-acd5956be029 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:06.602918 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135434b8-8214-4d4e-98b2-acd5956be029 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:06.604428 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135434b8-8214-4d4e-98b2-acd5956be029 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:06.620366 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-135434b8-8214-4d4e-98b2-acd5956be029 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:06.620366 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:06.620366 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:06.620366 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:06.620366 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:06.620366 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:06.620366 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:06.620366 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:06.620366 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:06.620366 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:06.620366 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:06.620366 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:06.620366 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:46:06.620366 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:46:06.620366 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:46:06.621565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:46:06.621565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:06.621565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:06.621565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:06.621565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:06.621565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:06.621565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:06.621565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:06.621565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:06.621565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:06.621565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:06.621565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:06.621565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:06.621565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:06.621565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:06.621565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:06.621565 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:06.622685 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:46:06.622685 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:46:06.622685 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:46:06.622685 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:46:06.622685 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:46:06.622685 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:46:06.622685 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:06.622685 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:46:06.622685 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 623/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:46:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:06.631622 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377fc83-006e-4101-a351-1c8c1b7c118a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:06.754217 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377fc83-006e-4101-a351-1c8c1b7c118a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:06.795519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd52d1-228c-4a34-bcc7-b7aa3a6f5ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:06.796134 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd52d1-228c-4a34-bcc7-b7aa3a6f5ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:06.796413 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd52d1-228c-4a34-bcc7-b7aa3a6f5ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:06.796687 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd52d1-228c-4a34-bcc7-b7aa3a6f5ac5 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:06.797423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd52d1-228c-4a34-bcc7-b7aa3a6f5ac5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:06.797725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd52d1-228c-4a34-bcc7-b7aa3a6f5ac5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:06.800150 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd52d1-228c-4a34-bcc7-b7aa3a6f5ac5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:06.812927 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 636/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:46:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:06.819523 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135434b8-8214-4d4e-98b2-acd5956be029 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:06.848169 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:06.929721 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135434b8-8214-4d4e-98b2-acd5956be029 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:06.966552 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4da5a-787c-40b4-aa4c-b5ac74ae0d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:06.967206 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4da5a-787c-40b4-aa4c-b5ac74ae0d55 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:06.967546 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4da5a-787c-40b4-aa4c-b5ac74ae0d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:06.967867 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4da5a-787c-40b4-aa4c-b5ac74ae0d55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:06.968648 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4da5a-787c-40b4-aa4c-b5ac74ae0d55 None admin] RBAC: Adding query filter params (role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=a78481cceebd4138b893eba7e51c9c5b) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:06.969022 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4da5a-787c-40b4-aa4c-b5ac74ae0d55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:06.971066 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4da5a-787c-40b4-aa4c-b5ac74ae0d55 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:06.976823 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 624/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:46:06 2022] GET /identity/v3/role_assignments?user.id=a78481cceebd4138b893eba7e51c9c5b&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:09.477712 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35615ba8-aedb-4a93-8860-b30939402559 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:09.478238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35615ba8-aedb-4a93-8860-b30939402559 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:09.478238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35615ba8-aedb-4a93-8860-b30939402559 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:09.479592 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 637/1261] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:09.485061 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09286333-c8d3-4b82-82a4-1aa1294f7854 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:09.486088 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09286333-c8d3-4b82-82a4-1aa1294f7854 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:09.486237 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09286333-c8d3-4b82-82a4-1aa1294f7854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:09.508106 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-09286333-c8d3-4b82-82a4-1aa1294f7854 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:09.509353 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-09286333-c8d3-4b82-82a4-1aa1294f7854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:09.587233 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 625/1262] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:09.911448 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35615ba8-aedb-4a93-8860-b30939402559 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:09.923900 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:10.055889 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35615ba8-aedb-4a93-8860-b30939402559 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:10.094356 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd069f2-df1c-459c-b073-f1000d8f5e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:10.095642 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd069f2-df1c-459c-b073-f1000d8f5e0e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:10.095975 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd069f2-df1c-459c-b073-f1000d8f5e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:10.096233 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd069f2-df1c-459c-b073-f1000d8f5e0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:10.107622 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd069f2-df1c-459c-b073-f1000d8f5e0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:46:10.113076 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0fd069f2-df1c-459c-b073-f1000d8f5e0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:46:10.113076 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:10.113076 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:10.113076 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:10.113076 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:10.113076 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:10.113076 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:10.113076 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:10.113076 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:10.113076 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:10.113076 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:10.113076 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:10.113076 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:46:10.113076 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:46:10.113076 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:46:10.113076 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:46:10.114155 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:46:10.114155 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:46:10.114155 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:46:10.114155 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:46:10.114155 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:10.114155 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:10.114155 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:10.114155 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:10.114155 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:10.114155 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:10.114155 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:10.114155 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:10.114155 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:10.114155 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:10.114155 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:10.114155 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:10.115013 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:10.115013 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:10.115013 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:10.115013 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:10.115013 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:46:10.115013 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:46:10.115013 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:46:10.115013 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:46:10.115013 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:46:10.115013 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:46:10.115013 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:46:10.115013 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:46:10.115013 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 638/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:46:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:10.123922 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09286333-c8d3-4b82-82a4-1aa1294f7854 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:10.145458 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:10.247134 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09286333-c8d3-4b82-82a4-1aa1294f7854 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:10.289073 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1c6db-30bb-45e9-93b1-6f3d2c204431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:10.289685 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1c6db-30bb-45e9-93b1-6f3d2c204431 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:10.289963 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1c6db-30bb-45e9-93b1-6f3d2c204431 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:10.290233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1c6db-30bb-45e9-93b1-6f3d2c204431 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:10.290906 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1c6db-30bb-45e9-93b1-6f3d2c204431 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:10.291214 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1c6db-30bb-45e9-93b1-6f3d2c204431 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:10.292598 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1c6db-30bb-45e9-93b1-6f3d2c204431 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:10.303942 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 626/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:46:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:10.310527 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd069f2-df1c-459c-b073-f1000d8f5e0e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:10.389620 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:10.429351 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd069f2-df1c-459c-b073-f1000d8f5e0e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:10.468602 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f861c8-2a17-4de8-859a-b6b7fd8810fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:10.469261 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f861c8-2a17-4de8-859a-b6b7fd8810fd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:10.469541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f861c8-2a17-4de8-859a-b6b7fd8810fd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:10.469846 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f861c8-2a17-4de8-859a-b6b7fd8810fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:10.481786 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f861c8-2a17-4de8-859a-b6b7fd8810fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:10.483270 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f861c8-2a17-4de8-859a-b6b7fd8810fd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:10.500245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-91f861c8-2a17-4de8-859a-b6b7fd8810fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:10.500245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:10.500245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:10.500245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:10.500245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:10.500245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:10.500245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:10.500245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:10.500245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:10.500245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:10.500245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:10.500245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:10.500245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:10.500245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:10.500245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:10.500245 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:10.502718 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:10.502718 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:10.502718 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:10.502718 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:10.502718 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:10.502718 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:10.502718 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:10.502718 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:10.502718 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:10.502718 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:10.502718 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:10.502718 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:10.502718 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:10.502718 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:10.502718 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:10.502718 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:10.502718 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:10.504470 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:10.504470 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:10.504470 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:46:10.504470 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 639/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:10.508439 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1c6db-30bb-45e9-93b1-6f3d2c204431 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:10.600343 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:10.623650 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1c6db-30bb-45e9-93b1-6f3d2c204431 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:10.662524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32984178-6c76-4f2b-b5cd-078b202e51ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:10.663145 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32984178-6c76-4f2b-b5cd-078b202e51ec None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:10.663422 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32984178-6c76-4f2b-b5cd-078b202e51ec None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:10.663693 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32984178-6c76-4f2b-b5cd-078b202e51ec None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:10.664349 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32984178-6c76-4f2b-b5cd-078b202e51ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:10.664650 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32984178-6c76-4f2b-b5cd-078b202e51ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:10.666097 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32984178-6c76-4f2b-b5cd-078b202e51ec None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:10.679340 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 627/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:10.688426 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f861c8-2a17-4de8-859a-b6b7fd8810fd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:10.795985 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f861c8-2a17-4de8-859a-b6b7fd8810fd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:10.818651 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:10.837482 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d42b1-191e-40da-a315-5c030a52264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:10.838120 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d42b1-191e-40da-a315-5c030a52264f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:10.838401 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d42b1-191e-40da-a315-5c030a52264f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:10.838678 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d42b1-191e-40da-a315-5c030a52264f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:10.846906 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d42b1-191e-40da-a315-5c030a52264f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:10.848361 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d42b1-191e-40da-a315-5c030a52264f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:10.860683 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-708d42b1-191e-40da-a315-5c030a52264f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:46:10.860683 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:10.860683 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:10.860683 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:10.860683 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:10.860683 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:10.860683 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:10.860683 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:10.860683 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:10.860683 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:10.860683 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:10.860683 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:10.860683 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:46:10.860683 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:46:10.860683 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:46:10.860683 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:46:10.862696 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:10.862696 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:10.862696 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:46:10.862696 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:10.862696 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:46:10.862696 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:10.862696 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:10.862696 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:10.862696 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:10.862696 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:10.862696 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:10.862696 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:10.862696 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:10.862696 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:10.862696 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:10.862696 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:10.862696 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:10.862696 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:10.864653 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:10.864653 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:10.864653 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:46:10.864653 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:46:10.864653 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:46:10.864653 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:46:10.864653 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:46:10.864653 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:46:10.864653 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:46:10.864653 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:46:10.864653 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 640/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:10.867908 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32984178-6c76-4f2b-b5cd-078b202e51ec None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:10.978508 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32984178-6c76-4f2b-b5cd-078b202e51ec None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:11.017345 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e312a-c3ef-408b-a63d-71c249471209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:11.018080 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e312a-c3ef-408b-a63d-71c249471209 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:11.018377 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e312a-c3ef-408b-a63d-71c249471209 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:11.018630 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e312a-c3ef-408b-a63d-71c249471209 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:11.019367 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e312a-c3ef-408b-a63d-71c249471209 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:11.019668 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e312a-c3ef-408b-a63d-71c249471209 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:11.021149 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e312a-c3ef-408b-a63d-71c249471209 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:11.032216 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:11.042726 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 628/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Sun Oct 2 00:46:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:11.048797 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d42b1-191e-40da-a315-5c030a52264f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:11.160721 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d42b1-191e-40da-a315-5c030a52264f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:11.196156 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834bdda-f480-44a0-be71-777f15401787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:11.196796 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834bdda-f480-44a0-be71-777f15401787 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:11.197110 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834bdda-f480-44a0-be71-777f15401787 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:11.197385 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834bdda-f480-44a0-be71-777f15401787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:11.209506 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834bdda-f480-44a0-be71-777f15401787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:11.210966 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834bdda-f480-44a0-be71-777f15401787 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:11.225564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-1834bdda-f480-44a0-be71-777f15401787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:11.225564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:11.225564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:11.225564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:11.225564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:11.225564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:11.225564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:11.225564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:11.225564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:11.225564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:11.225564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:11.225564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:11.225564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:11.225564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:11.225564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:11.225564 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:11.226766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:11.226766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:11.226766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:11.226766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:11.226766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:11.226766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:11.226766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:11.226766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:11.226766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:11.226766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:11.226766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:11.226766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:11.226766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:11.226766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:11.226766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:11.226766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:11.226766 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:11.227748 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:11.227748 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:11.227748 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:46:11.227748 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 641/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:11.232652 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e312a-c3ef-408b-a63d-71c249471209 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:11.347624 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e312a-c3ef-408b-a63d-71c249471209 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:11.381928 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc577e-a921-4216-af2a-0e0b87acff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:11.382533 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc577e-a921-4216-af2a-0e0b87acff3e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:11.382814 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc577e-a921-4216-af2a-0e0b87acff3e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:11.383086 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc577e-a921-4216-af2a-0e0b87acff3e None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:11.383721 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc577e-a921-4216-af2a-0e0b87acff3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:11.384022 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc577e-a921-4216-af2a-0e0b87acff3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:11.385678 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc577e-a921-4216-af2a-0e0b87acff3e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:11.397486 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 629/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:11.403220 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834bdda-f480-44a0-be71-777f15401787 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:11.439864 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:11.515067 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834bdda-f480-44a0-be71-777f15401787 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:11.549437 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa060f-b921-4df2-b0fc-26a1203d7d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:11.550093 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa060f-b921-4df2-b0fc-26a1203d7d40 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:11.550368 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa060f-b921-4df2-b0fc-26a1203d7d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:11.550637 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa060f-b921-4df2-b0fc-26a1203d7d40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:11.558238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa060f-b921-4df2-b0fc-26a1203d7d40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:11.559674 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa060f-b921-4df2-b0fc-26a1203d7d40 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:11.571026 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-93fa060f-b921-4df2-b0fc-26a1203d7d40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:11.571026 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:11.571026 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:11.571026 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:11.571026 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:11.571026 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:11.571026 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:11.571026 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:11.571026 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:11.571026 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:11.571026 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:11.571026 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:11.571026 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:46:11.571026 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:46:11.571026 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:46:11.572159 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:46:11.572159 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:11.572159 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:11.572159 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:11.572159 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:11.572159 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:11.572159 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:11.572159 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:11.572159 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:11.572159 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:11.572159 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:11.572159 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:11.572159 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:11.572159 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:11.572159 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:11.572159 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:11.572159 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:11.573442 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:46:11.573442 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:46:11.573442 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:46:11.573442 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:46:11.573442 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:46:11.573442 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:46:11.573442 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:11.573442 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:46:11.573442 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 642/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:46:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:11.577947 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc577e-a921-4216-af2a-0e0b87acff3e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:11.635895 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:11.678131 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc577e-a921-4216-af2a-0e0b87acff3e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:11.710955 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadc10f-4afc-43ca-a9b4-bce0050b58e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:11.711547 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadc10f-4afc-43ca-a9b4-bce0050b58e0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:11.711818 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadc10f-4afc-43ca-a9b4-bce0050b58e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:11.712083 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadc10f-4afc-43ca-a9b4-bce0050b58e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:11.712755 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadc10f-4afc-43ca-a9b4-bce0050b58e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:11.713082 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadc10f-4afc-43ca-a9b4-bce0050b58e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:11.714501 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadc10f-4afc-43ca-a9b4-bce0050b58e0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:11.726838 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 630/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:46:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:11.732872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa060f-b921-4df2-b0fc-26a1203d7d40 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:11.830807 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:11.839745 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa060f-b921-4df2-b0fc-26a1203d7d40 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:11.873326 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a23fb-f2c3-4432-9df9-b5db83b739bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:11.873977 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a23fb-f2c3-4432-9df9-b5db83b739bb None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:11.874264 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a23fb-f2c3-4432-9df9-b5db83b739bb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:11.874536 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a23fb-f2c3-4432-9df9-b5db83b739bb None admin] PATH_INFO: `/v3/projects/7aec935005514f808eb735bfb01fee6e/users/a78481cceebd4138b893eba7e51c9c5b/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:11.876491 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a23fb-f2c3-4432-9df9-b5db83b739bb None admin] RBAC: Authorizing `identity:create_grant(project_id=7aec935005514f808eb735bfb01fee6e, user_id=a78481cceebd4138b893eba7e51c9c5b, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:11.877952 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a23fb-f2c3-4432-9df9-b5db83b739bb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:11.892244 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 643/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Oct 2 00:46:11 2022] PUT /identity/v3/projects/7aec935005514f808eb735bfb01fee6e/users/a78481cceebd4138b893eba7e51c9c5b/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:46:14.077832 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3b9c-4b99-4797-89a3-a4fc9e4dfcc3 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:14.078394 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3b9c-4b99-4797-89a3-a4fc9e4dfcc3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:14.078508 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3b9c-4b99-4797-89a3-a4fc9e4dfcc3 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:14.081324 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 631/1274] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:46:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:46:14.087975 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a612b21-2ddc-4914-9c1c-b4280f1933c5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:14.088698 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a612b21-2ddc-4914-9c1c-b4280f1933c5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:14.088698 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a612b21-2ddc-4914-9c1c-b4280f1933c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:14.108600 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4a612b21-2ddc-4914-9c1c-b4280f1933c5 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:14.109819 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4a612b21-2ddc-4914-9c1c-b4280f1933c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:14.181059 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 644/1275] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:14.448733 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e3b9c-4b99-4797-89a3-a4fc9e4dfcc3 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:14.553406 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e3b9c-4b99-4797-89a3-a4fc9e4dfcc3 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:14.570613 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:14.588141 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06294f7-7f58-49ee-8a9b-7201073bf894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:14.588763 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06294f7-7f58-49ee-8a9b-7201073bf894 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:14.589072 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06294f7-7f58-49ee-8a9b-7201073bf894 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:14.589341 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06294f7-7f58-49ee-8a9b-7201073bf894 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:14.600367 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06294f7-7f58-49ee-8a9b-7201073bf894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:46:14.605199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e06294f7-7f58-49ee-8a9b-7201073bf894 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:46:14.605199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:14.605199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:14.605199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:14.605199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:14.605199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:14.605199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:14.605199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:14.605199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:14.605199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:14.605199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:14.605199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:14.605199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:46:14.605199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:46:14.605199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:46:14.605199 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:46:14.606347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:46:14.606347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:46:14.606347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:46:14.606347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:46:14.606347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:14.606347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:14.606347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:14.606347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:14.606347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:14.606347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:14.606347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:14.606347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:14.606347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:14.606347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:14.606347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:14.606347 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:14.607478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:14.607478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:14.607478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:14.607478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:14.607478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:46:14.607478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:46:14.607478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:46:14.607478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:46:14.607478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:46:14.607478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:46:14.607478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:46:14.607478 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:46:14.607478 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 632/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Oct 2 00:46:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:14.613246 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a612b21-2ddc-4914-9c1c-b4280f1933c5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:14.693593 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:14.712457 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a612b21-2ddc-4914-9c1c-b4280f1933c5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:14.746918 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ce785-bd7f-4537-a48d-a8721dab9ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:14.747526 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ce785-bd7f-4537-a48d-a8721dab9ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:14.747808 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ce785-bd7f-4537-a48d-a8721dab9ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:14.748082 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ce785-bd7f-4537-a48d-a8721dab9ed7 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:14.748747 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ce785-bd7f-4537-a48d-a8721dab9ed7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:14.749082 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ce785-bd7f-4537-a48d-a8721dab9ed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:14.750463 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ce785-bd7f-4537-a48d-a8721dab9ed7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:14.759367 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 645/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Oct 2 00:46:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:14.765551 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06294f7-7f58-49ee-8a9b-7201073bf894 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:14.868928 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06294f7-7f58-49ee-8a9b-7201073bf894 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:14.911462 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9c605-7392-492a-85d2-ddfbf58c3dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:14.912126 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9c605-7392-492a-85d2-ddfbf58c3dee None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:14.912521 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9c605-7392-492a-85d2-ddfbf58c3dee None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:14.912795 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9c605-7392-492a-85d2-ddfbf58c3dee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:14.925103 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9c605-7392-492a-85d2-ddfbf58c3dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:14.926572 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9c605-7392-492a-85d2-ddfbf58c3dee None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:14.941991 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-35c9c605-7392-492a-85d2-ddfbf58c3dee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:14.941991 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:14.941991 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:14.941991 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:14.941991 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:14.941991 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:14.941991 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:14.941991 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:14.941991 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:14.941991 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:14.941991 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:14.941991 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:14.941991 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:14.941991 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:14.941991 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:14.941991 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:14.943246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:14.943246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:14.943246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:14.943246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:14.943246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:14.943246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:14.943246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:14.943246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:14.943246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:14.943246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:14.943246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:14.943246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:14.943246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:14.943246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:14.943246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:14.943246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:14.943246 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:14.944421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:14.944421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:14.944421 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:46:14.944421 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 633/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:14.948920 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ce785-bd7f-4537-a48d-a8721dab9ed7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:15.066974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ce785-bd7f-4537-a48d-a8721dab9ed7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:15.101409 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc2db1-3557-484f-9b84-84f7b887332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:15.102097 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc2db1-3557-484f-9b84-84f7b887332b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:15.102269 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc2db1-3557-484f-9b84-84f7b887332b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:15.102535 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc2db1-3557-484f-9b84-84f7b887332b None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:15.103170 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc2db1-3557-484f-9b84-84f7b887332b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:15.103468 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc2db1-3557-484f-9b84-84f7b887332b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:15.104830 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc2db1-3557-484f-9b84-84f7b887332b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:15.116996 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 646/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:15.122734 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9c605-7392-492a-85d2-ddfbf58c3dee None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:15.163762 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:15.234355 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9c605-7392-492a-85d2-ddfbf58c3dee None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:15.269284 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c44c9-d9fe-40b9-be33-073eaf232ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:15.269915 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c44c9-d9fe-40b9-be33-073eaf232ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:15.270197 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c44c9-d9fe-40b9-be33-073eaf232ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:15.270471 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c44c9-d9fe-40b9-be33-073eaf232ed9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:15.278331 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c44c9-d9fe-40b9-be33-073eaf232ed9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:15.279785 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c44c9-d9fe-40b9-be33-073eaf232ed9 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:15.291584 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-956c44c9-d9fe-40b9-be33-073eaf232ed9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:46:15.291584 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:15.291584 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:15.291584 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:15.291584 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:15.291584 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:15.291584 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:15.291584 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:15.291584 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:15.291584 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:15.291584 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:15.291584 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:15.291584 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:46:15.291584 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:46:15.291584 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:46:15.291584 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:46:15.292882 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:15.292882 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:15.292882 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:46:15.292882 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:15.292882 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:46:15.292882 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:15.292882 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:15.292882 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:15.292882 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:15.292882 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:15.292882 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:15.292882 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:15.292882 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:15.292882 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:15.292882 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:15.292882 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:15.292882 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:15.292882 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:15.294164 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:15.294164 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:15.294164 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:46:15.294164 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:46:15.294164 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:46:15.294164 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:46:15.294164 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:46:15.294164 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:46:15.294164 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:46:15.294164 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:46:15.294164 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 634/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:15.299387 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc2db1-3557-484f-9b84-84f7b887332b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:15.303165 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:15.399595 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc2db1-3557-484f-9b84-84f7b887332b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:15.434334 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fe584-5427-470a-b26f-b65ba6e64f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:15.434933 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fe584-5427-470a-b26f-b65ba6e64f39 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:15.435221 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fe584-5427-470a-b26f-b65ba6e64f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:15.435489 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fe584-5427-470a-b26f-b65ba6e64f39 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:15.436216 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fe584-5427-470a-b26f-b65ba6e64f39 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:15.436519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fe584-5427-470a-b26f-b65ba6e64f39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:15.437996 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fe584-5427-470a-b26f-b65ba6e64f39 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:15.458523 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 647/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Sun Oct 2 00:46:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:15.464631 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c44c9-d9fe-40b9-be33-073eaf232ed9 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:15.565580 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:15.576123 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c44c9-d9fe-40b9-be33-073eaf232ed9 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:15.611928 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669c8f6-c308-4955-9241-63c81d80805a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:15.612569 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669c8f6-c308-4955-9241-63c81d80805a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:15.612833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669c8f6-c308-4955-9241-63c81d80805a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:15.613140 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669c8f6-c308-4955-9241-63c81d80805a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:15.682143 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669c8f6-c308-4955-9241-63c81d80805a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:15.683618 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669c8f6-c308-4955-9241-63c81d80805a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:15.772581 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:15.783466 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 635/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Oct 2 00:46:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:46:15.789386 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fe584-5427-470a-b26f-b65ba6e64f39 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:15.849762 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:15.889637 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fe584-5427-470a-b26f-b65ba6e64f39 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:15.931524 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7422272-1767-42bf-b971-56aebeed3c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:15.932149 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7422272-1767-42bf-b971-56aebeed3c46 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:15.932427 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7422272-1767-42bf-b971-56aebeed3c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:15.932703 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7422272-1767-42bf-b971-56aebeed3c46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:15.943102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7422272-1767-42bf-b971-56aebeed3c46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:15.944545 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7422272-1767-42bf-b971-56aebeed3c46 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:15.958754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a7422272-1767-42bf-b971-56aebeed3c46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:15.958754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:15.958754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:15.958754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:15.958754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:15.958754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:15.958754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:15.958754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:15.958754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:15.958754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:15.958754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:15.958754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:15.958754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:15.958754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:15.958754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:15.958754 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:15.959896 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:15.959896 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:15.959896 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:15.959896 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:15.959896 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:15.959896 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:15.959896 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:15.959896 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:15.959896 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:15.959896 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:15.959896 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:15.959896 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:15.959896 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:15.959896 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:15.959896 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:15.959896 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:15.959896 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:15.960822 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:15.960822 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:15.960822 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:46:15.960822 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 648/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:15.965690 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669c8f6-c308-4955-9241-63c81d80805a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:16.075955 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669c8f6-c308-4955-9241-63c81d80805a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:16.109796 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98f43b-c3cb-4984-b680-79ba0a51e8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:16.110821 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98f43b-c3cb-4984-b680-79ba0a51e8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:16.111095 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98f43b-c3cb-4984-b680-79ba0a51e8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:16.111366 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98f43b-c3cb-4984-b680-79ba0a51e8e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:16.111996 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98f43b-c3cb-4984-b680-79ba0a51e8e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:16.112293 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98f43b-c3cb-4984-b680-79ba0a51e8e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:16.113695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98f43b-c3cb-4984-b680-79ba0a51e8e3 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:16.124999 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 636/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:16.131335 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7422272-1767-42bf-b971-56aebeed3c46 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:16.230819 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7422272-1767-42bf-b971-56aebeed3c46 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:16.244716 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:16.264862 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1e2fb-0b36-44fe-81be-f4ef7a601e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:16.265506 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1e2fb-0b36-44fe-81be-f4ef7a601e72 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:16.265789 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1e2fb-0b36-44fe-81be-f4ef7a601e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:16.266059 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1e2fb-0b36-44fe-81be-f4ef7a601e72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:16.273437 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1e2fb-0b36-44fe-81be-f4ef7a601e72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:16.274879 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1e2fb-0b36-44fe-81be-f4ef7a601e72 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:16.286774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-73f1e2fb-0b36-44fe-81be-f4ef7a601e72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:16.286774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:16.286774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:16.286774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:16.286774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:16.286774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:16.286774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:16.286774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:16.286774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:16.286774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:16.286774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:16.286774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:16.286774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:46:16.286774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:46:16.286774 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:46:16.287861 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:46:16.287861 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:16.287861 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:16.287861 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:16.287861 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:16.287861 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:16.287861 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:16.287861 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:16.287861 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:16.287861 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:16.287861 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:16.287861 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:16.287861 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:16.287861 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:16.287861 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:16.287861 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:16.287861 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:16.289033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:46:16.289033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:46:16.289033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:46:16.289033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:46:16.289033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:46:16.289033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:46:16.289033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:16.289033 dv-cinder-master-3-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 02 00:46:16.289033 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 649/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Oct 2 00:46:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:16.293844 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98f43b-c3cb-4984-b680-79ba0a51e8e3 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:16.347532 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:16.398072 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98f43b-c3cb-4984-b680-79ba0a51e8e3 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:16.432378 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f85143-8427-4e59-8b29-bcdd8f8299c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:16.433019 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f85143-8427-4e59-8b29-bcdd8f8299c7 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:16.433303 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f85143-8427-4e59-8b29-bcdd8f8299c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:16.433578 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f85143-8427-4e59-8b29-bcdd8f8299c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:16.434262 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f85143-8427-4e59-8b29-bcdd8f8299c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:16.434568 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f85143-8427-4e59-8b29-bcdd8f8299c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:16.436010 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f85143-8427-4e59-8b29-bcdd8f8299c7 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:16.448824 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 637/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Oct 2 00:46:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:16.455030 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1e2fb-0b36-44fe-81be-f4ef7a601e72 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:16.555594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1e2fb-0b36-44fe-81be-f4ef7a601e72 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:16.588186 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5ad01-5efc-49e9-9217-9840334d1d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:16.588779 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5ad01-5efc-49e9-9217-9840334d1d2f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:16.589101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5ad01-5efc-49e9-9217-9840334d1d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:16.589376 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5ad01-5efc-49e9-9217-9840334d1d2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:16.590091 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5ad01-5efc-49e9-9217-9840334d1d2f None admin] RBAC: Adding query filter params (role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e, scope.project.id=7aec935005514f808eb735bfb01fee6e, user.id=a78481cceebd4138b893eba7e51c9c5b) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:16.590400 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5ad01-5efc-49e9-9217-9840334d1d2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:16.591822 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5ad01-5efc-49e9-9217-9840334d1d2f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:16.598150 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 650/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Oct 2 00:46:16 2022] GET /identity/v3/role_assignments?user.id=a78481cceebd4138b893eba7e51c9c5b&scope.project.id=7aec935005514f808eb735bfb01fee6e&role.id=76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:18.798143 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137a39b-689a-4925-ad32-4c75d0feb900 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:18.798684 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137a39b-689a-4925-ad32-4c75d0feb900 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:18.800006 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137a39b-689a-4925-ad32-4c75d0feb900 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:18.801430 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 638/1288] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:46:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:18.807114 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614653b-5ba8-40e2-89c7-0744b438ee2a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:18.807649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614653b-5ba8-40e2-89c7-0744b438ee2a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:18.807649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614653b-5ba8-40e2-89c7-0744b438ee2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:18.826144 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c614653b-5ba8-40e2-89c7-0744b438ee2a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:18.827342 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c614653b-5ba8-40e2-89c7-0744b438ee2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:18.856774 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:18.899932 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 651/1289] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:46:19.187392 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137a39b-689a-4925-ad32-4c75d0feb900 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:19.293601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137a39b-689a-4925-ad32-4c75d0feb900 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:19.304839 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:19.334343 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0c7f3-823f-4c1d-915d-95aeb2b9ee20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:19.335213 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0c7f3-823f-4c1d-915d-95aeb2b9ee20 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:19.335729 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0c7f3-823f-4c1d-915d-95aeb2b9ee20 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:19.336204 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0c7f3-823f-4c1d-915d-95aeb2b9ee20 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:19.337344 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0c7f3-823f-4c1d-915d-95aeb2b9ee20 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:19.339085 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0c7f3-823f-4c1d-915d-95aeb2b9ee20 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:19.349745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-02e0c7f3-823f-4c1d-915d-95aeb2b9ee20 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 02 00:46:19.349745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:19.349745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:19.349745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:19.349745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:19.349745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:19.349745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:19.349745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:19.349745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 02 00:46:19.349745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:46:19.349745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:19.349745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:46:19.349745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:19.349745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:19.349745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:19.349745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:19.349745 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:19.351025 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:19.351025 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:19.351025 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:19.351025 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:19.351025 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:19.351025 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:19.351025 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:19.351025 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:19.351025 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:19.351025 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:19.351025 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:19.351025 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:19.351025 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:19.351025 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:19.351025 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:19.351025 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:19.352064 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:19.352064 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:19.352064 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:19.352064 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:19.352064 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:19.352064 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:19.352064 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:19.352064 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:19.352064 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:19.352064 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:19.352064 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:19.352064 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:19.352064 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 02 00:46:19.352064 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:46:19.352064 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 639/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Oct 2 00:46:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:19.360760 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614653b-5ba8-40e2-89c7-0744b438ee2a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:19.463507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614653b-5ba8-40e2-89c7-0744b438ee2a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:19.498313 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2183b-9aae-4ed5-8ea8-9c141deafe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:19.498923 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2183b-9aae-4ed5-8ea8-9c141deafe72 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:19.499205 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2183b-9aae-4ed5-8ea8-9c141deafe72 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:19.499479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2183b-9aae-4ed5-8ea8-9c141deafe72 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:19.500105 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2183b-9aae-4ed5-8ea8-9c141deafe72 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:19.500409 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2183b-9aae-4ed5-8ea8-9c141deafe72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:19.502208 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2183b-9aae-4ed5-8ea8-9c141deafe72 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:19.507063 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 652/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Sun Oct 2 00:46:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:19.513198 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0c7f3-823f-4c1d-915d-95aeb2b9ee20 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:19.616428 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0c7f3-823f-4c1d-915d-95aeb2b9ee20 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:19.653919 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffc67b-8014-49ff-ae1a-682ef911a8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:19.654517 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffc67b-8014-49ff-ae1a-682ef911a8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:19.654798 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffc67b-8014-49ff-ae1a-682ef911a8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:19.655074 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffc67b-8014-49ff-ae1a-682ef911a8e1 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:19.655687 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffc67b-8014-49ff-ae1a-682ef911a8e1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:19.655993 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffc67b-8014-49ff-ae1a-682ef911a8e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:19.658264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffc67b-8014-49ff-ae1a-682ef911a8e1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:19.662835 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 640/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Sun Oct 2 00:46:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:21.846785 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990227e9-ece0-481f-9cec-4579d9c9a153 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:21.847291 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990227e9-ece0-481f-9cec-4579d9c9a153 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:21.847291 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990227e9-ece0-481f-9cec-4579d9c9a153 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:21.848569 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 653/1293] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:21.853801 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbc960-5800-4fdb-be43-c088354abb6c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:21.854193 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbc960-5800-4fdb-be43-c088354abb6c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:21.854343 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbc960-5800-4fdb-be43-c088354abb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:21.872776 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-66dbc960-5800-4fdb-be43-c088354abb6c None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:21.873986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-66dbc960-5800-4fdb-be43-c088354abb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:21.905722 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:21.944331 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 641/1294] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:22.217189 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990227e9-ece0-481f-9cec-4579d9c9a153 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:22.248114 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:22.327506 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990227e9-ece0-481f-9cec-4579d9c9a153 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:22.362598 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91030d1-9bba-498a-91a3-6faf367c40a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:22.363207 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91030d1-9bba-498a-91a3-6faf367c40a5 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:22.363482 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91030d1-9bba-498a-91a3-6faf367c40a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:22.363760 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91030d1-9bba-498a-91a3-6faf367c40a5 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:22.364414 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91030d1-9bba-498a-91a3-6faf367c40a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:22.365808 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91030d1-9bba-498a-91a3-6faf367c40a5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:22.381580 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 654/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Oct 2 00:46:22 2022] POST /identity/v3/services => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:46:24.599591 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8fc86-f3c8-49c5-8630-4f981947f879 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:24.600176 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8fc86-f3c8-49c5-8630-4f981947f879 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:24.600176 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8fc86-f3c8-49c5-8630-4f981947f879 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:24.601491 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 642/1296] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:24.606664 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e943e-fcdb-4d86-8f85-cfd59073cca9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:24.607086 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e943e-fcdb-4d86-8f85-cfd59073cca9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:24.607199 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e943e-fcdb-4d86-8f85-cfd59073cca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:24.626508 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-459e943e-fcdb-4d86-8f85-cfd59073cca9 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:24.627707 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-459e943e-fcdb-4d86-8f85-cfd59073cca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:24.699670 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 655/1297] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:24.965737 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8fc86-f3c8-49c5-8630-4f981947f879 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:25.068579 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8fc86-f3c8-49c5-8630-4f981947f879 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:25.102055 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da353d-83c3-484d-a670-3006361a3d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:25.102668 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da353d-83c3-484d-a670-3006361a3d92 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:25.102942 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da353d-83c3-484d-a670-3006361a3d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:25.103207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da353d-83c3-484d-a670-3006361a3d92 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:25.103777 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da353d-83c3-484d-a670-3006361a3d92 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:25.105183 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da353d-83c3-484d-a670-3006361a3d92 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:25.115102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-55da353d-83c3-484d-a670-3006361a3d92 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 02 00:46:25.115102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:25.115102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:25.115102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:25.115102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:25.115102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:25.115102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:25.115102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:25.115102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 02 00:46:25.115102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:46:25.115102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:25.115102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:46:25.115102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:25.115102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:25.115102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:25.115102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:25.115102 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:25.116402 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:25.116402 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:25.116402 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:25.116402 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:25.116402 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:25.116402 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:25.116402 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:25.116402 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:25.116402 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:25.116402 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:25.116402 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:25.116402 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:25.116402 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:25.116402 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:25.116402 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:25.116402 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:25.117333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:25.117333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:25.117333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:25.117333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:25.117333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:25.117333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:25.117333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:25.117333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:25.117333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:25.117333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:25.117333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:25.117333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:25.117333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 02 00:46:25.117333 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:46:25.117333 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 643/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Oct 2 00:46:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:25.122897 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e943e-fcdb-4d86-8f85-cfd59073cca9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:25.142909 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:25.223020 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e943e-fcdb-4d86-8f85-cfd59073cca9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:25.257254 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fb939-4435-4bfa-bc81-a89f58e47a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:25.257853 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fb939-4435-4bfa-bc81-a89f58e47a0a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:25.258127 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fb939-4435-4bfa-bc81-a89f58e47a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:25.258393 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fb939-4435-4bfa-bc81-a89f58e47a0a None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:25.259014 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fb939-4435-4bfa-bc81-a89f58e47a0a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:25.259313 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fb939-4435-4bfa-bc81-a89f58e47a0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:25.260930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fb939-4435-4bfa-bc81-a89f58e47a0a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:25.266035 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 656/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Sun Oct 2 00:46:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:25.272259 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da353d-83c3-484d-a670-3006361a3d92 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:25.304817 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:25.376070 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da353d-83c3-484d-a670-3006361a3d92 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:25.409135 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0458a29-1d58-436d-81cb-fbfbb7d302ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:25.409623 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0458a29-1d58-436d-81cb-fbfbb7d302ac None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:25.409903 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0458a29-1d58-436d-81cb-fbfbb7d302ac None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:25.410174 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0458a29-1d58-436d-81cb-fbfbb7d302ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:25.410872 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0458a29-1d58-436d-81cb-fbfbb7d302ac None admin] RBAC: Adding query filter params (interface=public, service_id=2f7528e036b34c5f84d94edc14b70af5, region_id=RegionOne) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:25.411180 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0458a29-1d58-436d-81cb-fbfbb7d302ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:25.412549 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0458a29-1d58-436d-81cb-fbfbb7d302ac None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:25.417791 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 644/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Sun Oct 2 00:46:25 2022] GET /identity/v3/endpoints?service_id=2f7528e036b34c5f84d94edc14b70af5&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:25.424109 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fb939-4435-4bfa-bc81-a89f58e47a0a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:25.506005 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:25.524128 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fb939-4435-4bfa-bc81-a89f58e47a0a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:25.557462 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19ae17-d82a-4eb4-aaf8-33bd4e5f27ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:25.558058 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19ae17-d82a-4eb4-aaf8-33bd4e5f27ec None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:25.558340 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19ae17-d82a-4eb4-aaf8-33bd4e5f27ec None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:25.558614 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19ae17-d82a-4eb4-aaf8-33bd4e5f27ec None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:25.559208 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19ae17-d82a-4eb4-aaf8-33bd4e5f27ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:25.560570 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19ae17-d82a-4eb4-aaf8-33bd4e5f27ec None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:25.567522 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 657/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Sun Oct 2 00:46:25 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:46:27.796968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd99746-feb2-437d-8a53-f58b7b1d4a5f None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:27.797773 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd99746-feb2-437d-8a53-f58b7b1d4a5f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:27.797773 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd99746-feb2-437d-8a53-f58b7b1d4a5f None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:27.798831 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 645/1302] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:46:27.804139 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb301b-d307-41ef-b0fc-b7c70de4519d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:27.804524 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb301b-d307-41ef-b0fc-b7c70de4519d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:27.804695 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb301b-d307-41ef-b0fc-b7c70de4519d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:27.823524 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f6cb301b-d307-41ef-b0fc-b7c70de4519d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:27.824715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f6cb301b-d307-41ef-b0fc-b7c70de4519d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:27.896610 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 658/1303] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:28.182771 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd99746-feb2-437d-8a53-f58b7b1d4a5f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:28.278218 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:28.285821 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd99746-feb2-437d-8a53-f58b7b1d4a5f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:28.319581 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b21a6-9781-4a38-afd9-762f3e548249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:28.320205 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b21a6-9781-4a38-afd9-762f3e548249 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:28.320482 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b21a6-9781-4a38-afd9-762f3e548249 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:28.320753 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b21a6-9781-4a38-afd9-762f3e548249 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:28.321352 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b21a6-9781-4a38-afd9-762f3e548249 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:28.322713 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b21a6-9781-4a38-afd9-762f3e548249 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:28.332109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-af5b21a6-9781-4a38-afd9-762f3e548249 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 02 00:46:28.332109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:28.332109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:28.332109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:28.332109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:28.332109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:28.332109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:28.332109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:28.332109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 02 00:46:28.332109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:46:28.332109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:28.332109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:46:28.332109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:28.332109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:28.332109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:28.332109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:28.332109 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:28.333343 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:28.333343 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:28.333343 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:28.333343 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:28.333343 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:28.333343 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:28.333343 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:28.333343 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:28.333343 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:28.333343 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:28.333343 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:28.333343 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:28.333343 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:28.333343 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:28.333343 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:28.333343 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:28.334400 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:28.334400 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:28.334400 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:28.334400 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:28.334400 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:28.334400 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:28.334400 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:28.334400 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:28.334400 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:28.334400 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:28.334400 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:28.334400 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:28.334400 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 02 00:46:28.334400 dv-cinder-master-3-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Oct 02 00:46:28.334400 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 646/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Oct 2 00:46:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:28.339223 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb301b-d307-41ef-b0fc-b7c70de4519d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:28.415623 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:28.439594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb301b-d307-41ef-b0fc-b7c70de4519d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:28.475324 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5387a87-49b1-4b90-88b4-96ec5af30da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:28.475934 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5387a87-49b1-4b90-88b4-96ec5af30da6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:28.476212 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5387a87-49b1-4b90-88b4-96ec5af30da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:28.476483 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5387a87-49b1-4b90-88b4-96ec5af30da6 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:28.477141 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5387a87-49b1-4b90-88b4-96ec5af30da6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:28.477442 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5387a87-49b1-4b90-88b4-96ec5af30da6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:28.478811 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5387a87-49b1-4b90-88b4-96ec5af30da6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:28.484016 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 659/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Sun Oct 2 00:46:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:28.490104 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b21a6-9781-4a38-afd9-762f3e548249 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:28.595842 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b21a6-9781-4a38-afd9-762f3e548249 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:28.629867 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c12ecd-c31c-41de-9165-9f5046ffa434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:28.630470 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c12ecd-c31c-41de-9165-9f5046ffa434 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:28.630751 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c12ecd-c31c-41de-9165-9f5046ffa434 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:28.631026 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c12ecd-c31c-41de-9165-9f5046ffa434 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:28.631699 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c12ecd-c31c-41de-9165-9f5046ffa434 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:28.633108 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c12ecd-c31c-41de-9165-9f5046ffa434 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:28.653363 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 647/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:46:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:46:38.480990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=30 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:38.648972 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:38.228486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5632cc-7b6f-4291-93dd-e96faa1da158 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:38.229066 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5632cc-7b6f-4291-93dd-e96faa1da158 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:38.229393 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5632cc-7b6f-4291-93dd-e96faa1da158 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:38.238387 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 660/1307] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:47:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:38.240078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588d80e-7bb1-44b3-a5ab-8ba0232109ff None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:38.241087 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588d80e-7bb1-44b3-a5ab-8ba0232109ff None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:38.241841 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588d80e-7bb1-44b3-a5ab-8ba0232109ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:38.409752 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-f588d80e-7bb1-44b3-a5ab-8ba0232109ff None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:38.411121 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f588d80e-7bb1-44b3-a5ab-8ba0232109ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:38.577231 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 648/1308] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:47:38.991637 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c14d09-7294-4a23-ab20-451ce7ce2fb5 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:38.992119 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c14d09-7294-4a23-ab20-451ce7ce2fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:38.993053 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c14d09-7294-4a23-ab20-451ce7ce2fb5 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:38.994629 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 661/1309] 10.222.0.26 () {54 vars in 964 bytes} [Sun Oct 2 00:47:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:39.004765 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67780e-65f8-4ecf-800e-56ca579c6e85 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:39.005148 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67780e-65f8-4ecf-800e-56ca579c6e85 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:39.005531 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67780e-65f8-4ecf-800e-56ca579c6e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:39.127555 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3f67780e-65f8-4ecf-800e-56ca579c6e85 None None] MFA Rules not processed for user `5100db0c968c406fa89e117877604c50`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:39.129616 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3f67780e-65f8-4ecf-800e-56ca579c6e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:39.172006 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:39.291234 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 649/1310] 10.222.0.26 () {58 vars in 1061 bytes} [Sun Oct 2 00:47:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:47:39.305214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c14d09-7294-4a23-ab20-451ce7ce2fb5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:39.308292 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-82c14d09-7294-4a23-ab20-451ce7ce2fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:39.532539 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c14d09-7294-4a23-ab20-451ce7ce2fb5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:39.655588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98beb98c-0e0f-46bc-9e55-3945f035b73d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:39.656787 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98beb98c-0e0f-46bc-9e55-3945f035b73d service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:39.657318 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98beb98c-0e0f-46bc-9e55-3945f035b73d service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:39.657803 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98beb98c-0e0f-46bc-9e55-3945f035b73d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:39.659703 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-98beb98c-0e0f-46bc-9e55-3945f035b73d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:39.780080 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:39.879678 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98beb98c-0e0f-46bc-9e55-3945f035b73d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:39.882580 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98beb98c-0e0f-46bc-9e55-3945f035b73d service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:39.928599 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 662/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:47:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:47:42.543376 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9378a7-875d-4436-ba6e-e7506bdfd045 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:42.544099 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9378a7-875d-4436-ba6e-e7506bdfd045 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:42.544363 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9378a7-875d-4436-ba6e-e7506bdfd045 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:42.546612 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 650/1312] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:47:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:42.555235 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94392da9-71b7-4442-9e77-eb689cdbd501 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:42.556058 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94392da9-71b7-4442-9e77-eb689cdbd501 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:42.556336 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94392da9-71b7-4442-9e77-eb689cdbd501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:42.659325 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-94392da9-71b7-4442-9e77-eb689cdbd501 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:42.660678 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-94392da9-71b7-4442-9e77-eb689cdbd501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:42.817942 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 663/1313] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:47:43.123568 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9378a7-875d-4436-ba6e-e7506bdfd045 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:43.125724 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ea9378a7-875d-4436-ba6e-e7506bdfd045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:43.261872 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9378a7-875d-4436-ba6e-e7506bdfd045 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:43.351635 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:43.354385 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01b09c-5c05-41c4-b2ed-33c33c41db21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:43.355287 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01b09c-5c05-41c4-b2ed-33c33c41db21 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:43.356376 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01b09c-5c05-41c4-b2ed-33c33c41db21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:43.356725 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01b09c-5c05-41c4-b2ed-33c33c41db21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:43.358838 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4a01b09c-5c05-41c4-b2ed-33c33c41db21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:43.494474 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01b09c-5c05-41c4-b2ed-33c33c41db21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:43.495932 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01b09c-5c05-41c4-b2ed-33c33c41db21 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:43.516925 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 651/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:47:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:47:46.110381 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e40c58-00d3-4a13-82f8-8c848590383f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:46.111001 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e40c58-00d3-4a13-82f8-8c848590383f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:46.111001 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e40c58-00d3-4a13-82f8-8c848590383f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:46.112390 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 664/1315] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:46.121009 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76489d01-b3e5-4f6e-93d0-23efd953882c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:46.122329 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76489d01-b3e5-4f6e-93d0-23efd953882c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:46.122329 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76489d01-b3e5-4f6e-93d0-23efd953882c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:46.198122 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-76489d01-b3e5-4f6e-93d0-23efd953882c None None] MFA Rules not processed for user `69f4406ff16447f8af2cb9634cbd3cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:46.199416 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-76489d01-b3e5-4f6e-93d0-23efd953882c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:46.256132 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:46.303663 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 652/1316] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:47:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:47:46.616360 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7156d5-9497-4298-800c-aa6ba27ad67f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:46.616638 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7156d5-9497-4298-800c-aa6ba27ad67f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:46.616917 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7156d5-9497-4298-800c-aa6ba27ad67f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:46.618470 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 665/1317] 10.222.0.26 () {54 vars in 964 bytes} [Sun Oct 2 00:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:46.626725 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9368f9-02da-4c60-a35e-daeb8d550d8c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:46.627269 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9368f9-02da-4c60-a35e-daeb8d550d8c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:46.628272 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9368f9-02da-4c60-a35e-daeb8d550d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:46.718795 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-9e9368f9-02da-4c60-a35e-daeb8d550d8c None None] MFA Rules not processed for user `5100db0c968c406fa89e117877604c50`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:46.719965 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9e9368f9-02da-4c60-a35e-daeb8d550d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:46.812580 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 653/1318] 10.222.0.26 () {58 vars in 1061 bytes} [Sun Oct 2 00:47:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:47:46.821652 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7156d5-9497-4298-800c-aa6ba27ad67f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:46.823188 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dc7156d5-9497-4298-800c-aa6ba27ad67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:46.845978 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:46.948895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7156d5-9497-4298-800c-aa6ba27ad67f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:47.026534 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017bf3d-ea1c-4945-bfbe-03df0ab89a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:47.027052 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017bf3d-ea1c-4945-bfbe-03df0ab89a9d service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:47.027333 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017bf3d-ea1c-4945-bfbe-03df0ab89a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:47.027690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017bf3d-ea1c-4945-bfbe-03df0ab89a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:47.029680 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4017bf3d-ea1c-4945-bfbe-03df0ab89a9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:47.096419 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:47.147389 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017bf3d-ea1c-4945-bfbe-03df0ab89a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:47.148856 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017bf3d-ea1c-4945-bfbe-03df0ab89a9d service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:47.168526 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 666/1319] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:47:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:47:50.280271 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb55309-dbaa-4e15-86f7-10721d56b5aa None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:50.280868 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb55309-dbaa-4e15-86f7-10721d56b5aa None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:50.280868 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb55309-dbaa-4e15-86f7-10721d56b5aa None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:50.282166 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 654/1320] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:50.287768 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55abf21-06f9-45e4-b5cf-169ef5d8ecb6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:50.288207 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55abf21-06f9-45e4-b5cf-169ef5d8ecb6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:50.288315 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55abf21-06f9-45e4-b5cf-169ef5d8ecb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:50.356613 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a55abf21-06f9-45e4-b5cf-169ef5d8ecb6 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:50.357814 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a55abf21-06f9-45e4-b5cf-169ef5d8ecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:50.455948 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 667/1321] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:47:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:47:50.741162 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb55309-dbaa-4e15-86f7-10721d56b5aa None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:50.742733 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4eb55309-dbaa-4e15-86f7-10721d56b5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:50.793741 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:50.849265 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb55309-dbaa-4e15-86f7-10721d56b5aa None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:50.926137 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff0aee-adf4-49a3-86d1-5782720f04fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:50.926740 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff0aee-adf4-49a3-86d1-5782720f04fb service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:50.927015 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff0aee-adf4-49a3-86d1-5782720f04fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:50.927279 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff0aee-adf4-49a3-86d1-5782720f04fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:50.928875 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f8ff0aee-adf4-49a3-86d1-5782720f04fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:51.029785 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:51.043837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff0aee-adf4-49a3-86d1-5782720f04fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:51.045356 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff0aee-adf4-49a3-86d1-5782720f04fb service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:51.065592 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 655/1322] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:47:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:47:54.012179 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89df566-4d45-41d3-b90c-0995ec22d2cf None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:54.012770 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89df566-4d45-41d3-b90c-0995ec22d2cf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:54.012770 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89df566-4d45-41d3-b90c-0995ec22d2cf None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:54.014209 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 668/1323] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:54.020365 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a9b8c-7c25-451a-8e00-b8e172f27487 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:54.021161 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a9b8c-7c25-451a-8e00-b8e172f27487 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:54.021161 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a9b8c-7c25-451a-8e00-b8e172f27487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:54.101584 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-185a9b8c-7c25-451a-8e00-b8e172f27487 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:54.102942 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-185a9b8c-7c25-451a-8e00-b8e172f27487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:54.221422 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 656/1324] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:47:54.514227 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89df566-4d45-41d3-b90c-0995ec22d2cf None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:54.515783 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d89df566-4d45-41d3-b90c-0995ec22d2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:54.537713 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:54.645001 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89df566-4d45-41d3-b90c-0995ec22d2cf None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:54.728331 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb382d-f980-4335-8606-ac32afd4ec6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:54.728852 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb382d-f980-4335-8606-ac32afd4ec6e service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:54.729185 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb382d-f980-4335-8606-ac32afd4ec6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:54.729454 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb382d-f980-4335-8606-ac32afd4ec6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:54.731374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f1eb382d-f980-4335-8606-ac32afd4ec6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:54.825317 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:54.874278 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb382d-f980-4335-8606-ac32afd4ec6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:54.877118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb382d-f980-4335-8606-ac32afd4ec6e service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:54.900484 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 669/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:47:57.208346 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d6512-5ad0-4b6a-93a9-1a034d09d133 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:57.209016 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d6512-5ad0-4b6a-93a9-1a034d09d133 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:57.209016 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d6512-5ad0-4b6a-93a9-1a034d09d133 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:57.210706 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 657/1326] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:57.217619 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96626797-04a1-4299-82fe-84ec07df7b83 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:57.218179 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96626797-04a1-4299-82fe-84ec07df7b83 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:57.218556 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96626797-04a1-4299-82fe-84ec07df7b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:57.319835 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-96626797-04a1-4299-82fe-84ec07df7b83 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:57.321082 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-96626797-04a1-4299-82fe-84ec07df7b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:57.449238 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 670/1327] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:47:57.737755 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d6512-5ad0-4b6a-93a9-1a034d09d133 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:57.739421 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-895d6512-5ad0-4b6a-93a9-1a034d09d133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:57.813555 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:57.866019 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d6512-5ad0-4b6a-93a9-1a034d09d133 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:57.955749 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69cd1c-2041-4842-b012-00c500ae2fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:57.956358 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69cd1c-2041-4842-b012-00c500ae2fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:57.956631 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69cd1c-2041-4842-b012-00c500ae2fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:57.956898 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69cd1c-2041-4842-b012-00c500ae2fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:57.958557 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-bc69cd1c-2041-4842-b012-00c500ae2fe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:58.080070 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:58.082847 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69cd1c-2041-4842-b012-00c500ae2fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:58.084432 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69cd1c-2041-4842-b012-00c500ae2fe7 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:58.107664 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 658/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:47:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:48:00.885787 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a093c-1c4d-4c5d-a2bd-b581431db023 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:00.887019 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a093c-1c4d-4c5d-a2bd-b581431db023 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:00.887219 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a093c-1c4d-4c5d-a2bd-b581431db023 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:00.888663 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 671/1329] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:48:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:00.895024 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508c714-1158-4499-b362-7b9e7b77f28f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:00.895581 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508c714-1158-4499-b362-7b9e7b77f28f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:00.895581 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508c714-1158-4499-b362-7b9e7b77f28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:00.979082 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e508c714-1158-4499-b362-7b9e7b77f28f None None] MFA Rules not processed for user `69f4406ff16447f8af2cb9634cbd3cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:00.981809 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e508c714-1158-4499-b362-7b9e7b77f28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:01.106356 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 659/1330] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:00 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:48:01.396296 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a093c-1c4d-4c5d-a2bd-b581431db023 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:01.397986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8e4a093c-1c4d-4c5d-a2bd-b581431db023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:01.438842 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:01.521069 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a093c-1c4d-4c5d-a2bd-b581431db023 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:01.598923 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c305a-8b88-4aeb-b250-51c76865eec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:01.599539 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c305a-8b88-4aeb-b250-51c76865eec7 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:01.599820 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c305a-8b88-4aeb-b250-51c76865eec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:01.600100 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c305a-8b88-4aeb-b250-51c76865eec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:01.601784 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-248c305a-8b88-4aeb-b250-51c76865eec7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:01.691388 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:01.734206 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c305a-8b88-4aeb-b250-51c76865eec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:01.735659 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c305a-8b88-4aeb-b250-51c76865eec7 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:01.754511 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 672/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:48:01 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:48:04.254250 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a103251-1c18-402e-8abe-a834455b05a7 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:04.254805 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a103251-1c18-402e-8abe-a834455b05a7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:04.254805 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a103251-1c18-402e-8abe-a834455b05a7 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:04.256167 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 660/1332] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:04.262542 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2655fe4-b0fe-49b8-9d6c-a19c5152e730 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:04.263085 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2655fe4-b0fe-49b8-9d6c-a19c5152e730 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:04.263085 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2655fe4-b0fe-49b8-9d6c-a19c5152e730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:04.338668 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f2655fe4-b0fe-49b8-9d6c-a19c5152e730 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:04.339941 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f2655fe4-b0fe-49b8-9d6c-a19c5152e730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:04.451973 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 673/1333] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:48:05.001400 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a103251-1c18-402e-8abe-a834455b05a7 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:05.002988 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8a103251-1c18-402e-8abe-a834455b05a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:05.075502 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:05.110306 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a103251-1c18-402e-8abe-a834455b05a7 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:05.185720 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7480f3d-2568-4277-9b86-641314de0acc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:05.186330 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7480f3d-2568-4277-9b86-641314de0acc service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:05.186610 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7480f3d-2568-4277-9b86-641314de0acc service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:05.186886 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7480f3d-2568-4277-9b86-641314de0acc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:05.188531 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d7480f3d-2568-4277-9b86-641314de0acc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:05.300042 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7480f3d-2568-4277-9b86-641314de0acc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:05.301457 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7480f3d-2568-4277-9b86-641314de0acc service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:05.312027 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:05.320658 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 661/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:48:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:48:07.575474 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34863b-b9e2-4140-a408-f012181a06b6 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:07.576023 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34863b-b9e2-4140-a408-f012181a06b6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:07.576023 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34863b-b9e2-4140-a408-f012181a06b6 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:07.577490 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 674/1335] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:48:07.583527 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41355a01-cc9a-4e02-9db0-3058c2b7dcf9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:07.584062 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41355a01-cc9a-4e02-9db0-3058c2b7dcf9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:07.584062 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41355a01-cc9a-4e02-9db0-3058c2b7dcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:07.660168 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-41355a01-cc9a-4e02-9db0-3058c2b7dcf9 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:07.661391 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-41355a01-cc9a-4e02-9db0-3058c2b7dcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:07.763867 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 662/1336] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:48:08.053692 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34863b-b9e2-4140-a408-f012181a06b6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:08.055267 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ba34863b-b9e2-4140-a408-f012181a06b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:08.095775 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:08.165735 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34863b-b9e2-4140-a408-f012181a06b6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:08.242299 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a33c5a-a4fc-4405-be3a-db42697fc2e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:08.242902 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a33c5a-a4fc-4405-be3a-db42697fc2e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:08.243177 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a33c5a-a4fc-4405-be3a-db42697fc2e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:08.243445 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a33c5a-a4fc-4405-be3a-db42697fc2e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:08.245162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-72a33c5a-a4fc-4405-be3a-db42697fc2e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:08.328467 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:08.354141 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a33c5a-a4fc-4405-be3a-db42697fc2e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:08.355652 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a33c5a-a4fc-4405-be3a-db42697fc2e8 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:08.373909 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 675/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:48:10.917541 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e139d-e408-4560-9586-de8bb8f303f6 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:10.918182 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e139d-e408-4560-9586-de8bb8f303f6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:10.918182 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e139d-e408-4560-9586-de8bb8f303f6 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:10.919563 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 663/1338] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:48:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:10.925673 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b0a06-db8b-4d77-9a1d-dc29487c1a89 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:10.926287 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b0a06-db8b-4d77-9a1d-dc29487c1a89 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:10.926287 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b0a06-db8b-4d77-9a1d-dc29487c1a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:11.015828 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-930b0a06-db8b-4d77-9a1d-dc29487c1a89 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:11.017106 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-930b0a06-db8b-4d77-9a1d-dc29487c1a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:11.161687 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 676/1339] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:48:11.470958 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e139d-e408-4560-9586-de8bb8f303f6 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:11.472518 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-831e139d-e408-4560-9586-de8bb8f303f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:11.556635 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:11.586734 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e139d-e408-4560-9586-de8bb8f303f6 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:11.663708 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb15877-222b-4d1e-ae7f-383d69010f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:11.664213 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb15877-222b-4d1e-ae7f-383d69010f44 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:11.664490 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb15877-222b-4d1e-ae7f-383d69010f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:11.664759 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb15877-222b-4d1e-ae7f-383d69010f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:11.666394 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-eeb15877-222b-4d1e-ae7f-383d69010f44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:11.779693 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb15877-222b-4d1e-ae7f-383d69010f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:11.781191 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb15877-222b-4d1e-ae7f-383d69010f44 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:11.800262 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 664/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:48:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:48:15.990177 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdb305-1ced-4e41-9a9a-2995a52e7a94 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:15.990798 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdb305-1ced-4e41-9a9a-2995a52e7a94 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:15.990798 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdb305-1ced-4e41-9a9a-2995a52e7a94 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:15.992125 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 677/1341] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:15.999530 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035069c-094f-47f9-964f-42359e0c15d5 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:16.000380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035069c-094f-47f9-964f-42359e0c15d5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:16.000380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035069c-094f-47f9-964f-42359e0c15d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:16.006373 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:16.076073 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6035069c-094f-47f9-964f-42359e0c15d5 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:16.077356 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6035069c-094f-47f9-964f-42359e0c15d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:16.184868 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 665/1342] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:48:16.476182 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdb305-1ced-4e41-9a9a-2995a52e7a94 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:16.477972 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5ccdb305-1ced-4e41-9a9a-2995a52e7a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:16.535657 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:16.602802 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdb305-1ced-4e41-9a9a-2995a52e7a94 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:16.699187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6581b-9ae3-491d-b28c-6d55c7ccd65f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:16.699741 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6581b-9ae3-491d-b28c-6d55c7ccd65f service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:16.700186 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6581b-9ae3-491d-b28c-6d55c7ccd65f service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:16.700595 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6581b-9ae3-491d-b28c-6d55c7ccd65f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:16.702914 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-17e6581b-9ae3-491d-b28c-6d55c7ccd65f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:16.815294 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:16.834612 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6581b-9ae3-491d-b28c-6d55c7ccd65f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:16.836063 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6581b-9ae3-491d-b28c-6d55c7ccd65f service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:16.857800 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 678/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:48:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:48:19.810471 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9d425-07e0-4875-9a73-7f2fb508ff29 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:19.811058 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9d425-07e0-4875-9a73-7f2fb508ff29 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:19.811058 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9d425-07e0-4875-9a73-7f2fb508ff29 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:19.812351 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 666/1344] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:19.819086 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d76d3a-9a40-4f0e-bdcc-935ea05c6ab9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:19.819662 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d76d3a-9a40-4f0e-bdcc-935ea05c6ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:19.819780 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d76d3a-9a40-4f0e-bdcc-935ea05c6ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:19.910806 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-61d76d3a-9a40-4f0e-bdcc-935ea05c6ab9 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:19.912081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-61d76d3a-9a40-4f0e-bdcc-935ea05c6ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:20.031939 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 679/1345] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:48:20.335348 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9d425-07e0-4875-9a73-7f2fb508ff29 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:20.339330 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-54c9d425-07e0-4875-9a73-7f2fb508ff29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:20.461281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:20.483124 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9d425-07e0-4875-9a73-7f2fb508ff29 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:20.565902 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30925ccb-2407-4c83-8b98-ebec2d57283c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:20.566507 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30925ccb-2407-4c83-8b98-ebec2d57283c service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:20.566781 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30925ccb-2407-4c83-8b98-ebec2d57283c service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:20.567048 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30925ccb-2407-4c83-8b98-ebec2d57283c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:20.568638 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-30925ccb-2407-4c83-8b98-ebec2d57283c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:20.690377 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30925ccb-2407-4c83-8b98-ebec2d57283c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:20.691913 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30925ccb-2407-4c83-8b98-ebec2d57283c service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:20.715633 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 667/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:48:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:48:25.656175 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad94b1-f2c6-4f82-9859-78aef7963bd5 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:25.656713 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad94b1-f2c6-4f82-9859-78aef7963bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:25.656713 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad94b1-f2c6-4f82-9859-78aef7963bd5 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:25.658311 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 680/1347] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:25.663986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d6137-4c3a-4678-a5f9-110403b1c0cb None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:25.664553 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d6137-4c3a-4678-a5f9-110403b1c0cb None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:25.664553 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d6137-4c3a-4678-a5f9-110403b1c0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:25.681650 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:25.743817 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-623d6137-4c3a-4678-a5f9-110403b1c0cb None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:25.745645 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-623d6137-4c3a-4678-a5f9-110403b1c0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:25.869302 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 668/1348] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:48:26.160060 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad94b1-f2c6-4f82-9859-78aef7963bd5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:26.161657 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-abad94b1-f2c6-4f82-9859-78aef7963bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:26.233865 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:26.288622 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad94b1-f2c6-4f82-9859-78aef7963bd5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:26.377178 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee7039-f426-4911-bf9d-22ea5f40f0f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:26.377965 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee7039-f426-4911-bf9d-22ea5f40f0f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:26.378254 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee7039-f426-4911-bf9d-22ea5f40f0f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:26.378528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee7039-f426-4911-bf9d-22ea5f40f0f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:26.380243 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-52ee7039-f426-4911-bf9d-22ea5f40f0f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:26.530581 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:26.535592 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee7039-f426-4911-bf9d-22ea5f40f0f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:26.537077 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee7039-f426-4911-bf9d-22ea5f40f0f7 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:26.557620 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 681/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:48:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:48:31.844669 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f98b3d-61d6-4e66-a1f1-7eda0b28a589 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:31.845258 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f98b3d-61d6-4e66-a1f1-7eda0b28a589 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:31.845258 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f98b3d-61d6-4e66-a1f1-7eda0b28a589 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:31.846835 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 669/1350] 10.222.0.26 () {54 vars in 921 bytes} [Sun Oct 2 00:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:31.855767 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cac5a-f752-4ef6-9a2a-49f86e1ea3df None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:31.855767 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cac5a-f752-4ef6-9a2a-49f86e1ea3df None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:31.855767 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cac5a-f752-4ef6-9a2a-49f86e1ea3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:31.997810 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-fc6cac5a-f752-4ef6-9a2a-49f86e1ea3df None None] MFA Rules not processed for user `a78481cceebd4138b893eba7e51c9c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:31.999665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fc6cac5a-f752-4ef6-9a2a-49f86e1ea3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:32.252104 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 682/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Oct 2 00:48:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:48:35.865688 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=59 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:37.703612 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0f8c4-6852-42f2-8f02-f367199b33a4 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:37.704226 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0f8c4-6852-42f2-8f02-f367199b33a4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:37.704556 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0f8c4-6852-42f2-8f02-f367199b33a4 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:37.707981 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 670/1352] 10.222.0.26 () {54 vars in 921 bytes} [Sun Oct 2 00:48:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:48:37.718004 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a167e8-52e1-45ad-bb0c-70b0b7df8ab1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:37.718942 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a167e8-52e1-45ad-bb0c-70b0b7df8ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:37.719224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a167e8-52e1-45ad-bb0c-70b0b7df8ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:37.811493 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:37.844509 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b6a167e8-52e1-45ad-bb0c-70b0b7df8ab1 None None] MFA Rules not processed for user `a78481cceebd4138b893eba7e51c9c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:37.845794 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b6a167e8-52e1-45ad-bb0c-70b0b7df8ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:37.989788 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 683/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Oct 2 00:48:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:48:39.492969 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241a6c7-8739-45e4-b93f-f0d7c0c5f398 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:39.493773 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241a6c7-8739-45e4-b93f-f0d7c0c5f398 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:39.493968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241a6c7-8739-45e4-b93f-f0d7c0c5f398 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:39.496277 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 671/1354] 10.222.0.26 () {54 vars in 921 bytes} [Sun Oct 2 00:48:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:39.502299 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9010fc-2e8b-4689-a957-9378c4af8001 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:39.503102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9010fc-2e8b-4689-a957-9378c4af8001 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:39.503102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9010fc-2e8b-4689-a957-9378c4af8001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:39.605163 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0f9010fc-2e8b-4689-a957-9378c4af8001 None None] MFA Rules not processed for user `a78481cceebd4138b893eba7e51c9c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:39.606721 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0f9010fc-2e8b-4689-a957-9378c4af8001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:39.681826 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:39.768048 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 684/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Oct 2 00:48:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:48:43.758373 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d875c-50aa-41bb-a0ab-28e8b15b4195 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:43.760984 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d875c-50aa-41bb-a0ab-28e8b15b4195 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:43.761510 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d875c-50aa-41bb-a0ab-28e8b15b4195 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:43.763558 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 672/1356] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:48:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:43.770638 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb45d8d-bf93-4bb2-876d-d85a9627b239 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:43.771152 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb45d8d-bf93-4bb2-876d-d85a9627b239 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:43.771152 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb45d8d-bf93-4bb2-876d-d85a9627b239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:43.859713 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3fb45d8d-bf93-4bb2-876d-d85a9627b239 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:43.861102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3fb45d8d-bf93-4bb2-876d-d85a9627b239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:43.988250 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 685/1357] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:48:44.308925 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba9aa0-6d85-4847-bfc1-554c1956606e None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:44.309737 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba9aa0-6d85-4847-bfc1-554c1956606e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:44.310537 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba9aa0-6d85-4847-bfc1-554c1956606e None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:44.313925 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 673/1358] 10.222.0.26 () {54 vars in 961 bytes} [Sun Oct 2 00:48:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:44.324404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287eba2c-ecda-4f6e-b76b-e7961946185b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:44.324404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287eba2c-ecda-4f6e-b76b-e7961946185b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:44.324824 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287eba2c-ecda-4f6e-b76b-e7961946185b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:44.345383 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:44.435565 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-287eba2c-ecda-4f6e-b76b-e7961946185b None None] MFA Rules not processed for user `81e0396b7ba341ce8d02b1a149786d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:44.437312 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-287eba2c-ecda-4f6e-b76b-e7961946185b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:44.594202 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 686/1359] 10.222.0.26 () {58 vars in 1058 bytes} [Sun Oct 2 00:48:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:48:44.607169 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba9aa0-6d85-4847-bfc1-554c1956606e None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:44.609108 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a3ba9aa0-6d85-4847-bfc1-554c1956606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:44.800271 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba9aa0-6d85-4847-bfc1-554c1956606e None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:44.898081 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:44.950572 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000b051-b0cd-46ad-b34f-f066d5aea88c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:44.951346 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000b051-b0cd-46ad-b34f-f066d5aea88c service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:44.951649 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000b051-b0cd-46ad-b34f-f066d5aea88c service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:44.951935 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000b051-b0cd-46ad-b34f-f066d5aea88c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:44.954127 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d000b051-b0cd-46ad-b34f-f066d5aea88c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:45.089763 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000b051-b0cd-46ad-b34f-f066d5aea88c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:45.091992 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000b051-b0cd-46ad-b34f-f066d5aea88c service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:45.117877 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 674/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:48:47.670169 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666b8f9-6818-44b5-99c7-a43d4556736f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:47.671014 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666b8f9-6818-44b5-99c7-a43d4556736f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:47.671014 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666b8f9-6818-44b5-99c7-a43d4556736f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:47.674778 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 687/1361] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:48:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:47.680885 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d43d8-65f7-4571-82ab-8eaf47c6bf73 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:47.683100 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d43d8-65f7-4571-82ab-8eaf47c6bf73 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:47.683100 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d43d8-65f7-4571-82ab-8eaf47c6bf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:47.797695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-403d43d8-65f7-4571-82ab-8eaf47c6bf73 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:47.797695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-403d43d8-65f7-4571-82ab-8eaf47c6bf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:47.873777 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:47.980746 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 675/1362] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:48:48.303538 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666b8f9-6818-44b5-99c7-a43d4556736f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:48.305860 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b666b8f9-6818-44b5-99c7-a43d4556736f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:48.416999 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:48.523112 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666b8f9-6818-44b5-99c7-a43d4556736f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:48.722424 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f90285-099f-4f4d-ac73-c7593bb7420d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:48.723216 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f90285-099f-4f4d-ac73-c7593bb7420d service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:48.723477 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f90285-099f-4f4d-ac73-c7593bb7420d service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:48.723759 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f90285-099f-4f4d-ac73-c7593bb7420d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:48.725916 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c6f90285-099f-4f4d-ac73-c7593bb7420d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:48.762112 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:48.865901 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f90285-099f-4f4d-ac73-c7593bb7420d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:48.867541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f90285-099f-4f4d-ac73-c7593bb7420d service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:48.889815 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 688/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:48:51.522166 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2f67e-07e4-48d9-a1a4-d47bb1cd548b None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:51.522955 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2f67e-07e4-48d9-a1a4-d47bb1cd548b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:51.522955 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2f67e-07e4-48d9-a1a4-d47bb1cd548b None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:51.525314 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 676/1364] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:48:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:51.536543 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7347881-77ca-4ebf-b94a-facfbe4a42aa None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:51.537190 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7347881-77ca-4ebf-b94a-facfbe4a42aa None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:51.537871 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7347881-77ca-4ebf-b94a-facfbe4a42aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:51.629608 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d7347881-77ca-4ebf-b94a-facfbe4a42aa None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:51.630893 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d7347881-77ca-4ebf-b94a-facfbe4a42aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:51.759839 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 689/1365] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:48:51.765761 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:52.081222 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd426f-6007-47b7-8352-26dbdba3f2ac None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:52.081573 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd426f-6007-47b7-8352-26dbdba3f2ac None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:52.081786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd426f-6007-47b7-8352-26dbdba3f2ac None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:52.083304 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 677/1366] 10.222.0.26 () {54 vars in 961 bytes} [Sun Oct 2 00:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:52.090992 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e9c96-27cd-48a6-80f3-fd366342956e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:52.091320 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e9c96-27cd-48a6-80f3-fd366342956e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:52.091554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e9c96-27cd-48a6-80f3-fd366342956e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:52.195351 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3a6e9c96-27cd-48a6-80f3-fd366342956e None None] MFA Rules not processed for user `81e0396b7ba341ce8d02b1a149786d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:52.197175 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3a6e9c96-27cd-48a6-80f3-fd366342956e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:52.349509 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 690/1367] 10.222.0.26 () {58 vars in 1058 bytes} [Sun Oct 2 00:48:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:48:52.358984 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd426f-6007-47b7-8352-26dbdba3f2ac None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:52.360903 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8ebd426f-6007-47b7-8352-26dbdba3f2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:52.564662 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd426f-6007-47b7-8352-26dbdba3f2ac None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:52.596756 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:52.781443 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c115326-62a0-48cd-b7cf-fa89bd16fe79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:52.782808 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c115326-62a0-48cd-b7cf-fa89bd16fe79 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:52.783264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c115326-62a0-48cd-b7cf-fa89bd16fe79 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:52.783703 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c115326-62a0-48cd-b7cf-fa89bd16fe79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:52.786989 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4c115326-62a0-48cd-b7cf-fa89bd16fe79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:52.923088 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c115326-62a0-48cd-b7cf-fa89bd16fe79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:52.924709 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c115326-62a0-48cd-b7cf-fa89bd16fe79 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:52.944748 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 678/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:48:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:48:52.988992 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4553a1-2776-45a4-83b4-9f6b90d6a960 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:52.989753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4553a1-2776-45a4-83b4-9f6b90d6a960 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:52.989753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4553a1-2776-45a4-83b4-9f6b90d6a960 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:52.990905 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 691/1369] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:48:52.997025 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866de76-519e-47cf-8af9-7ab223326d92 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:52.997415 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866de76-519e-47cf-8af9-7ab223326d92 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:52.997707 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866de76-519e-47cf-8af9-7ab223326d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:53.049487 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:53.099605 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8866de76-519e-47cf-8af9-7ab223326d92 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:53.100890 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8866de76-519e-47cf-8af9-7ab223326d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:53.245027 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 679/1370] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:48:53.572143 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7555a7-8e0b-4ac3-8f20-a22825361225 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:53.572623 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7555a7-8e0b-4ac3-8f20-a22825361225 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:53.573079 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7555a7-8e0b-4ac3-8f20-a22825361225 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:53.575565 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 692/1371] 10.222.0.26 () {54 vars in 963 bytes} [Sun Oct 2 00:48:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:53.582398 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e82d3f-1c80-4226-9e6e-a728d5e2209a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:53.582942 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e82d3f-1c80-4226-9e6e-a728d5e2209a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:53.583163 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e82d3f-1c80-4226-9e6e-a728d5e2209a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:53.714797 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-46e82d3f-1c80-4226-9e6e-a728d5e2209a None None] MFA Rules not processed for user `3469f1e6a9bf47b58d208bffc3415014`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:53.716083 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-46e82d3f-1c80-4226-9e6e-a728d5e2209a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:53.785346 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:53.829537 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 680/1372] 10.222.0.26 () {58 vars in 1060 bytes} [Sun Oct 2 00:48:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:48:53.846434 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7555a7-8e0b-4ac3-8f20-a22825361225 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:53.849975 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4e7555a7-8e0b-4ac3-8f20-a22825361225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:53.949518 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:54.045282 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7555a7-8e0b-4ac3-8f20-a22825361225 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:54.153631 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a982760-48d5-4d1f-948d-c5c40b9a633a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:54.154410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a982760-48d5-4d1f-948d-c5c40b9a633a service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:54.154795 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a982760-48d5-4d1f-948d-c5c40b9a633a service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:54.155170 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a982760-48d5-4d1f-948d-c5c40b9a633a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:54.157079 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6a982760-48d5-4d1f-948d-c5c40b9a633a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:54.330067 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:54.352738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a982760-48d5-4d1f-948d-c5c40b9a633a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:54.354302 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a982760-48d5-4d1f-948d-c5c40b9a633a service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:54.386281 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 693/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:48:55.424361 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80361dbf-ea25-472a-b1d1-5ea91130e954 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:55.425200 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80361dbf-ea25-472a-b1d1-5ea91130e954 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:55.425389 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80361dbf-ea25-472a-b1d1-5ea91130e954 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:55.427858 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 681/1374] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:48:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:55.437220 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d163bac-5668-4d99-ad15-6b5c9c9fae7d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:55.437990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d163bac-5668-4d99-ad15-6b5c9c9fae7d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:55.437990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d163bac-5668-4d99-ad15-6b5c9c9fae7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:55.548218 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8d163bac-5668-4d99-ad15-6b5c9c9fae7d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:55.550256 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8d163bac-5668-4d99-ad15-6b5c9c9fae7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:55.716400 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 694/1375] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:48:56.183006 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80361dbf-ea25-472a-b1d1-5ea91130e954 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:56.185913 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-80361dbf-ea25-472a-b1d1-5ea91130e954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:56.426600 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80361dbf-ea25-472a-b1d1-5ea91130e954 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:56.498800 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:56.600648 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121e6e2-cb70-4271-8c29-62f063acf03a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:56.601621 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121e6e2-cb70-4271-8c29-62f063acf03a service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:56.602104 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121e6e2-cb70-4271-8c29-62f063acf03a service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:56.602595 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121e6e2-cb70-4271-8c29-62f063acf03a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:56.605996 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b121e6e2-cb70-4271-8c29-62f063acf03a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:56.762491 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121e6e2-cb70-4271-8c29-62f063acf03a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:56.764034 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121e6e2-cb70-4271-8c29-62f063acf03a service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:56.786622 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 682/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:48:59.279992 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c359f-e069-448b-be24-448c037173dd None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:59.280546 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c359f-e069-448b-be24-448c037173dd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:59.280546 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c359f-e069-448b-be24-448c037173dd None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:59.282106 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 695/1377] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:59.287535 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc59db-d6cd-4628-8125-f4d4ab3b06f9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:59.288375 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc59db-d6cd-4628-8125-f4d4ab3b06f9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:59.288656 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc59db-d6cd-4628-8125-f4d4ab3b06f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:59.372301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-35dc59db-d6cd-4628-8125-f4d4ab3b06f9 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:59.373685 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-35dc59db-d6cd-4628-8125-f4d4ab3b06f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:59.383049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:59.521119 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 683/1378] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:48:59.823856 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c359f-e069-448b-be24-448c037173dd None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:59.826013 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b73c359f-e069-448b-be24-448c037173dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:59.939681 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:00.066205 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c359f-e069-448b-be24-448c037173dd None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:00.260114 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce4a7c-8437-46b9-b664-a400c5df1ef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:00.261117 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce4a7c-8437-46b9-b664-a400c5df1ef0 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:00.261251 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce4a7c-8437-46b9-b664-a400c5df1ef0 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:00.261470 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce4a7c-8437-46b9-b664-a400c5df1ef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:00.263127 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4bce4a7c-8437-46b9-b664-a400c5df1ef0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:00.286883 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:00.391288 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce4a7c-8437-46b9-b664-a400c5df1ef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:00.392926 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce4a7c-8437-46b9-b664-a400c5df1ef0 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:00.422857 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 696/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:48:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:02.907995 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a8924-4fba-4a57-8f2c-bb2369d4434e None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:02.907995 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a8924-4fba-4a57-8f2c-bb2369d4434e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:02.907995 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a8924-4fba-4a57-8f2c-bb2369d4434e None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:02.916239 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 684/1380] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:49:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:02.917074 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2b026-9b1a-42aa-a607-6409bb344de1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:02.917903 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2b026-9b1a-42aa-a607-6409bb344de1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:02.917903 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2b026-9b1a-42aa-a607-6409bb344de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:03.018438 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e7f2b026-9b1a-42aa-a607-6409bb344de1 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:03.019783 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e7f2b026-9b1a-42aa-a607-6409bb344de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:03.177836 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:03.187320 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 697/1381] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:49:03.581529 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a8924-4fba-4a57-8f2c-bb2369d4434e None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:03.584410 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-786a8924-4fba-4a57-8f2c-bb2369d4434e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:03.826563 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:03.846059 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a8924-4fba-4a57-8f2c-bb2369d4434e None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:04.059755 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982b33a-65bc-4b70-91fd-9e2538257641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:04.060512 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982b33a-65bc-4b70-91fd-9e2538257641 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:04.060654 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982b33a-65bc-4b70-91fd-9e2538257641 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:04.060913 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982b33a-65bc-4b70-91fd-9e2538257641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:04.062660 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9982b33a-65bc-4b70-91fd-9e2538257641 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:04.220928 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982b33a-65bc-4b70-91fd-9e2538257641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:04.222685 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982b33a-65bc-4b70-91fd-9e2538257641 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:04.241453 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:04.255862 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 685/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:49:06.942554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976c456-84ee-4729-ab82-5f6a13c431b1 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:06.943220 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976c456-84ee-4729-ab82-5f6a13c431b1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:06.943544 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976c456-84ee-4729-ab82-5f6a13c431b1 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:06.946320 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 698/1383] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:49:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:49:06.954075 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f8748-37a8-4f0f-b0e9-b7b4d917af10 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:06.954977 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f8748-37a8-4f0f-b0e9-b7b4d917af10 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:06.954977 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f8748-37a8-4f0f-b0e9-b7b4d917af10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:07.045912 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-880f8748-37a8-4f0f-b0e9-b7b4d917af10 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:07.047159 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-880f8748-37a8-4f0f-b0e9-b7b4d917af10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:07.176555 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 686/1384] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:49:07.482851 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976c456-84ee-4729-ab82-5f6a13c431b1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:07.484910 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2976c456-84ee-4729-ab82-5f6a13c431b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:07.675341 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976c456-84ee-4729-ab82-5f6a13c431b1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:07.785063 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:07.850212 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f66fc1-a257-4df9-8557-bde3b22ec2b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:07.852098 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f66fc1-a257-4df9-8557-bde3b22ec2b7 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:07.853554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f66fc1-a257-4df9-8557-bde3b22ec2b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:07.854047 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f66fc1-a257-4df9-8557-bde3b22ec2b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:07.856422 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-41f66fc1-a257-4df9-8557-bde3b22ec2b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:07.981252 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f66fc1-a257-4df9-8557-bde3b22ec2b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:07.982998 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f66fc1-a257-4df9-8557-bde3b22ec2b7 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:08.006303 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 699/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:49:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:10.265696 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867f5fa-6e33-4256-b499-f8dbd9dbed6e None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:10.266227 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867f5fa-6e33-4256-b499-f8dbd9dbed6e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:10.266227 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867f5fa-6e33-4256-b499-f8dbd9dbed6e None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:10.267729 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 687/1386] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:10.273431 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d10a2-5a8a-4cf0-85ba-d3bf734a8352 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:10.273933 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d10a2-5a8a-4cf0-85ba-d3bf734a8352 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:10.274039 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d10a2-5a8a-4cf0-85ba-d3bf734a8352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:10.360322 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b42d10a2-5a8a-4cf0-85ba-d3bf734a8352 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:10.361657 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b42d10a2-5a8a-4cf0-85ba-d3bf734a8352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:10.413392 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:10.495946 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 700/1387] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:49:10.818794 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867f5fa-6e33-4256-b499-f8dbd9dbed6e None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:10.820769 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1867f5fa-6e33-4256-b499-f8dbd9dbed6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:10.907992 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:11.007393 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867f5fa-6e33-4256-b499-f8dbd9dbed6e None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:11.164306 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078615-d754-489b-a9fa-80a9adba6848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:11.165177 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078615-d754-489b-a9fa-80a9adba6848 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:11.165714 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078615-d754-489b-a9fa-80a9adba6848 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:11.166083 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078615-d754-489b-a9fa-80a9adba6848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:11.168390 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-64078615-d754-489b-a9fa-80a9adba6848 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:11.227523 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:11.305774 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64078615-d754-489b-a9fa-80a9adba6848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:11.307433 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64078615-d754-489b-a9fa-80a9adba6848 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:11.331507 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 688/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:11.749661 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0199bc-e5e7-41c2-820a-eee44abc0601 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:11.750491 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0199bc-e5e7-41c2-820a-eee44abc0601 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:11.750491 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0199bc-e5e7-41c2-820a-eee44abc0601 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:11.751792 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 701/1389] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:11.760931 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb546c1-43a7-450d-9cea-fdef3893e7ac None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:11.761350 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb546c1-43a7-450d-9cea-fdef3893e7ac None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:11.761826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb546c1-43a7-450d-9cea-fdef3893e7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:11.850525 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ffb546c1-43a7-450d-9cea-fdef3893e7ac None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:11.852274 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ffb546c1-43a7-450d-9cea-fdef3893e7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:12.006443 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 689/1390] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:49:12.377374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33432e2-1066-43aa-9beb-5c4294dde6cd None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:12.377740 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33432e2-1066-43aa-9beb-5c4294dde6cd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:12.378272 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33432e2-1066-43aa-9beb-5c4294dde6cd None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:12.379604 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 702/1391] 10.222.0.26 () {54 vars in 962 bytes} [Sun Oct 2 00:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:49:12.386992 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fc9c0-876c-4ef6-ba3b-50b0afd585d0 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:12.387653 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fc9c0-876c-4ef6-ba3b-50b0afd585d0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:12.387895 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fc9c0-876c-4ef6-ba3b-50b0afd585d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:12.417601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:12.516374 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-104fc9c0-876c-4ef6-ba3b-50b0afd585d0 None None] MFA Rules not processed for user `2920ad41c61b401299ca5ae1714b4031`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:12.518143 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-104fc9c0-876c-4ef6-ba3b-50b0afd585d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:12.652453 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 690/1392] 10.222.0.26 () {58 vars in 1059 bytes} [Sun Oct 2 00:49:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:49:12.663114 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33432e2-1066-43aa-9beb-5c4294dde6cd None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:12.664786 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f33432e2-1066-43aa-9beb-5c4294dde6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:12.802701 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33432e2-1066-43aa-9beb-5c4294dde6cd None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:12.879621 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:12.898660 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6195e-11c4-4813-9627-52e3693f1a54 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2920ad41c61b401299ca5ae1714b4031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:12.899412 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6195e-11c4-4813-9627-52e3693f1a54 service glance] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:12.899693 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6195e-11c4-4813-9627-52e3693f1a54 service glance] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:12.904882 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6195e-11c4-4813-9627-52e3693f1a54 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:12.906857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3ae6195e-11c4-4813-9627-52e3693f1a54 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:13.045984 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6195e-11c4-4813-9627-52e3693f1a54 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:13.047745 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6195e-11c4-4813-9627-52e3693f1a54 service glance] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:13.072069 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 703/1393] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:14.005025 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f37b7-fcfd-46b2-9a4a-5124bdcd70fc None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:14.006328 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f37b7-fcfd-46b2-9a4a-5124bdcd70fc None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:14.007114 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f37b7-fcfd-46b2-9a4a-5124bdcd70fc None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:14.009582 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 691/1394] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:49:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:14.009814 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6a1de-433c-4d82-a02b-2dc27155bfe8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:14.010516 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6a1de-433c-4d82-a02b-2dc27155bfe8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:14.010516 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6a1de-433c-4d82-a02b-2dc27155bfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:14.015925 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81353f8-6129-4cf5-b534-5996e5890742 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:14.016218 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81353f8-6129-4cf5-b534-5996e5890742 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:14.016629 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81353f8-6129-4cf5-b534-5996e5890742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:14.087404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d7f6a1de-433c-4d82-a02b-2dc27155bfe8 None None] MFA Rules not processed for user `42dcae7ba3c241eb8d7d0894aadb467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:14.089095 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d7f6a1de-433c-4d82-a02b-2dc27155bfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:14.098085 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-c81353f8-6129-4cf5-b534-5996e5890742 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:14.099320 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c81353f8-6129-4cf5-b534-5996e5890742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:14.140483 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:14.164671 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:14.208205 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 704/1395] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Oct 2 00:49:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:49:14.216701 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 692/1396] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:49:14.264805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c7c2d-1bbc-4c47-b6f7-84561266e061 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:14.265119 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c7c2d-1bbc-4c47-b6f7-84561266e061 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:14.265410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c7c2d-1bbc-4c47-b6f7-84561266e061 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:14.266772 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 705/1397] 10.222.0.26 () {54 vars in 943 bytes} [Sun Oct 2 00:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:49:14.273694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f8bee-ca19-4f21-83c0-311f9e046c1f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:14.273981 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f8bee-ca19-4f21-83c0-311f9e046c1f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:14.274446 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f8bee-ca19-4f21-83c0-311f9e046c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:14.359108 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-821f8bee-ca19-4f21-83c0-311f9e046c1f None None] MFA Rules not processed for user `2784579d2ddf4cc99fe0e1d109e5cdda`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:14.360333 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-821f8bee-ca19-4f21-83c0-311f9e046c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:14.486564 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 693/1398] 10.222.0.26 () {58 vars in 1040 bytes} [Sun Oct 2 00:49:14 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:49:14.497723 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c7c2d-1bbc-4c47-b6f7-84561266e061 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:14.499738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-694c7c2d-1bbc-4c47-b6f7-84561266e061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:14.515148 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f8bee-ca19-4f21-83c0-311f9e046c1f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:14.516383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-821f8bee-ca19-4f21-83c0-311f9e046c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:14.540757 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:14.629550 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f8bee-ca19-4f21-83c0-311f9e046c1f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:14.652451 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c7c2d-1bbc-4c47-b6f7-84561266e061 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:14.707113 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:14.763563 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55407d0-2a5f-4640-a6a7-b93026faf0cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:14.764189 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55407d0-2a5f-4640-a6a7-b93026faf0cf service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:14.764471 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55407d0-2a5f-4640-a6a7-b93026faf0cf service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:14.764744 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55407d0-2a5f-4640-a6a7-b93026faf0cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:14.766562 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e55407d0-2a5f-4640-a6a7-b93026faf0cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:14.806792 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:14.879103 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55407d0-2a5f-4640-a6a7-b93026faf0cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:14.880722 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55407d0-2a5f-4640-a6a7-b93026faf0cf service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:14.900526 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89db612-35d8-493b-9979-87de6415e46c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784579d2ddf4cc99fe0e1d109e5cdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:14.901175 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89db612-35d8-493b-9979-87de6415e46c service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:14.901460 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89db612-35d8-493b-9979-87de6415e46c service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:14.901736 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89db612-35d8-493b-9979-87de6415e46c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:14.902514 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 694/1399] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:14.903439 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e89db612-35d8-493b-9979-87de6415e46c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:15.023942 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89db612-35d8-493b-9979-87de6415e46c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:15.025878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89db612-35d8-493b-9979-87de6415e46c service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:15.035442 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 706/1400] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Oct 2 00:49:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 00:49:17.216572 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79115e2-1188-4e6b-b988-40d3f6b92fc2 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:17.217625 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79115e2-1188-4e6b-b988-40d3f6b92fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:17.218214 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79115e2-1188-4e6b-b988-40d3f6b92fc2 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:17.219604 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 695/1401] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:49:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:17.225499 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dcc61-525f-4b8b-bf03-a30395e7e483 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:17.225972 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dcc61-525f-4b8b-bf03-a30395e7e483 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:17.226087 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dcc61-525f-4b8b-bf03-a30395e7e483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:17.329564 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2c6dcc61-525f-4b8b-bf03-a30395e7e483 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:17.331446 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2c6dcc61-525f-4b8b-bf03-a30395e7e483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:17.389109 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:17.509092 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 707/1402] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:49:17.828023 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79115e2-1188-4e6b-b988-40d3f6b92fc2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:17.829595 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c79115e2-1188-4e6b-b988-40d3f6b92fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:18.074924 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79115e2-1188-4e6b-b988-40d3f6b92fc2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:18.086418 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:18.231657 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d4232-12fd-44d4-b752-4a7b7b712602 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:18.232374 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d4232-12fd-44d4-b752-4a7b7b712602 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:18.232550 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d4232-12fd-44d4-b752-4a7b7b712602 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:18.232826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d4232-12fd-44d4-b752-4a7b7b712602 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:18.235456 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7e9d4232-12fd-44d4-b752-4a7b7b712602 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:18.349043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d4232-12fd-44d4-b752-4a7b7b712602 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:18.350576 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d4232-12fd-44d4-b752-4a7b7b712602 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:18.377273 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 696/1403] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:20.677578 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160f931-1cf2-4a03-b5b7-d5dc6a492e9b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:20.678148 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160f931-1cf2-4a03-b5b7-d5dc6a492e9b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:20.678148 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160f931-1cf2-4a03-b5b7-d5dc6a492e9b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:20.680013 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 708/1404] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:20.686725 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1526559-1a7e-4bf6-910b-dfffbc1fb306 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:20.687532 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1526559-1a7e-4bf6-910b-dfffbc1fb306 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:20.687532 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1526559-1a7e-4bf6-910b-dfffbc1fb306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:20.704692 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:20.768123 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b1526559-1a7e-4bf6-910b-dfffbc1fb306 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:20.769457 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b1526559-1a7e-4bf6-910b-dfffbc1fb306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:20.941554 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 697/1405] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:49:21.241115 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160f931-1cf2-4a03-b5b7-d5dc6a492e9b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:21.243048 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4160f931-1cf2-4a03-b5b7-d5dc6a492e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:21.466630 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160f931-1cf2-4a03-b5b7-d5dc6a492e9b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:21.491407 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:21.633808 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932c706-18a3-45b3-bec0-6e49068e0493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:21.634442 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932c706-18a3-45b3-bec0-6e49068e0493 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:21.634728 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932c706-18a3-45b3-bec0-6e49068e0493 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:21.635003 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932c706-18a3-45b3-bec0-6e49068e0493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:21.636806 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1932c706-18a3-45b3-bec0-6e49068e0493 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:21.756857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932c706-18a3-45b3-bec0-6e49068e0493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:21.759175 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932c706-18a3-45b3-bec0-6e49068e0493 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:21.780423 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 709/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:24.177736 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea4f92-2a71-47d8-b5a0-e92938fc1487 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:24.179961 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea4f92-2a71-47d8-b5a0-e92938fc1487 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:24.180770 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea4f92-2a71-47d8-b5a0-e92938fc1487 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:24.183962 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 698/1407] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:49:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:24.189426 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbf70d-f18d-4e50-b11b-6437ef9d9dbe None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:24.190162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbf70d-f18d-4e50-b11b-6437ef9d9dbe None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:24.190162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbf70d-f18d-4e50-b11b-6437ef9d9dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:24.219242 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:24.298900 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-53bbf70d-f18d-4e50-b11b-6437ef9d9dbe None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:24.300632 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-53bbf70d-f18d-4e50-b11b-6437ef9d9dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:24.454929 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 710/1408] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:49:24.788855 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea4f92-2a71-47d8-b5a0-e92938fc1487 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:24.790576 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-58ea4f92-2a71-47d8-b5a0-e92938fc1487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:24.917263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:25.017505 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea4f92-2a71-47d8-b5a0-e92938fc1487 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:25.199026 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9abd9-d7a4-4cc6-80bf-9a687fa3d871 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:25.199712 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9abd9-d7a4-4cc6-80bf-9a687fa3d871 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:25.199905 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9abd9-d7a4-4cc6-80bf-9a687fa3d871 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:25.200173 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9abd9-d7a4-4cc6-80bf-9a687fa3d871 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:25.201883 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-beb9abd9-d7a4-4cc6-80bf-9a687fa3d871 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:25.307365 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:25.364864 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9abd9-d7a4-4cc6-80bf-9a687fa3d871 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:25.369268 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9abd9-d7a4-4cc6-80bf-9a687fa3d871 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:25.402887 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 699/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:34.451795 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=57 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:35.399104 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=21 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:39.652584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01295f78-0e8c-45a6-9950-c313885fb970 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:39.653334 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01295f78-0e8c-45a6-9950-c313885fb970 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:39.653334 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01295f78-0e8c-45a6-9950-c313885fb970 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:39.655265 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 711/1410] 10.222.0.26 () {54 vars in 918 bytes} [Sun Oct 2 00:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:39.660933 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c06f74-489b-4630-ab1d-91b62acd5602 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:39.661491 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c06f74-489b-4630-ab1d-91b62acd5602 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:39.661491 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c06f74-489b-4630-ab1d-91b62acd5602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:39.746942 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-f6c06f74-489b-4630-ab1d-91b62acd5602 None None] MFA Rules not processed for user `a78481cceebd4138b893eba7e51c9c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:39.748199 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f6c06f74-489b-4630-ab1d-91b62acd5602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:39.871710 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 700/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Sun Oct 2 00:49:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:49:39.890509 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89aae0-6016-40f4-aae2-ab98f35e3597 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:39.890981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89aae0-6016-40f4-aae2-ab98f35e3597 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:39.891374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89aae0-6016-40f4-aae2-ab98f35e3597 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:39.893785 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 712/1412] 10.222.0.26 () {54 vars in 918 bytes} [Sun Oct 2 00:49:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:39.899081 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9236f6-fccb-4434-9a91-979a35b0cacc None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:39.899365 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9236f6-fccb-4434-9a91-979a35b0cacc None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:39.899638 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9236f6-fccb-4434-9a91-979a35b0cacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:39.990862 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:39.996518 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6e9236f6-fccb-4434-9a91-979a35b0cacc None None] MFA Rules not processed for user `81e0396b7ba341ce8d02b1a149786d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:39.998592 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6e9236f6-fccb-4434-9a91-979a35b0cacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:40.126513 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 701/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Sun Oct 2 00:49:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:49:42.752672 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b6a40-dd94-4d26-936b-396dff29c97c None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:42.753279 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b6a40-dd94-4d26-936b-396dff29c97c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:42.753279 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b6a40-dd94-4d26-936b-396dff29c97c None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:42.754585 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:42.760893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ead20-4a73-414f-9c45-f16e7ce3cd1b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:42.761410 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ead20-4a73-414f-9c45-f16e7ce3cd1b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:42.761508 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ead20-4a73-414f-9c45-f16e7ce3cd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:42.830835 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-cc6ead20-4a73-414f-9c45-f16e7ce3cd1b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:42.832057 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cc6ead20-4a73-414f-9c45-f16e7ce3cd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:42.893806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:42.938807 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:49:43.231171 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b6a40-dd94-4d26-936b-396dff29c97c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:43.232756 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-390b6a40-dd94-4d26-936b-396dff29c97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:43.392233 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b6a40-dd94-4d26-936b-396dff29c97c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:43.494046 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:43.536427 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674eb993-fdfb-46c0-bd6f-7ccc4c71ec13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:43.537086 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674eb993-fdfb-46c0-bd6f-7ccc4c71ec13 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:43.537409 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674eb993-fdfb-46c0-bd6f-7ccc4c71ec13 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:43.537911 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674eb993-fdfb-46c0-bd6f-7ccc4c71ec13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:43.539555 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-674eb993-fdfb-46c0-bd6f-7ccc4c71ec13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:43.644797 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674eb993-fdfb-46c0-bd6f-7ccc4c71ec13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:43.646503 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674eb993-fdfb-46c0-bd6f-7ccc4c71ec13 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:43.666290 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 714/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:44.899502 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d45a12-5bb6-4099-a4b3-ab396920ce84 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:44.900218 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d45a12-5bb6-4099-a4b3-ab396920ce84 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:44.900218 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d45a12-5bb6-4099-a4b3-ab396920ce84 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:44.901483 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:44.908751 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab7abf-a710-4118-8855-b002a1cd6838 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:44.909322 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab7abf-a710-4118-8855-b002a1cd6838 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:44.909322 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab7abf-a710-4118-8855-b002a1cd6838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:44.985373 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2dab7abf-a710-4118-8855-b002a1cd6838 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:44.986581 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2dab7abf-a710-4118-8855-b002a1cd6838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:45.016252 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:45.089365 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:49:45.242861 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d45a12-5bb6-4099-a4b3-ab396920ce84 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:45.244402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-82d45a12-5bb6-4099-a4b3-ab396920ce84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:45.394768 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d45a12-5bb6-4099-a4b3-ab396920ce84 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:45.441687 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:45.638510 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a01965-ce32-4f61-81a3-c8085e285fab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:45.639023 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a01965-ce32-4f61-81a3-c8085e285fab service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:45.639298 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a01965-ce32-4f61-81a3-c8085e285fab service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:45.639579 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a01965-ce32-4f61-81a3-c8085e285fab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:45.641182 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-03a01965-ce32-4f61-81a3-c8085e285fab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:45.737238 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a01965-ce32-4f61-81a3-c8085e285fab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:45.738905 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a01965-ce32-4f61-81a3-c8085e285fab service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:45.758088 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 704/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:46.931873 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa0c90-d3d4-4343-b96e-156a004e0f24 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:46.932450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa0c90-d3d4-4343-b96e-156a004e0f24 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:46.932450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa0c90-d3d4-4343-b96e-156a004e0f24 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:46.933854 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:46.940376 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239d80d-663b-4280-ab52-6a48cb20ef6b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:46.940853 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239d80d-663b-4280-ab52-6a48cb20ef6b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:46.941005 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239d80d-663b-4280-ab52-6a48cb20ef6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:46.996799 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:47.022251 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a239d80d-663b-4280-ab52-6a48cb20ef6b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:47.023563 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a239d80d-663b-4280-ab52-6a48cb20ef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:47.129017 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:49:47.284150 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa0c90-d3d4-4343-b96e-156a004e0f24 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:47.285636 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-91aa0c90-d3d4-4343-b96e-156a004e0f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:47.441270 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa0c90-d3d4-4343-b96e-156a004e0f24 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:47.454884 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:47.567651 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ebc54-e1d1-4407-bd75-f37827caf485 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:47.568180 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ebc54-e1d1-4407-bd75-f37827caf485 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:47.569064 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ebc54-e1d1-4407-bd75-f37827caf485 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:47.569334 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ebc54-e1d1-4407-bd75-f37827caf485 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:47.570998 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f30ebc54-e1d1-4407-bd75-f37827caf485 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:47.673219 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ebc54-e1d1-4407-bd75-f37827caf485 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:47.675172 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ebc54-e1d1-4407-bd75-f37827caf485 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:47.695235 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 717/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:49:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:48.831554 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa30a0-02b7-4628-adc8-736dc33e6690 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:48.832142 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa30a0-02b7-4628-adc8-736dc33e6690 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:48.832142 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa30a0-02b7-4628-adc8-736dc33e6690 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:48.833504 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:48.841285 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70d1d9-5f33-4545-ae1a-5f3191629fac None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:48.841838 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70d1d9-5f33-4545-ae1a-5f3191629fac None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:48.841934 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70d1d9-5f33-4545-ae1a-5f3191629fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:48.861882 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:48.919778 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ea70d1d9-5f33-4545-ae1a-5f3191629fac None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:48.921026 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ea70d1d9-5f33-4545-ae1a-5f3191629fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:49.027610 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:49:49.182343 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa30a0-02b7-4628-adc8-736dc33e6690 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:49.183899 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a5fa30a0-02b7-4628-adc8-736dc33e6690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:49.300833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:49.339416 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa30a0-02b7-4628-adc8-736dc33e6690 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:49.465407 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5c194-137f-464d-bc94-26c684d13d08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:49.465930 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5c194-137f-464d-bc94-26c684d13d08 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:49.466208 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5c194-137f-464d-bc94-26c684d13d08 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:49.466479 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5c194-137f-464d-bc94-26c684d13d08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:49.468096 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ffd5c194-137f-464d-bc94-26c684d13d08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:49.555706 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:49.570972 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5c194-137f-464d-bc94-26c684d13d08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:49.572602 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5c194-137f-464d-bc94-26c684d13d08 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:49.591940 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 707/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:50.735080 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b481a-2bcc-4445-a142-d9f7248b153f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:50.735601 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b481a-2bcc-4445-a142-d9f7248b153f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:50.735601 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b481a-2bcc-4445-a142-d9f7248b153f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:50.736892 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:50.744402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c8a41-b37d-44cf-b456-f3d5b7f25870 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:50.744912 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c8a41-b37d-44cf-b456-f3d5b7f25870 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:50.745077 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c8a41-b37d-44cf-b456-f3d5b7f25870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:50.822636 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5e6c8a41-b37d-44cf-b456-f3d5b7f25870 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:50.823838 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5e6c8a41-b37d-44cf-b456-f3d5b7f25870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:50.924705 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:49:51.077190 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b481a-2bcc-4445-a142-d9f7248b153f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:51.078635 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b44b481a-2bcc-4445-a142-d9f7248b153f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:51.168195 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:51.236408 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b481a-2bcc-4445-a142-d9f7248b153f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:51.353579 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1dd3a-12b7-4f8d-adc9-efd8b03788f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:51.354095 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1dd3a-12b7-4f8d-adc9-efd8b03788f3 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:51.354377 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1dd3a-12b7-4f8d-adc9-efd8b03788f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:51.354648 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1dd3a-12b7-4f8d-adc9-efd8b03788f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:51.356273 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-10a1dd3a-12b7-4f8d-adc9-efd8b03788f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:51.408839 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:51.457855 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1dd3a-12b7-4f8d-adc9-efd8b03788f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:51.459898 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1dd3a-12b7-4f8d-adc9-efd8b03788f3 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:51.480490 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 720/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:49:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:52.556078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0c665-0bcd-415b-97a5-41696602ee52 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:52.556603 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0c665-0bcd-415b-97a5-41696602ee52 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:52.556603 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0c665-0bcd-415b-97a5-41696602ee52 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:52.557964 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:52.564990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc6130-aa74-49c8-af28-e17f446c9a73 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:52.565528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc6130-aa74-49c8-af28-e17f446c9a73 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:52.565528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc6130-aa74-49c8-af28-e17f446c9a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:52.645990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-effc6130-aa74-49c8-af28-e17f446c9a73 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:52.648274 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-effc6130-aa74-49c8-af28-e17f446c9a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:52.751567 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:49:52.907725 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0c665-0bcd-415b-97a5-41696602ee52 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:52.909257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-62f0c665-0bcd-415b-97a5-41696602ee52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:52.960798 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:53.066553 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0c665-0bcd-415b-97a5-41696602ee52 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:53.185258 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6591c61-ae6c-4ec3-bb26-ca82771ebf6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:53.185778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6591c61-ae6c-4ec3-bb26-ca82771ebf6f service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:53.186055 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6591c61-ae6c-4ec3-bb26-ca82771ebf6f service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:53.186323 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6591c61-ae6c-4ec3-bb26-ca82771ebf6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:53.187948 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a6591c61-ae6c-4ec3-bb26-ca82771ebf6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:53.196059 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:53.284223 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6591c61-ae6c-4ec3-bb26-ca82771ebf6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:53.285882 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6591c61-ae6c-4ec3-bb26-ca82771ebf6f service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:53.312499 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 710/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:54.410922 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e036b3-e7e8-444f-a4d5-98e41edf5336 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:54.411347 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e036b3-e7e8-444f-a4d5-98e41edf5336 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:54.411475 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e036b3-e7e8-444f-a4d5-98e41edf5336 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:54.413223 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:54.419785 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10d4e3-2b13-4080-96c3-59968d7b9f86 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:54.420421 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10d4e3-2b13-4080-96c3-59968d7b9f86 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:54.420421 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10d4e3-2b13-4080-96c3-59968d7b9f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:54.507488 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-9d10d4e3-2b13-4080-96c3-59968d7b9f86 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:54.508725 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9d10d4e3-2b13-4080-96c3-59968d7b9f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:54.583145 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:54.611484 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:49:54.763015 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e036b3-e7e8-444f-a4d5-98e41edf5336 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:54.764445 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-87e036b3-e7e8-444f-a4d5-98e41edf5336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:54.784143 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:54.916343 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e036b3-e7e8-444f-a4d5-98e41edf5336 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:55.007377 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:55.035270 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c103c-00e3-457c-8d6b-a592d1003fb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:55.035805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c103c-00e3-457c-8d6b-a592d1003fb6 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:55.036077 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c103c-00e3-457c-8d6b-a592d1003fb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:55.036338 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c103c-00e3-457c-8d6b-a592d1003fb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:55.038130 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-816c103c-00e3-457c-8d6b-a592d1003fb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:55.134284 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c103c-00e3-457c-8d6b-a592d1003fb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:55.135915 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c103c-00e3-457c-8d6b-a592d1003fb6 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:55.156077 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 723/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:49:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:56.241358 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c33e13-8a17-466c-9c42-cf620a0932b9 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:56.241945 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c33e13-8a17-466c-9c42-cf620a0932b9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:56.241945 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c33e13-8a17-466c-9c42-cf620a0932b9 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:56.243254 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:49:56.249916 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c79a6-37d7-4559-bf6b-45601c5b5634 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:56.250433 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c79a6-37d7-4559-bf6b-45601c5b5634 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:56.250433 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c79a6-37d7-4559-bf6b-45601c5b5634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:56.332371 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-923c79a6-37d7-4559-bf6b-45601c5b5634 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:56.334291 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-923c79a6-37d7-4559-bf6b-45601c5b5634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:56.378385 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:56.438490 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:49:56.594090 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c33e13-8a17-466c-9c42-cf620a0932b9 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:56.596019 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-46c33e13-8a17-466c-9c42-cf620a0932b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:56.750220 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c33e13-8a17-466c-9c42-cf620a0932b9 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:56.807301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:56.868918 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6a351-679f-4d9d-a8d0-03b015ee1426 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:56.869547 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6a351-679f-4d9d-a8d0-03b015ee1426 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:56.869823 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6a351-679f-4d9d-a8d0-03b015ee1426 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:56.870092 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6a351-679f-4d9d-a8d0-03b015ee1426 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:56.871704 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7ee6a351-679f-4d9d-a8d0-03b015ee1426 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:56.966164 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6a351-679f-4d9d-a8d0-03b015ee1426 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:56.967778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6a351-679f-4d9d-a8d0-03b015ee1426 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:56.987230 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 713/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:49:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:49:58.072993 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58363fa5-1811-4778-82f2-d6a50a41b0b7 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:58.073609 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58363fa5-1811-4778-82f2-d6a50a41b0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:58.073609 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58363fa5-1811-4778-82f2-d6a50a41b0b7 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:58.074866 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:58.081526 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b1d2e-f2f1-4c79-8328-2c6601a1a06a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:58.082055 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b1d2e-f2f1-4c79-8328-2c6601a1a06a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:58.082055 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b1d2e-f2f1-4c79-8328-2c6601a1a06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:58.163514 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e31b1d2e-f2f1-4c79-8328-2c6601a1a06a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:58.164718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e31b1d2e-f2f1-4c79-8328-2c6601a1a06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:58.166947 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:58.268653 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:49:58.419465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58363fa5-1811-4778-82f2-d6a50a41b0b7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:58.421016 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-58363fa5-1811-4778-82f2-d6a50a41b0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:58.573030 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58363fa5-1811-4778-82f2-d6a50a41b0b7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:58.603157 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:58.694739 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45c8a1-edab-4638-80f4-87c1a4ae67c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:58.695247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45c8a1-edab-4638-80f4-87c1a4ae67c6 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:58.695532 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45c8a1-edab-4638-80f4-87c1a4ae67c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:58.695800 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45c8a1-edab-4638-80f4-87c1a4ae67c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:58.697455 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8b45c8a1-edab-4638-80f4-87c1a4ae67c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:58.790539 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45c8a1-edab-4638-80f4-87c1a4ae67c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:58.792172 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45c8a1-edab-4638-80f4-87c1a4ae67c6 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:58.812145 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 726/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:00.912920 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf19b93-313b-4df4-a31b-51d096cc547c None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:00.913505 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf19b93-313b-4df4-a31b-51d096cc547c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:00.913505 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf19b93-313b-4df4-a31b-51d096cc547c None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:00.914840 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:00.920590 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630f7d6-03f1-4f63-892b-692e70221b22 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:00.921024 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630f7d6-03f1-4f63-892b-692e70221b22 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:00.921172 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630f7d6-03f1-4f63-892b-692e70221b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:00.962782 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:00.989600 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e630f7d6-03f1-4f63-892b-692e70221b22 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:00.991301 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e630f7d6-03f1-4f63-892b-692e70221b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:01.088902 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:01.375969 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf19b93-313b-4df4-a31b-51d096cc547c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:01.377540 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ecf19b93-313b-4df4-a31b-51d096cc547c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:01.489171 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf19b93-313b-4df4-a31b-51d096cc547c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:01.523452 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:01.566064 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bf666-acfa-43dc-8507-ea39a5b85d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:01.566666 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bf666-acfa-43dc-8507-ea39a5b85d61 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:01.566942 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bf666-acfa-43dc-8507-ea39a5b85d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:01.567207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bf666-acfa-43dc-8507-ea39a5b85d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:01.569468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d35bf666-acfa-43dc-8507-ea39a5b85d61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:01.684297 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bf666-acfa-43dc-8507-ea39a5b85d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:01.685770 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bf666-acfa-43dc-8507-ea39a5b85d61 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:01.705379 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 716/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:50:04.086677 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e86fa-cf7f-43ef-9023-81ce8f28cb9f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:04.087312 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e86fa-cf7f-43ef-9023-81ce8f28cb9f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:04.087312 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e86fa-cf7f-43ef-9023-81ce8f28cb9f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:04.088598 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:04.093967 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d9a9b-b6fd-4130-b46f-6e575d7e5bf3 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:04.094552 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d9a9b-b6fd-4130-b46f-6e575d7e5bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:04.094552 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d9a9b-b6fd-4130-b46f-6e575d7e5bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:04.163951 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d81d9a9b-b6fd-4130-b46f-6e575d7e5bf3 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:04.165221 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d81d9a9b-b6fd-4130-b46f-6e575d7e5bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:04.179717 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:04.266745 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:04.553046 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e86fa-cf7f-43ef-9023-81ce8f28cb9f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:04.554584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-863e86fa-cf7f-43ef-9023-81ce8f28cb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:04.662840 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e86fa-cf7f-43ef-9023-81ce8f28cb9f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:04.677030 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:04.743450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8680b-f97c-434d-9565-5e5993147a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:04.744057 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8680b-f97c-434d-9565-5e5993147a3a service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:04.744344 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8680b-f97c-434d-9565-5e5993147a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:04.744610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8680b-f97c-434d-9565-5e5993147a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:04.746276 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6af8680b-f97c-434d-9565-5e5993147a3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:04.858712 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8680b-f97c-434d-9565-5e5993147a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:04.860158 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8680b-f97c-434d-9565-5e5993147a3a service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:04.879008 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 729/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:07.423679 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c64ad1-05af-4370-98e5-61ec132ef503 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:07.424233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c64ad1-05af-4370-98e5-61ec132ef503 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:07.424233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c64ad1-05af-4370-98e5-61ec132ef503 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:07.425632 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:07.431059 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a641d0-5ffd-47ec-afce-d3b1bc9f7523 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:07.431545 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a641d0-5ffd-47ec-afce-d3b1bc9f7523 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:07.431653 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a641d0-5ffd-47ec-afce-d3b1bc9f7523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:07.485551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:07.505457 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f6a641d0-5ffd-47ec-afce-d3b1bc9f7523 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:07.507274 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f6a641d0-5ffd-47ec-afce-d3b1bc9f7523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:07.609639 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:07.907337 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c64ad1-05af-4370-98e5-61ec132ef503 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:07.908952 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-12c64ad1-05af-4370-98e5-61ec132ef503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:08.017480 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c64ad1-05af-4370-98e5-61ec132ef503 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:08.058357 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:08.093455 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fa270-0449-437a-8c6c-1946acb80f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:08.094063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fa270-0449-437a-8c6c-1946acb80f7d service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:08.094339 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fa270-0449-437a-8c6c-1946acb80f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:08.094609 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fa270-0449-437a-8c6c-1946acb80f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:08.096221 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f27fa270-0449-437a-8c6c-1946acb80f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:08.208930 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27fa270-0449-437a-8c6c-1946acb80f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:08.210406 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27fa270-0449-437a-8c6c-1946acb80f7d service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:08.229245 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 719/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:10.597457 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f7e57-a32f-4e0c-974d-c60d7123a720 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:10.598010 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f7e57-a32f-4e0c-974d-c60d7123a720 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:10.598010 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f7e57-a32f-4e0c-974d-c60d7123a720 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:10.599392 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:10.604931 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0f469-1814-40c0-ae5b-de1a0fd13753 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:10.605391 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0f469-1814-40c0-ae5b-de1a0fd13753 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:10.605514 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0f469-1814-40c0-ae5b-de1a0fd13753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:10.674243 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d2e0f469-1814-40c0-ae5b-de1a0fd13753 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:10.675391 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d2e0f469-1814-40c0-ae5b-de1a0fd13753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:10.700831 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:10.780757 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:11.072245 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f7e57-a32f-4e0c-974d-c60d7123a720 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:11.073930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-472f7e57-a32f-4e0c-974d-c60d7123a720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:11.183634 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f7e57-a32f-4e0c-974d-c60d7123a720 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:11.204803 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:11.263570 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6169288-e75e-4a74-a077-4ca62dc4b998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:11.264170 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6169288-e75e-4a74-a077-4ca62dc4b998 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:11.264447 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6169288-e75e-4a74-a077-4ca62dc4b998 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:11.264717 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6169288-e75e-4a74-a077-4ca62dc4b998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:11.266378 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a6169288-e75e-4a74-a077-4ca62dc4b998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:11.381213 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6169288-e75e-4a74-a077-4ca62dc4b998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:11.382883 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6169288-e75e-4a74-a077-4ca62dc4b998 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:11.401283 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 732/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:13.757893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddf38c-7869-45b4-9211-91f63268932e None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:13.758747 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddf38c-7869-45b4-9211-91f63268932e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:13.758747 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddf38c-7869-45b4-9211-91f63268932e None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:13.760403 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:13.766183 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ed50d-d855-485a-9a4f-25f7d119144e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:13.766666 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ed50d-d855-485a-9a4f-25f7d119144e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:13.766783 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ed50d-d855-485a-9a4f-25f7d119144e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:13.839363 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:13.842556 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3d5ed50d-d855-485a-9a4f-25f7d119144e None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:13.844111 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3d5ed50d-d855-485a-9a4f-25f7d119144e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:13.951718 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:14.244804 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddf38c-7869-45b4-9211-91f63268932e None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:14.246423 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-86ddf38c-7869-45b4-9211-91f63268932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:14.359702 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddf38c-7869-45b4-9211-91f63268932e None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:14.418735 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:14.448484 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6d7ff-4275-470d-8405-464c826b472f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:14.449014 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6d7ff-4275-470d-8405-464c826b472f service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:14.449291 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6d7ff-4275-470d-8405-464c826b472f service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:14.449556 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6d7ff-4275-470d-8405-464c826b472f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:14.451223 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-56c6d7ff-4275-470d-8405-464c826b472f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:14.568464 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6d7ff-4275-470d-8405-464c826b472f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:14.569996 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6d7ff-4275-470d-8405-464c826b472f service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:14.590095 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 722/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:16.870517 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be60119-a77a-485a-a433-bde7ccb6c941 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:16.871088 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be60119-a77a-485a-a433-bde7ccb6c941 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:16.871088 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be60119-a77a-485a-a433-bde7ccb6c941 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:16.872411 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:16.877888 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1194094-8532-4b63-b0af-2c18bfe8efb9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:16.878305 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1194094-8532-4b63-b0af-2c18bfe8efb9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:16.878470 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1194094-8532-4b63-b0af-2c18bfe8efb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:16.947280 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a1194094-8532-4b63-b0af-2c18bfe8efb9 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:16.948496 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a1194094-8532-4b63-b0af-2c18bfe8efb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:16.977567 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:17.046833 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:17.334691 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be60119-a77a-485a-a433-bde7ccb6c941 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:17.336237 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0be60119-a77a-485a-a433-bde7ccb6c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:17.452627 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be60119-a77a-485a-a433-bde7ccb6c941 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:17.482481 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:17.530053 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d14795-dd15-4084-9587-0c6b4fa22ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:17.530658 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d14795-dd15-4084-9587-0c6b4fa22ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:17.530944 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d14795-dd15-4084-9587-0c6b4fa22ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:17.531214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d14795-dd15-4084-9587-0c6b4fa22ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:17.532841 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e7d14795-dd15-4084-9587-0c6b4fa22ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:17.656433 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d14795-dd15-4084-9587-0c6b4fa22ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:17.658041 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d14795-dd15-4084-9587-0c6b4fa22ca0 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:17.680004 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 735/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:19.912506 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22068b65-a044-4311-b5e3-f9b039aa0179 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:19.913071 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22068b65-a044-4311-b5e3-f9b039aa0179 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:19.913071 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22068b65-a044-4311-b5e3-f9b039aa0179 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:19.914437 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:19.919908 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace2f5b-5308-472c-a473-4b5360e09fa5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:19.920327 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace2f5b-5308-472c-a473-4b5360e09fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:19.920557 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace2f5b-5308-472c-a473-4b5360e09fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:19.990062 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8ace2f5b-5308-472c-a473-4b5360e09fa5 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:19.991294 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8ace2f5b-5308-472c-a473-4b5360e09fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:19.999823 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:20.092170 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:20.380656 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22068b65-a044-4311-b5e3-f9b039aa0179 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:20.382294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-22068b65-a044-4311-b5e3-f9b039aa0179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:20.489381 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22068b65-a044-4311-b5e3-f9b039aa0179 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:20.546646 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:20.565170 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ad351-377d-4cd8-bc40-1e6bec135c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:20.565780 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ad351-377d-4cd8-bc40-1e6bec135c3a service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:20.566055 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ad351-377d-4cd8-bc40-1e6bec135c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:20.566324 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ad351-377d-4cd8-bc40-1e6bec135c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:20.568554 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-bc3ad351-377d-4cd8-bc40-1e6bec135c3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:20.690816 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ad351-377d-4cd8-bc40-1e6bec135c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:20.692311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ad351-377d-4cd8-bc40-1e6bec135c3a service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:20.711527 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 725/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:22.990986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf49c59-46b9-48fc-bbbe-998a132ce4dc None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:22.991512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf49c59-46b9-48fc-bbbe-998a132ce4dc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:22.991512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf49c59-46b9-48fc-bbbe-998a132ce4dc None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:22.992791 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:22.998766 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8730831-6320-4128-beb3-4fed0d529049 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:22.999183 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8730831-6320-4128-beb3-4fed0d529049 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:22.999324 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8730831-6320-4128-beb3-4fed0d529049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:23.067203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a8730831-6320-4128-beb3-4fed0d529049 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:23.068594 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a8730831-6320-4128-beb3-4fed0d529049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:23.106704 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:23.166728 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:23.456770 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf49c59-46b9-48fc-bbbe-998a132ce4dc None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:23.459203 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-daf49c59-46b9-48fc-bbbe-998a132ce4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:23.567628 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf49c59-46b9-48fc-bbbe-998a132ce4dc None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:23.607875 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:23.649189 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aedb0b-3cc6-4bc1-8db4-4ec0e6d9a742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:23.649827 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aedb0b-3cc6-4bc1-8db4-4ec0e6d9a742 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:23.650107 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aedb0b-3cc6-4bc1-8db4-4ec0e6d9a742 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:23.650390 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aedb0b-3cc6-4bc1-8db4-4ec0e6d9a742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:23.652180 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f6aedb0b-3cc6-4bc1-8db4-4ec0e6d9a742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:23.771508 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aedb0b-3cc6-4bc1-8db4-4ec0e6d9a742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:23.772879 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aedb0b-3cc6-4bc1-8db4-4ec0e6d9a742 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:23.792789 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 738/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:26.000585 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965f8d0-5dfb-4225-b994-9931ee86c54a None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:26.001192 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965f8d0-5dfb-4225-b994-9931ee86c54a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:26.001192 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965f8d0-5dfb-4225-b994-9931ee86c54a None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:26.002856 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:26.008587 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2f643-4187-45de-9b66-3f0d2f5af208 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:26.009009 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2f643-4187-45de-9b66-3f0d2f5af208 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:26.009184 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2f643-4187-45de-9b66-3f0d2f5af208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:26.078029 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-56d2f643-4187-45de-9b66-3f0d2f5af208 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:26.079256 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-56d2f643-4187-45de-9b66-3f0d2f5af208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:26.098808 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:26.181122 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:26.469816 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965f8d0-5dfb-4225-b994-9931ee86c54a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:26.471380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7965f8d0-5dfb-4225-b994-9931ee86c54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:26.579082 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965f8d0-5dfb-4225-b994-9931ee86c54a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:26.650735 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:26.658173 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a9095-6653-45d0-bbb7-a5a08540354a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:26.658828 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a9095-6653-45d0-bbb7-a5a08540354a service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:26.659053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a9095-6653-45d0-bbb7-a5a08540354a service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:26.659328 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a9095-6653-45d0-bbb7-a5a08540354a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:26.661737 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-460a9095-6653-45d0-bbb7-a5a08540354a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:26.783674 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a9095-6653-45d0-bbb7-a5a08540354a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:26.786081 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a9095-6653-45d0-bbb7-a5a08540354a service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:26.806496 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 728/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:29.029304 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efbedf-79a7-4642-9bf9-91053b75cdb6 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:29.029926 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efbedf-79a7-4642-9bf9-91053b75cdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:29.029926 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efbedf-79a7-4642-9bf9-91053b75cdb6 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:29.031210 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:29.036858 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ba62c-15ad-4720-b61f-a75937d32157 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:29.037347 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ba62c-15ad-4720-b61f-a75937d32157 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:29.037462 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ba62c-15ad-4720-b61f-a75937d32157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:29.105694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-603ba62c-15ad-4720-b61f-a75937d32157 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:29.106919 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-603ba62c-15ad-4720-b61f-a75937d32157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:29.157153 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:29.207653 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:50:29.495736 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efbedf-79a7-4642-9bf9-91053b75cdb6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:29.497301 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c6efbedf-79a7-4642-9bf9-91053b75cdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:29.606170 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efbedf-79a7-4642-9bf9-91053b75cdb6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:29.656125 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:29.683136 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d919874-3ea7-4fd5-b5ed-c14c2a5b631a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:29.683675 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d919874-3ea7-4fd5-b5ed-c14c2a5b631a service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:29.683947 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d919874-3ea7-4fd5-b5ed-c14c2a5b631a service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:29.684211 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d919874-3ea7-4fd5-b5ed-c14c2a5b631a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:29.685846 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1d919874-3ea7-4fd5-b5ed-c14c2a5b631a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:29.798096 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d919874-3ea7-4fd5-b5ed-c14c2a5b631a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:29.799660 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d919874-3ea7-4fd5-b5ed-c14c2a5b631a service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:29.823354 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 741/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:39.205823 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=22 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:39.820775 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=66 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:50.249934 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028250d7-3613-46dd-a4eb-5474ff3d0a36 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:50.250493 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028250d7-3613-46dd-a4eb-5474ff3d0a36 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:50.250493 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028250d7-3613-46dd-a4eb-5474ff3d0a36 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:50.251838 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 730/1471] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:50.258342 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397e37c-df60-4920-ba39-1a73f780ec9a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:50.258812 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397e37c-df60-4920-ba39-1a73f780ec9a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:50.258812 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397e37c-df60-4920-ba39-1a73f780ec9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:50.326775 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7397e37c-df60-4920-ba39-1a73f780ec9a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:50.327984 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7397e37c-df60-4920-ba39-1a73f780ec9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:50.428994 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 742/1472] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:50.736164 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964a8d8-9879-479c-a79f-5429e065e81e None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:50.736442 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964a8d8-9879-479c-a79f-5429e065e81e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:50.736710 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964a8d8-9879-479c-a79f-5429e065e81e None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:50.738663 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 731/1473] 10.222.0.26 () {54 vars in 962 bytes} [Sun Oct 2 00:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:50.743902 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b396ad1-16f4-469d-ba8d-16dbb0bcb19a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:50.744185 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b396ad1-16f4-469d-ba8d-16dbb0bcb19a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:50.744456 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b396ad1-16f4-469d-ba8d-16dbb0bcb19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:50.821684 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5b396ad1-16f4-469d-ba8d-16dbb0bcb19a None None] MFA Rules not processed for user `2920ad41c61b401299ca5ae1714b4031`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:50.822891 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5b396ad1-16f4-469d-ba8d-16dbb0bcb19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:50.843069 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:50.899945 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 743/1474] 10.222.0.26 () {58 vars in 1059 bytes} [Sun Oct 2 00:50:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:50.908520 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964a8d8-9879-479c-a79f-5429e065e81e None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:50.910236 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c964a8d8-9879-479c-a79f-5429e065e81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:51.019308 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964a8d8-9879-479c-a79f-5429e065e81e None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:51.095281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7977f8-765d-4f28-8dde-184f84130937 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2920ad41c61b401299ca5ae1714b4031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:51.095921 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7977f8-765d-4f28-8dde-184f84130937 service glance] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:51.096231 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7977f8-765d-4f28-8dde-184f84130937 service glance] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:51.097156 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7977f8-765d-4f28-8dde-184f84130937 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:51.098931 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9e7977f8-765d-4f28-8dde-184f84130937 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:51.154867 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:51.212367 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7977f8-765d-4f28-8dde-184f84130937 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:51.213851 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7977f8-765d-4f28-8dde-184f84130937 service glance] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:51.234040 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 732/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:53.540149 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e21299-a560-49b8-9552-2a433ffc2e22 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:53.540709 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e21299-a560-49b8-9552-2a433ffc2e22 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:53.540709 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e21299-a560-49b8-9552-2a433ffc2e22 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:53.542051 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 744/1476] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:53.547435 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214548f-de51-4d7a-b5f3-aa0248ad773f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:53.547861 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214548f-de51-4d7a-b5f3-aa0248ad773f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:53.547978 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214548f-de51-4d7a-b5f3-aa0248ad773f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:53.622190 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-0214548f-de51-4d7a-b5f3-aa0248ad773f None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:53.623403 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0214548f-de51-4d7a-b5f3-aa0248ad773f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:53.724083 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 733/1477] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:53.996380 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e21299-a560-49b8-9552-2a433ffc2e22 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:53.997868 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b2e21299-a560-49b8-9552-2a433ffc2e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:54.128237 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e21299-a560-49b8-9552-2a433ffc2e22 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:54.179277 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:54.227328 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537dcee-605d-4480-b5eb-f539e168b79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:54.227953 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537dcee-605d-4480-b5eb-f539e168b79e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:54.228228 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537dcee-605d-4480-b5eb-f539e168b79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:54.228496 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537dcee-605d-4480-b5eb-f539e168b79e admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:54.229168 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537dcee-605d-4480-b5eb-f539e168b79e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:54.230915 dv-cinder-master-3-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-d537dcee-605d-4480-b5eb-f539e168b79e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:50:54.230915 dv-cinder-master-3-smb devstack@keystone.service[81450]: warnings.warn(msg) Oct 02 00:50:54.230915 dv-cinder-master-3-smb devstack@keystone.service[81450]: Oct 02 00:50:54.232070 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537dcee-605d-4480-b5eb-f539e168b79e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:54.256620 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 745/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Oct 2 00:50:53 2022] GET /identity/v3/projects => generated 2553 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:50:56.490984 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f015d-0b95-4e4b-b579-af3bb4d807ce None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:56.491511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f015d-0b95-4e4b-b579-af3bb4d807ce None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:56.491511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f015d-0b95-4e4b-b579-af3bb4d807ce None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:56.492862 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 734/1479] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:56.498240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e9f50-7085-4c02-98ee-1fa6ff17d906 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:56.498706 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e9f50-7085-4c02-98ee-1fa6ff17d906 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:56.498817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e9f50-7085-4c02-98ee-1fa6ff17d906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:56.567319 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e45e9f50-7085-4c02-98ee-1fa6ff17d906 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:56.568597 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e45e9f50-7085-4c02-98ee-1fa6ff17d906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:56.668417 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 746/1480] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:50:56.974074 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f015d-0b95-4e4b-b579-af3bb4d807ce None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:56.975764 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-257f015d-0b95-4e4b-b579-af3bb4d807ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:56.991294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:57.184427 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f015d-0b95-4e4b-b579-af3bb4d807ce None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:57.275303 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:57.313827 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73f89e-54ab-4ddd-9f69-47d461640506 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:57.314432 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73f89e-54ab-4ddd-9f69-47d461640506 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:57.314711 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73f89e-54ab-4ddd-9f69-47d461640506 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:57.314998 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73f89e-54ab-4ddd-9f69-47d461640506 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:57.316606 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ed73f89e-54ab-4ddd-9f69-47d461640506 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:57.415865 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73f89e-54ab-4ddd-9f69-47d461640506 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:57.417536 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73f89e-54ab-4ddd-9f69-47d461640506 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:57.437668 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 735/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:59.875192 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348e603-c582-4fcc-a661-f973a87df987 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:59.875790 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348e603-c582-4fcc-a661-f973a87df987 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:59.875790 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348e603-c582-4fcc-a661-f973a87df987 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:59.877005 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 747/1482] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:59.883906 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22731df9-7d4e-4a16-b0e5-5638b67bd24d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:59.884450 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22731df9-7d4e-4a16-b0e5-5638b67bd24d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:59.884557 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22731df9-7d4e-4a16-b0e5-5638b67bd24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:59.969937 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-22731df9-7d4e-4a16-b0e5-5638b67bd24d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:59.971756 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-22731df9-7d4e-4a16-b0e5-5638b67bd24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:00.020694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:00.072590 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 736/1483] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:00.367346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348e603-c582-4fcc-a661-f973a87df987 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:00.368988 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e348e603-c582-4fcc-a661-f973a87df987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:00.396033 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:00.491541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348e603-c582-4fcc-a661-f973a87df987 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:00.573903 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8ab66-0506-4ceb-8f4a-278aeadbb3ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:00.574511 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8ab66-0506-4ceb-8f4a-278aeadbb3ae service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:00.574788 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8ab66-0506-4ceb-8f4a-278aeadbb3ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:00.575106 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8ab66-0506-4ceb-8f4a-278aeadbb3ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:00.576709 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-28f8ab66-0506-4ceb-8f4a-278aeadbb3ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:00.657588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:00.708183 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8ab66-0506-4ceb-8f4a-278aeadbb3ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:00.709664 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8ab66-0506-4ceb-8f4a-278aeadbb3ae service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:00.729523 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 748/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:51:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:51:03.001061 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78906d4e-d890-4075-b77a-7592edee391c None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:03.001669 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78906d4e-d890-4075-b77a-7592edee391c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:03.001669 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78906d4e-d890-4075-b77a-7592edee391c None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:03.003581 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 737/1485] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:03.009115 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397c81a-76ba-48d1-a5d4-ea204c0008c9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:03.009568 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397c81a-76ba-48d1-a5d4-ea204c0008c9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:03.009680 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397c81a-76ba-48d1-a5d4-ea204c0008c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:03.075458 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4397c81a-76ba-48d1-a5d4-ea204c0008c9 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:03.076654 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4397c81a-76ba-48d1-a5d4-ea204c0008c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:03.182705 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 749/1486] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:03.476605 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78906d4e-d890-4075-b77a-7592edee391c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:03.478205 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-78906d4e-d890-4075-b77a-7592edee391c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:03.586430 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78906d4e-d890-4075-b77a-7592edee391c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:03.668918 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:03.670391 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be6c1f-0177-4c88-b9d7-3318908a0db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:03.671148 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be6c1f-0177-4c88-b9d7-3318908a0db7 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:03.671624 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be6c1f-0177-4c88-b9d7-3318908a0db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:03.672074 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be6c1f-0177-4c88-b9d7-3318908a0db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:03.674694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-91be6c1f-0177-4c88-b9d7-3318908a0db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:03.791336 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be6c1f-0177-4c88-b9d7-3318908a0db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:03.792811 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be6c1f-0177-4c88-b9d7-3318908a0db7 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:03.813788 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 738/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:51:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:51:06.197594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cacde-0059-44d9-8e35-bea53dbea500 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:06.198167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cacde-0059-44d9-8e35-bea53dbea500 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:06.198167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cacde-0059-44d9-8e35-bea53dbea500 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:06.199541 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 750/1488] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:06.204812 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa913e95-09cb-4bb3-87b6-d3300e34c7cc None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:06.205435 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa913e95-09cb-4bb3-87b6-d3300e34c7cc None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:06.205435 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa913e95-09cb-4bb3-87b6-d3300e34c7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:06.274002 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-aa913e95-09cb-4bb3-87b6-d3300e34c7cc None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:06.275206 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-aa913e95-09cb-4bb3-87b6-d3300e34c7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:06.328887 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:06.379083 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 739/1489] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:06.677793 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cacde-0059-44d9-8e35-bea53dbea500 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:06.679382 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-461cacde-0059-44d9-8e35-bea53dbea500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:06.724118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:06.794482 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cacde-0059-44d9-8e35-bea53dbea500 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:06.869525 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e1a72-a2a8-4ba8-8080-ed983758d668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:06.870133 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e1a72-a2a8-4ba8-8080-ed983758d668 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:06.870405 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e1a72-a2a8-4ba8-8080-ed983758d668 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:06.870670 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e1a72-a2a8-4ba8-8080-ed983758d668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:06.872253 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ed1e1a72-a2a8-4ba8-8080-ed983758d668 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:06.962162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:06.996412 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e1a72-a2a8-4ba8-8080-ed983758d668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:06.997903 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e1a72-a2a8-4ba8-8080-ed983758d668 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:07.018525 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 751/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:51:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:51:09.450404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17ffb8-b6f5-4b68-be7c-c3f8c4cc7de0 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:09.450973 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17ffb8-b6f5-4b68-be7c-c3f8c4cc7de0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:09.450973 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17ffb8-b6f5-4b68-be7c-c3f8c4cc7de0 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:09.452266 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 740/1491] 10.222.0.26 () {54 vars in 927 bytes} [Sun Oct 2 00:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:09.457712 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4868e4c-8704-42d7-82e8-0ab195d0ae1a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:09.458181 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4868e4c-8704-42d7-82e8-0ab195d0ae1a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:09.458291 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4868e4c-8704-42d7-82e8-0ab195d0ae1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:09.525333 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b4868e4c-8704-42d7-82e8-0ab195d0ae1a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:09.526597 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b4868e4c-8704-42d7-82e8-0ab195d0ae1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:09.625405 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 752/1492] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Oct 2 00:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:09.931737 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17ffb8-b6f5-4b68-be7c-c3f8c4cc7de0 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:09.933253 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cc17ffb8-b6f5-4b68-be7c-c3f8c4cc7de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:10.044768 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17ffb8-b6f5-4b68-be7c-c3f8c4cc7de0 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:10.132706 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fec545-b723-42a2-9a55-6777c3381ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:10.133346 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fec545-b723-42a2-9a55-6777c3381ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:10.133628 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fec545-b723-42a2-9a55-6777c3381ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:10.134021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fec545-b723-42a2-9a55-6777c3381ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:10.135541 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b2fec545-b723-42a2-9a55-6777c3381ff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:10.144582 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:10.248172 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fec545-b723-42a2-9a55-6777c3381ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:10.249659 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fec545-b723-42a2-9a55-6777c3381ff9 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:10.270359 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 741/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:51:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:51:19.623836 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=82 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:20.267939 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=50 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:25.767857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af11db-da7e-4f03-9fa0-37a484270967 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:25.768498 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af11db-da7e-4f03-9fa0-37a484270967 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:25.768498 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af11db-da7e-4f03-9fa0-37a484270967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:25.847438 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-80af11db-da7e-4f03-9fa0-37a484270967 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:25.848682 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-80af11db-da7e-4f03-9fa0-37a484270967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:25.947623 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 753/1494] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:25.956053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66093f42-2496-4228-9339-af624e2820d4 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:25.956721 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66093f42-2496-4228-9339-af624e2820d4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:25.956721 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66093f42-2496-4228-9339-af624e2820d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:26.034880 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-66093f42-2496-4228-9339-af624e2820d4 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:26.036014 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-66093f42-2496-4228-9339-af624e2820d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:26.133880 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 742/1495] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:26.138692 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af11db-da7e-4f03-9fa0-37a484270967 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:26.139918 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-80af11db-da7e-4f03-9fa0-37a484270967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:26.151349 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af11db-da7e-4f03-9fa0-37a484270967 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:26.221088 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:26.256259 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7e676-4c99-4acf-a589-1774f3f47c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:26.256870 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7e676-4c99-4acf-a589-1774f3f47c20 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:26.257179 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7e676-4c99-4acf-a589-1774f3f47c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:26.257450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7e676-4c99-4acf-a589-1774f3f47c20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:26.258094 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7e676-4c99-4acf-a589-1774f3f47c20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:52:26.258390 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7e676-4c99-4acf-a589-1774f3f47c20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:26.259410 dv-cinder-master-3-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-93e7e676-4c99-4acf-a589-1774f3f47c20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:52:26.259410 dv-cinder-master-3-smb devstack@keystone.service[81450]: warnings.warn(msg) Oct 02 00:52:26.259410 dv-cinder-master-3-smb devstack@keystone.service[81450]: Oct 02 00:52:26.260301 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7e676-4c99-4acf-a589-1774f3f47c20 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:26.272408 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 754/1496] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:52:26.281507 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66093f42-2496-4228-9339-af624e2820d4 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:26.290727 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66093f42-2496-4228-9339-af624e2820d4 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:26.351799 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:26.387107 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b09fe-6357-47c3-bde7-b195d1a9cc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:26.387714 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b09fe-6357-47c3-bde7-b195d1a9cc35 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:26.387992 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b09fe-6357-47c3-bde7-b195d1a9cc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:26.388263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b09fe-6357-47c3-bde7-b195d1a9cc35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:26.388910 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b09fe-6357-47c3-bde7-b195d1a9cc35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:26.390674 dv-cinder-master-3-smb devstack@keystone.service[81451]: WARNING py.warnings [None req-eb1b09fe-6357-47c3-bde7-b195d1a9cc35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:52:26.390674 dv-cinder-master-3-smb devstack@keystone.service[81451]: warnings.warn(msg) Oct 02 00:52:26.390674 dv-cinder-master-3-smb devstack@keystone.service[81451]: Oct 02 00:52:26.391882 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b09fe-6357-47c3-bde7-b195d1a9cc35 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:26.453857 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 743/1497] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:52:26 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:52:26.458356 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7e676-4c99-4acf-a589-1774f3f47c20 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:26.459958 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-93e7e676-4c99-4acf-a589-1774f3f47c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:26.498811 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7e676-4c99-4acf-a589-1774f3f47c20 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:26.606592 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896fd31-a4ec-4ee1-ae1a-026b83c67d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:26.607113 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896fd31-a4ec-4ee1-ae1a-026b83c67d40 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:26.607939 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896fd31-a4ec-4ee1-ae1a-026b83c67d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:26.608234 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896fd31-a4ec-4ee1-ae1a-026b83c67d40 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:26.608873 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896fd31-a4ec-4ee1-ae1a-026b83c67d40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:26.609935 dv-cinder-master-3-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-6896fd31-a4ec-4ee1-ae1a-026b83c67d40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:52:26.609935 dv-cinder-master-3-smb devstack@keystone.service[81450]: warnings.warn(msg) Oct 02 00:52:26.609935 dv-cinder-master-3-smb devstack@keystone.service[81450]: Oct 02 00:52:26.611173 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896fd31-a4ec-4ee1-ae1a-026b83c67d40 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:26.657295 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 755/1498] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:52:26 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:52:26.661835 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b09fe-6357-47c3-bde7-b195d1a9cc35 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:26.663341 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-eb1b09fe-6357-47c3-bde7-b195d1a9cc35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:26.728951 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b09fe-6357-47c3-bde7-b195d1a9cc35 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:26.816306 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:26.827917 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcab2ff-309e-4e39-8cc3-f669865e7b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:26.828524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcab2ff-309e-4e39-8cc3-f669865e7b2e admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:26.828801 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcab2ff-309e-4e39-8cc3-f669865e7b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:26.829106 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcab2ff-309e-4e39-8cc3-f669865e7b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:26.829742 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcab2ff-309e-4e39-8cc3-f669865e7b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:26.830757 dv-cinder-master-3-smb devstack@keystone.service[81451]: WARNING py.warnings [None req-9fcab2ff-309e-4e39-8cc3-f669865e7b2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:52:26.830757 dv-cinder-master-3-smb devstack@keystone.service[81451]: warnings.warn(msg) Oct 02 00:52:26.830757 dv-cinder-master-3-smb devstack@keystone.service[81451]: Oct 02 00:52:26.831650 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcab2ff-309e-4e39-8cc3-f669865e7b2e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:26.844516 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 744/1499] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:52:26.848679 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896fd31-a4ec-4ee1-ae1a-026b83c67d40 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:26.850271 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6896fd31-a4ec-4ee1-ae1a-026b83c67d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:26.862437 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896fd31-a4ec-4ee1-ae1a-026b83c67d40 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:26.889515 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:26.970382 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a17e4-9122-4ebb-ad48-56cdfcd9de83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:26.970994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a17e4-9122-4ebb-ad48-56cdfcd9de83 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:26.971271 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a17e4-9122-4ebb-ad48-56cdfcd9de83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:26.971540 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a17e4-9122-4ebb-ad48-56cdfcd9de83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:26.972183 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a17e4-9122-4ebb-ad48-56cdfcd9de83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:26.973238 dv-cinder-master-3-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-d60a17e4-9122-4ebb-ad48-56cdfcd9de83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:52:26.973238 dv-cinder-master-3-smb devstack@keystone.service[81450]: warnings.warn(msg) Oct 02 00:52:26.973238 dv-cinder-master-3-smb devstack@keystone.service[81450]: Oct 02 00:52:26.974128 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a17e4-9122-4ebb-ad48-56cdfcd9de83 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:26.987006 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 756/1500] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:52:26.991423 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcab2ff-309e-4e39-8cc3-f669865e7b2e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:26.992964 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9fcab2ff-309e-4e39-8cc3-f669865e7b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:27.027778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcab2ff-309e-4e39-8cc3-f669865e7b2e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:27.123675 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3ff8a-e75c-4634-8459-e869e54f02e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:27.124489 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3ff8a-e75c-4634-8459-e869e54f02e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:27.124769 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3ff8a-e75c-4634-8459-e869e54f02e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:27.125074 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3ff8a-e75c-4634-8459-e869e54f02e1 admin admin] PATH_INFO: `/v3/projects/52cd514eb83448a2b1c6448efdee107a/users/5a7f057b3964412fa7de951f63fcf555/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:27.150333 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3ff8a-e75c-4634-8459-e869e54f02e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52cd514eb83448a2b1c6448efdee107a, user_id=5a7f057b3964412fa7de951f63fcf555, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:27.151403 dv-cinder-master-3-smb devstack@keystone.service[81451]: WARNING py.warnings [None req-6cd3ff8a-e75c-4634-8459-e869e54f02e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:52:27.151403 dv-cinder-master-3-smb devstack@keystone.service[81451]: warnings.warn(msg) Oct 02 00:52:27.151403 dv-cinder-master-3-smb devstack@keystone.service[81451]: Oct 02 00:52:27.153431 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3ff8a-e75c-4634-8459-e869e54f02e1 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:27.182068 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 745/1501] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:52:26 2022] PUT /identity/v3/projects/52cd514eb83448a2b1c6448efdee107a/users/5a7f057b3964412fa7de951f63fcf555/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:52:27.194998 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bb92e-56e3-4bb2-8714-9d0146a28bf9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:27.195279 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bb92e-56e3-4bb2-8714-9d0146a28bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:27.195555 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bb92e-56e3-4bb2-8714-9d0146a28bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:27.272883 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5f2bb92e-56e3-4bb2-8714-9d0146a28bf9 None None] MFA Rules not processed for user `5a7f057b3964412fa7de951f63fcf555`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:27.274671 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5f2bb92e-56e3-4bb2-8714-9d0146a28bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:27.361436 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 757/1502] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:52:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:27.375054 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6d88e-19b6-4588-ba36-860bd310fe66 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:27.375279 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6d88e-19b6-4588-ba36-860bd310fe66 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:27.375565 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6d88e-19b6-4588-ba36-860bd310fe66 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:27.376902 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 746/1503] 10.222.0.26 () {54 vars in 963 bytes} [Sun Oct 2 00:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:27.382161 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0171256-fbcb-4eef-8e1f-1a8a846efb52 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:27.382449 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0171256-fbcb-4eef-8e1f-1a8a846efb52 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:27.382727 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0171256-fbcb-4eef-8e1f-1a8a846efb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:27.416640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:27.463395 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e0171256-fbcb-4eef-8e1f-1a8a846efb52 None None] MFA Rules not processed for user `3469f1e6a9bf47b58d208bffc3415014`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:27.464615 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e0171256-fbcb-4eef-8e1f-1a8a846efb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:27.543062 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 758/1504] 10.222.0.26 () {58 vars in 1060 bytes} [Sun Oct 2 00:52:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:27.553455 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6d88e-19b6-4588-ba36-860bd310fe66 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:27.555028 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ccc6d88e-19b6-4588-ba36-860bd310fe66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:27.609646 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:27.674789 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6d88e-19b6-4588-ba36-860bd310fe66 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:27.761137 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0f597-d6ed-4fa8-904c-26ed0976aab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:27.761775 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0f597-d6ed-4fa8-904c-26ed0976aab7 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:27.762052 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0f597-d6ed-4fa8-904c-26ed0976aab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:27.762325 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0f597-d6ed-4fa8-904c-26ed0976aab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:27.764833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-17e0f597-d6ed-4fa8-904c-26ed0976aab7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:27.867785 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0f597-d6ed-4fa8-904c-26ed0976aab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:27.869286 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0f597-d6ed-4fa8-904c-26ed0976aab7 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:27.872786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:27.889926 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 747/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:27.935908 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ab9c3-254e-493b-8b0b-2d3c1ce5d94e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:27.936370 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ab9c3-254e-493b-8b0b-2d3c1ce5d94e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:27.936468 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ab9c3-254e-493b-8b0b-2d3c1ce5d94e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:27.937758 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 759/1506] 10.222.0.26 () {52 vars in 830 bytes} [Sun Oct 2 00:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:27.941400 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0f597-d6ed-4fa8-904c-26ed0976aab7 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:27.942606 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-17e0f597-d6ed-4fa8-904c-26ed0976aab7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:28.046238 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0f597-d6ed-4fa8-904c-26ed0976aab7 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:28.148989 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b316d18-c6e4-4ae2-985c-859c1f1720ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:28.149632 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b316d18-c6e4-4ae2-985c-859c1f1720ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:28.150083 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b316d18-c6e4-4ae2-985c-859c1f1720ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:28.150196 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b316d18-c6e4-4ae2-985c-859c1f1720ca admin admin] PATH_INFO: `/v3/users/5a7f057b3964412fa7de951f63fcf555` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:28.166260 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b316d18-c6e4-4ae2-985c-859c1f1720ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a7f057b3964412fa7de951f63fcf555)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:28.167303 dv-cinder-master-3-smb devstack@keystone.service[81451]: WARNING py.warnings [None req-3b316d18-c6e4-4ae2-985c-859c1f1720ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:52:28.167303 dv-cinder-master-3-smb devstack@keystone.service[81451]: warnings.warn(msg) Oct 02 00:52:28.167303 dv-cinder-master-3-smb devstack@keystone.service[81451]: Oct 02 00:52:28.168530 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b316d18-c6e4-4ae2-985c-859c1f1720ca admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:28.180282 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:28.240704 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3b316d18-c6e4-4ae2-985c-859c1f1720ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a7f057b3964412fa7de951f63fcf555'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:52:28.241170 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3b316d18-c6e4-4ae2-985c-859c1f1720ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a7f057b3964412fa7de951f63fcf555'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:52:28.251045 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3b316d18-c6e4-4ae2-985c-859c1f1720ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a7f057b3964412fa7de951f63fcf555'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:52:28.251823 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3b316d18-c6e4-4ae2-985c-859c1f1720ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a7f057b3964412fa7de951f63fcf555'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:52:28.267407 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3b316d18-c6e4-4ae2-985c-859c1f1720ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a7f057b3964412fa7de951f63fcf555'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:52:28.297128 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 748/1507] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:52:27 2022] DELETE /identity/v3/users/5a7f057b3964412fa7de951f63fcf555 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:52:28.301541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443e2e8-8d1c-4770-9843-86d3ae1a0b48 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:28.301826 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443e2e8-8d1c-4770-9843-86d3ae1a0b48 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:28.302135 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443e2e8-8d1c-4770-9843-86d3ae1a0b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:28.360576 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e443e2e8-8d1c-4770-9843-86d3ae1a0b48 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:28.361812 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e443e2e8-8d1c-4770-9843-86d3ae1a0b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:28.439522 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:28.453728 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 760/1508] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:28.463425 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b316d18-c6e4-4ae2-985c-859c1f1720ca admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:28.464685 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3b316d18-c6e4-4ae2-985c-859c1f1720ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:28.569781 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b316d18-c6e4-4ae2-985c-859c1f1720ca admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:28.628710 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:28.650752 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cec08d-f006-491b-a548-adc0f908a2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:28.651368 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cec08d-f006-491b-a548-adc0f908a2fe service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:28.651646 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cec08d-f006-491b-a548-adc0f908a2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:28.651916 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cec08d-f006-491b-a548-adc0f908a2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:28.653580 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f2cec08d-f006-491b-a548-adc0f908a2fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:28.772294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cec08d-f006-491b-a548-adc0f908a2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:28.773674 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cec08d-f006-491b-a548-adc0f908a2fe service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:28.792430 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 749/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:29.158225 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443e2e8-8d1c-4770-9843-86d3ae1a0b48 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:29.159461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e443e2e8-8d1c-4770-9843-86d3ae1a0b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:29.171587 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443e2e8-8d1c-4770-9843-86d3ae1a0b48 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:29.274942 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed9405-3ea3-4c61-a5ca-a3a2a9bbe571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:29.275741 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed9405-3ea3-4c61-a5ca-a3a2a9bbe571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:29.276019 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed9405-3ea3-4c61-a5ca-a3a2a9bbe571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:29.276282 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed9405-3ea3-4c61-a5ca-a3a2a9bbe571 admin admin] PATH_INFO: `/v3/projects/52cd514eb83448a2b1c6448efdee107a` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:29.288950 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed9405-3ea3-4c61-a5ca-a3a2a9bbe571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52cd514eb83448a2b1c6448efdee107a)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:29.289908 dv-cinder-master-3-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-d6ed9405-3ea3-4c61-a5ca-a3a2a9bbe571 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:52:29.289908 dv-cinder-master-3-smb devstack@keystone.service[81450]: warnings.warn(msg) Oct 02 00:52:29.289908 dv-cinder-master-3-smb devstack@keystone.service[81450]: Oct 02 00:52:29.291109 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed9405-3ea3-4c61-a5ca-a3a2a9bbe571 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:29.354291 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d6ed9405-3ea3-4c61-a5ca-a3a2a9bbe571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52cd514eb83448a2b1c6448efdee107a', 'request_id': 'req-d6ed9405-3ea3-4c61-a5ca-a3a2a9bbe571'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:52:29.370747 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d6ed9405-3ea3-4c61-a5ca-a3a2a9bbe571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52cd514eb83448a2b1c6448efdee107a', 'request_id': 'req-d6ed9405-3ea3-4c61-a5ca-a3a2a9bbe571'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:52:29.382330 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d6ed9405-3ea3-4c61-a5ca-a3a2a9bbe571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52cd514eb83448a2b1c6448efdee107a', 'request_id': 'req-d6ed9405-3ea3-4c61-a5ca-a3a2a9bbe571'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:52:29.407240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d6ed9405-3ea3-4c61-a5ca-a3a2a9bbe571 admin admin] The token cache is being invalidate because project 52cd514eb83448a2b1c6448efdee107a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:52:29.407537 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d6ed9405-3ea3-4c61-a5ca-a3a2a9bbe571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:52:29.408067 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d6ed9405-3ea3-4c61-a5ca-a3a2a9bbe571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:52:29.409570 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 761/1510] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:52:29 2022] DELETE /identity/v3/projects/52cd514eb83448a2b1c6448efdee107a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:52:38.790118 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=62 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:39.404538 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:03.653798 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b063f1-d658-45a3-b81f-5ec703acf699 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:03.654413 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b063f1-d658-45a3-b81f-5ec703acf699 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:03.654413 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b063f1-d658-45a3-b81f-5ec703acf699 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:03.655733 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:54:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:54:03.660763 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff8ad5-138c-4284-972c-715d099e9f0a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:03.661254 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff8ad5-138c-4284-972c-715d099e9f0a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:03.661254 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff8ad5-138c-4284-972c-715d099e9f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:03.748222 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-10ff8ad5-138c-4284-972c-715d099e9f0a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:54:03.749473 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-10ff8ad5-138c-4284-972c-715d099e9f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:03.856245 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:54:04.019894 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b063f1-d658-45a3-b81f-5ec703acf699 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:04.022082 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-54b063f1-d658-45a3-b81f-5ec703acf699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:04.148157 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b063f1-d658-45a3-b81f-5ec703acf699 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:04.154407 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197640d-4357-418c-9c3c-4bdf56a3cae2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:04.155018 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197640d-4357-418c-9c3c-4bdf56a3cae2 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:04.155300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197640d-4357-418c-9c3c-4bdf56a3cae2 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:04.155574 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197640d-4357-418c-9c3c-4bdf56a3cae2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:04.164043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197640d-4357-418c-9c3c-4bdf56a3cae2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:04.165680 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197640d-4357-418c-9c3c-4bdf56a3cae2 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:04.176351 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 751/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:54:04.999624 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f0998-ba49-4c34-8ad4-ea8ea4a6601c None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:05.000163 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f0998-ba49-4c34-8ad4-ea8ea4a6601c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:05.000247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f0998-ba49-4c34-8ad4-ea8ea4a6601c None None] PATH_INFO: `/v3` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:05.001924 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 763/1514] 10.222.0.36 () {54 vars in 925 bytes} [Sun Oct 2 00:54:04 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:54:05.008377 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2c11b-b453-402e-9fc5-9a8405205550 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:05.008893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2c11b-b453-402e-9fc5-9a8405205550 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:05.009047 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2c11b-b453-402e-9fc5-9a8405205550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:05.076256 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-77c2c11b-b453-402e-9fc5-9a8405205550 None None] MFA Rules not processed for user `a78481cceebd4138b893eba7e51c9c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:54:05.077499 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-77c2c11b-b453-402e-9fc5-9a8405205550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:05.151404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:05.157534 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 752/1515] 10.222.0.36 () {58 vars in 1015 bytes} [Sun Oct 2 00:54:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:54:05.299644 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce825540-9256-48d5-a817-1fe99c648a54 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:05.299958 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce825540-9256-48d5-a817-1fe99c648a54 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:05.300242 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce825540-9256-48d5-a817-1fe99c648a54 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:05.301649 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 764/1516] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:54:05.308241 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc7a0c-6e1f-4ec3-a1a1-5bd7efd17075 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:05.308513 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc7a0c-6e1f-4ec3-a1a1-5bd7efd17075 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:05.308792 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc7a0c-6e1f-4ec3-a1a1-5bd7efd17075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:05.328902 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8bcc7a0c-6e1f-4ec3-a1a1-5bd7efd17075 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:54:05.330148 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8bcc7a0c-6e1f-4ec3-a1a1-5bd7efd17075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:05.338086 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 753/1517] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:54:05.493304 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce825540-9256-48d5-a817-1fe99c648a54 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:05.511859 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce825540-9256-48d5-a817-1fe99c648a54 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:05.517393 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdfb02-15db-4bcd-bd8d-578100c8af2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:05.518007 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdfb02-15db-4bcd-bd8d-578100c8af2c service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:05.518280 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdfb02-15db-4bcd-bd8d-578100c8af2c service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:05.518545 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdfb02-15db-4bcd-bd8d-578100c8af2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:05.527935 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdfb02-15db-4bcd-bd8d-578100c8af2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:05.529550 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdfb02-15db-4bcd-bd8d-578100c8af2c service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:05.538909 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 765/1518] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:54:13.694620 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b46ce-441c-4cec-bee7-f431bfcdc499 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:13.695597 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b46ce-441c-4cec-bee7-f431bfcdc499 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:13.695597 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b46ce-441c-4cec-bee7-f431bfcdc499 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:13.697328 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 754/1519] 10.222.0.26 () {54 vars in 961 bytes} [Sun Oct 2 00:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:54:13.704667 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b918a8f-90e2-4a00-a0b8-3f6dee64e05e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:13.705309 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b918a8f-90e2-4a00-a0b8-3f6dee64e05e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:13.705309 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b918a8f-90e2-4a00-a0b8-3f6dee64e05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:13.731911 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5b918a8f-90e2-4a00-a0b8-3f6dee64e05e None None] MFA Rules not processed for user `a78481cceebd4138b893eba7e51c9c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:54:13.733236 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5b918a8f-90e2-4a00-a0b8-3f6dee64e05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:13.742891 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 766/1520] 10.222.0.26 () {58 vars in 1058 bytes} [Sun Oct 2 00:54:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:54:13.752358 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b46ce-441c-4cec-bee7-f431bfcdc499 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:13.767918 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b46ce-441c-4cec-bee7-f431bfcdc499 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:13.774349 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fdd7f-5ae0-4e31-a62e-0c956971f189 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78481cceebd4138b893eba7e51c9c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:13.774991 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fdd7f-5ae0-4e31-a62e-0c956971f189 service placement] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:13.775286 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fdd7f-5ae0-4e31-a62e-0c956971f189 service placement] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:13.775563 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fdd7f-5ae0-4e31-a62e-0c956971f189 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:13.790708 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771fdd7f-5ae0-4e31-a62e-0c956971f189 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:13.792909 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771fdd7f-5ae0-4e31-a62e-0c956971f189 service placement] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:13.806373 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 755/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:54:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:54:17.022985 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b42d95-591d-4d96-b81d-d081e7eeb5d5 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:17.023610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b42d95-591d-4d96-b81d-d081e7eeb5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:17.023610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b42d95-591d-4d96-b81d-d081e7eeb5d5 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:17.024926 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:54:17.031483 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa1986-579d-48fe-8bf6-7162a70bd85a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:17.031969 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa1986-579d-48fe-8bf6-7162a70bd85a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:17.032111 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa1986-579d-48fe-8bf6-7162a70bd85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:17.052315 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-aeaa1986-579d-48fe-8bf6-7162a70bd85a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:54:17.053530 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-aeaa1986-579d-48fe-8bf6-7162a70bd85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:17.062171 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:54:17.228472 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b42d95-591d-4d96-b81d-d081e7eeb5d5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:17.243149 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b42d95-591d-4d96-b81d-d081e7eeb5d5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:17.249375 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f70bc5-a1e1-413e-8cfd-7750345a82fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:17.250002 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f70bc5-a1e1-413e-8cfd-7750345a82fc service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:17.250283 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f70bc5-a1e1-413e-8cfd-7750345a82fc service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:17.250555 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f70bc5-a1e1-413e-8cfd-7750345a82fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:17.258932 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f70bc5-a1e1-413e-8cfd-7750345a82fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:17.261202 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f70bc5-a1e1-413e-8cfd-7750345a82fc service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:17.270753 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 768/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:54:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:54:18.350771 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95226f-1239-451d-be5b-963394e59f54 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:18.351257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95226f-1239-451d-be5b-963394e59f54 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:18.351370 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95226f-1239-451d-be5b-963394e59f54 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:18.352666 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:54:18.359505 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832f41b-6575-4eec-b9d3-2009de268cee None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:18.359934 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832f41b-6575-4eec-b9d3-2009de268cee None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:18.360040 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832f41b-6575-4eec-b9d3-2009de268cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:18.382271 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c832f41b-6575-4eec-b9d3-2009de268cee None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:54:18.383484 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c832f41b-6575-4eec-b9d3-2009de268cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:18.391466 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:54:18.546921 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95226f-1239-451d-be5b-963394e59f54 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:18.561456 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95226f-1239-451d-be5b-963394e59f54 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:18.567376 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53413e6d-d3f9-4ad9-aa11-dae535107167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:18.567963 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53413e6d-d3f9-4ad9-aa11-dae535107167 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:18.568243 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53413e6d-d3f9-4ad9-aa11-dae535107167 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:18.568512 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53413e6d-d3f9-4ad9-aa11-dae535107167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:18.577211 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53413e6d-d3f9-4ad9-aa11-dae535107167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:18.578801 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53413e6d-d3f9-4ad9-aa11-dae535107167 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:18.589034 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 758/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:54:22.612775 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cddee-77db-4504-b3da-052381f8c04a None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:22.613349 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cddee-77db-4504-b3da-052381f8c04a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:22.613349 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cddee-77db-4504-b3da-052381f8c04a None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:22.614655 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:54:22.619824 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d1282-211b-4c5d-98a8-02e2b12896c0 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:22.620266 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d1282-211b-4c5d-98a8-02e2b12896c0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:22.620377 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d1282-211b-4c5d-98a8-02e2b12896c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:22.640222 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-1f0d1282-211b-4c5d-98a8-02e2b12896c0 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:54:22.641440 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1f0d1282-211b-4c5d-98a8-02e2b12896c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:22.649123 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:54:22.939849 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cddee-77db-4504-b3da-052381f8c04a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:22.941594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e74cddee-77db-4504-b3da-052381f8c04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:22.974435 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:23.020696 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cddee-77db-4504-b3da-052381f8c04a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:23.024324 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29b411-9bc3-4e96-ad6c-82feb61e11ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:23.024931 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b411-9bc3-4e96-ad6c-82feb61e11ac service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:23.025241 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b411-9bc3-4e96-ad6c-82feb61e11ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:23.025519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b411-9bc3-4e96-ad6c-82feb61e11ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:23.035533 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29b411-9bc3-4e96-ad6c-82feb61e11ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:23.036993 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29b411-9bc3-4e96-ad6c-82feb61e11ac service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:23.047065 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 771/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:54:25.215279 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff20786-4868-4638-8dee-3016b940d36d None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:25.215856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff20786-4868-4638-8dee-3016b940d36d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:25.215856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff20786-4868-4638-8dee-3016b940d36d None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:25.217190 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:54:25.222381 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabcf02-e3ef-4c91-ad2a-311e05b3707a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:25.222834 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabcf02-e3ef-4c91-ad2a-311e05b3707a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:25.222938 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabcf02-e3ef-4c91-ad2a-311e05b3707a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:25.243375 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6fabcf02-e3ef-4c91-ad2a-311e05b3707a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:54:25.244694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6fabcf02-e3ef-4c91-ad2a-311e05b3707a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:25.254712 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:54:25.545923 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff20786-4868-4638-8dee-3016b940d36d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:25.556748 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff20786-4868-4638-8dee-3016b940d36d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:25.560208 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34125561-d6ef-4284-a522-cbc0e3c7ed77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:25.560790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34125561-d6ef-4284-a522-cbc0e3c7ed77 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:25.561097 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34125561-d6ef-4284-a522-cbc0e3c7ed77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:25.561365 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34125561-d6ef-4284-a522-cbc0e3c7ed77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:25.570235 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34125561-d6ef-4284-a522-cbc0e3c7ed77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:25.571657 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34125561-d6ef-4284-a522-cbc0e3c7ed77 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:25.581723 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 761/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:54:29.519633 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5004e4-5833-4b44-a4d2-f9802df6392e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:29.520190 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5004e4-5833-4b44-a4d2-f9802df6392e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:29.520190 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5004e4-5833-4b44-a4d2-f9802df6392e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:29.521576 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:54:29.527423 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4c96e-f509-467d-af6a-b64850c7a94a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:29.527848 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4c96e-f509-467d-af6a-b64850c7a94a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:29.527968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4c96e-f509-467d-af6a-b64850c7a94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:29.547139 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e2b4c96e-f509-467d-af6a-b64850c7a94a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:54:29.548322 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e2b4c96e-f509-467d-af6a-b64850c7a94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:29.556010 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:54:29.863736 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5004e4-5833-4b44-a4d2-f9802df6392e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:29.865442 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9e5004e4-5833-4b44-a4d2-f9802df6392e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:29.944782 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5004e4-5833-4b44-a4d2-f9802df6392e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:29.948928 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cbca4-b9f0-41a3-b20b-a6db34304f4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:29.949556 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cbca4-b9f0-41a3-b20b-a6db34304f4a service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:29.949832 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cbca4-b9f0-41a3-b20b-a6db34304f4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:29.950099 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cbca4-b9f0-41a3-b20b-a6db34304f4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:29.958992 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8cbca4-b9f0-41a3-b20b-a6db34304f4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:29.960405 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8cbca4-b9f0-41a3-b20b-a6db34304f4a service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:29.969764 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 774/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:54:32.142985 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c2b02-8521-4bee-ab6c-b4fa352a1d01 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:32.143552 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c2b02-8521-4bee-ab6c-b4fa352a1d01 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:32.143552 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c2b02-8521-4bee-ab6c-b4fa352a1d01 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:32.144964 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:54:32.150817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec8bbe-6448-46b3-93a8-52f3131bd123 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:32.151258 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec8bbe-6448-46b3-93a8-52f3131bd123 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:32.151362 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec8bbe-6448-46b3-93a8-52f3131bd123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:32.176006 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-99ec8bbe-6448-46b3-93a8-52f3131bd123 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:54:32.177271 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-99ec8bbe-6448-46b3-93a8-52f3131bd123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:32.185522 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:54:32.490070 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c2b02-8521-4bee-ab6c-b4fa352a1d01 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:32.491727 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2a1c2b02-8521-4bee-ab6c-b4fa352a1d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:32.504977 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c2b02-8521-4bee-ab6c-b4fa352a1d01 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:32.508426 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7b44b-99d7-4ca4-b4e4-de48b14d1a46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:32.509045 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7b44b-99d7-4ca4-b4e4-de48b14d1a46 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:32.509341 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7b44b-99d7-4ca4-b4e4-de48b14d1a46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:32.510103 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7b44b-99d7-4ca4-b4e4-de48b14d1a46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:32.519268 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7b44b-99d7-4ca4-b4e4-de48b14d1a46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:32.520693 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7b44b-99d7-4ca4-b4e4-de48b14d1a46 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:32.531086 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 764/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:54:42.165673 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=63 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:42.526603 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=37 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:03.146582 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8146320-90f0-4ecc-a480-db084706f760 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:03.180089 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8146320-90f0-4ecc-a480-db084706f760 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:03.180089 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8146320-90f0-4ecc-a480-db084706f760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:03.203736 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a8146320-90f0-4ecc-a480-db084706f760 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:03.205019 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a8146320-90f0-4ecc-a480-db084706f760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:03.220509 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 776/1540] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:56:03.230794 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526646a-6448-4d4e-a7c0-a9d2e0e4c31a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:03.246021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526646a-6448-4d4e-a7c0-a9d2e0e4c31a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:03.246021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526646a-6448-4d4e-a7c0-a9d2e0e4c31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:03.270211 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-c526646a-6448-4d4e-a7c0-a9d2e0e4c31a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:03.272407 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c526646a-6448-4d4e-a7c0-a9d2e0e4c31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:03.281869 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 765/1541] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:03.287216 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8146320-90f0-4ecc-a480-db084706f760 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:03.303261 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8146320-90f0-4ecc-a480-db084706f760 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:03.315549 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ad765-a653-424c-9838-a3a4d93c7bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:03.316649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ad765-a653-424c-9838-a3a4d93c7bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:03.317172 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ad765-a653-424c-9838-a3a4d93c7bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:03.318235 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ad765-a653-424c-9838-a3a4d93c7bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:03.319568 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ad765-a653-424c-9838-a3a4d93c7bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:03.320025 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ad765-a653-424c-9838-a3a4d93c7bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:03.322004 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ad765-a653-424c-9838-a3a4d93c7bf5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:03.344144 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 777/1542] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:56:03.352649 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526646a-6448-4d4e-a7c0-a9d2e0e4c31a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:03.367881 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526646a-6448-4d4e-a7c0-a9d2e0e4c31a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:03.375184 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9bfe8-0052-4897-a0f7-216845cb4d87 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:03.375532 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9bfe8-0052-4897-a0f7-216845cb4d87 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:03.375757 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9bfe8-0052-4897-a0f7-216845cb4d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:03.389573 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130525d-12da-4d79-be0a-792617b71ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:03.391527 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130525d-12da-4d79-be0a-792617b71ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:03.391820 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130525d-12da-4d79-be0a-792617b71ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:03.392099 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130525d-12da-4d79-be0a-792617b71ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:03.392776 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130525d-12da-4d79-be0a-792617b71ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:03.394818 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130525d-12da-4d79-be0a-792617b71ff8 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:03.403375 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c0f9bfe8-0052-4897-a0f7-216845cb4d87 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:03.407868 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c0f9bfe8-0052-4897-a0f7-216845cb4d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:03.429719 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 778/1543] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:56:03.439145 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ebe6f-4ad4-4d30-a5e7-fb5f3b4e69d6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:03.439487 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ebe6f-4ad4-4d30-a5e7-fb5f3b4e69d6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:03.439713 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ebe6f-4ad4-4d30-a5e7-fb5f3b4e69d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:03.481810 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1e8ebe6f-4ad4-4d30-a5e7-fb5f3b4e69d6 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:03.483122 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1e8ebe6f-4ad4-4d30-a5e7-fb5f3b4e69d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:03.498856 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 766/1544] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:03 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:03.503299 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130525d-12da-4d79-be0a-792617b71ff8 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:03.505575 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 779/1545] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:03.510993 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ebe6f-4ad4-4d30-a5e7-fb5f3b4e69d6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:03.527094 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ebe6f-4ad4-4d30-a5e7-fb5f3b4e69d6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:03.686837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130525d-12da-4d79-be0a-792617b71ff8 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:03.709353 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b115e-a20d-48fe-a408-0c449842efcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:03.710479 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b115e-a20d-48fe-a408-0c449842efcd admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:03.710679 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd384a-68c3-4efc-a289-23afbbdb41e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:03.710809 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b115e-a20d-48fe-a408-0c449842efcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:03.711091 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b115e-a20d-48fe-a408-0c449842efcd admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:03.711274 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd384a-68c3-4efc-a289-23afbbdb41e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:03.711546 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd384a-68c3-4efc-a289-23afbbdb41e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:03.712298 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b115e-a20d-48fe-a408-0c449842efcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:03.712421 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd384a-68c3-4efc-a289-23afbbdb41e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:03.712987 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd384a-68c3-4efc-a289-23afbbdb41e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:03.713303 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd384a-68c3-4efc-a289-23afbbdb41e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:03.713502 dv-cinder-master-3-smb devstack@keystone.service[81451]: WARNING py.warnings [None req-337b115e-a20d-48fe-a408-0c449842efcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:56:03.713502 dv-cinder-master-3-smb devstack@keystone.service[81451]: warnings.warn(msg) Oct 02 00:56:03.713502 dv-cinder-master-3-smb devstack@keystone.service[81451]: Oct 02 00:56:03.714914 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b115e-a20d-48fe-a408-0c449842efcd admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:03.720307 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd384a-68c3-4efc-a289-23afbbdb41e4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:03.744256 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 780/1546] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:56:03.747101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857e0f1-3d09-4892-a654-f5f496a7906c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:03.747389 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857e0f1-3d09-4892-a654-f5f496a7906c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:03.747663 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857e0f1-3d09-4892-a654-f5f496a7906c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:03.757633 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 767/1547] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:03 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:03.759309 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915d381-b250-4b17-95bb-cbafd229d28c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:03.759596 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915d381-b250-4b17-95bb-cbafd229d28c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:03.759873 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915d381-b250-4b17-95bb-cbafd229d28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:03.785049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e915d381-b250-4b17-95bb-cbafd229d28c None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:03.786979 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e915d381-b250-4b17-95bb-cbafd229d28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:03.790174 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e857e0f1-3d09-4892-a654-f5f496a7906c None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:03.793157 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e857e0f1-3d09-4892-a654-f5f496a7906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:03.795879 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 768/1548] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:03.797427 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72892ee9-421f-43f5-99a8-19e402fb7312 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:03.797721 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72892ee9-421f-43f5-99a8-19e402fb7312 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:03.797995 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72892ee9-421f-43f5-99a8-19e402fb7312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:03.820487 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 781/1549] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:03.821874 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67156aab-21d5-4c76-9bee-c78b9d149016 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:03.822283 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67156aab-21d5-4c76-9bee-c78b9d149016 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:03.822553 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67156aab-21d5-4c76-9bee-c78b9d149016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:03.823242 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-72892ee9-421f-43f5-99a8-19e402fb7312 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:03.824465 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-72892ee9-421f-43f5-99a8-19e402fb7312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:03.833879 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 769/1550] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:03.835086 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72892ee9-421f-43f5-99a8-19e402fb7312 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:03.845999 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-67156aab-21d5-4c76-9bee-c78b9d149016 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:03.846684 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72892ee9-421f-43f5-99a8-19e402fb7312 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:03.847227 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-67156aab-21d5-4c76-9bee-c78b9d149016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:03.851962 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfa129-379f-4356-bd0d-f4c1c8fe7fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:03.852598 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfa129-379f-4356-bd0d-f4c1c8fe7fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:03.852879 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfa129-379f-4356-bd0d-f4c1c8fe7fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:03.853182 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfa129-379f-4356-bd0d-f4c1c8fe7fc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:03.853841 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfa129-379f-4356-bd0d-f4c1c8fe7fc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:03.855830 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfa129-379f-4356-bd0d-f4c1c8fe7fc0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:03.856069 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 782/1551] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:03.856897 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67156aab-21d5-4c76-9bee-c78b9d149016 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:03.868120 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67156aab-21d5-4c76-9bee-c78b9d149016 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:03.873456 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aaa5de-c64c-4508-87a9-a68e7e0e2435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:03.874342 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aaa5de-c64c-4508-87a9-a68e7e0e2435 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:03.874652 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aaa5de-c64c-4508-87a9-a68e7e0e2435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:03.874933 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aaa5de-c64c-4508-87a9-a68e7e0e2435 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:03.875595 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aaa5de-c64c-4508-87a9-a68e7e0e2435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:03.877267 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aaa5de-c64c-4508-87a9-a68e7e0e2435 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:03.892637 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 783/1552] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:03.892637 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1e689-1017-4fc1-b26a-33a6b8c0bb0b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:03.892637 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1e689-1017-4fc1-b26a-33a6b8c0bb0b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:03.892637 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1e689-1017-4fc1-b26a-33a6b8c0bb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:03.904385 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 770/1553] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:03 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:03.904385 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163402f-4fa2-4624-917b-9122275fcef9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:03.904385 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163402f-4fa2-4624-917b-9122275fcef9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:03.904385 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163402f-4fa2-4624-917b-9122275fcef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:03.919047 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d3d1e689-1017-4fc1-b26a-33a6b8c0bb0b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:03.920387 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d3d1e689-1017-4fc1-b26a-33a6b8c0bb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:03.929552 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b163402f-4fa2-4624-917b-9122275fcef9 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:03.930997 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b163402f-4fa2-4624-917b-9122275fcef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:04.002383 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 784/1554] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:04.010503 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 771/1555] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:04.010744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473f7bd-41b6-45a7-bb0c-0d811ef8018e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.010744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473f7bd-41b6-45a7-bb0c-0d811ef8018e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.011062 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473f7bd-41b6-45a7-bb0c-0d811ef8018e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.012599 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882777cc-513a-4534-886f-2b527a11cd07 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.012842 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882777cc-513a-4534-886f-2b527a11cd07 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.013318 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882777cc-513a-4534-886f-2b527a11cd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.037465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1473f7bd-41b6-45a7-bb0c-0d811ef8018e None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:04.038291 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-882777cc-513a-4534-886f-2b527a11cd07 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:04.038876 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1473f7bd-41b6-45a7-bb0c-0d811ef8018e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:04.039607 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-882777cc-513a-4534-886f-2b527a11cd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:04.046973 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 785/1556] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:04.048210 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406832ab-d526-4ab1-8a75-302ea3dccd96 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.048491 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406832ab-d526-4ab1-8a75-302ea3dccd96 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.048766 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406832ab-d526-4ab1-8a75-302ea3dccd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.049674 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 772/1557] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:04.054051 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882777cc-513a-4534-886f-2b527a11cd07 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.069264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882777cc-513a-4534-886f-2b527a11cd07 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:04.073719 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-406832ab-d526-4ab1-8a75-302ea3dccd96 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:04.073719 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-406832ab-d526-4ab1-8a75-302ea3dccd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:04.074061 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cb3f6-25f7-44be-afb4-b3adab06d180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:04.074696 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cb3f6-25f7-44be-afb4-b3adab06d180 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.075001 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cb3f6-25f7-44be-afb4-b3adab06d180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.075274 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cb3f6-25f7-44be-afb4-b3adab06d180 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.075915 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cb3f6-25f7-44be-afb4-b3adab06d180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:04.077586 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cb3f6-25f7-44be-afb4-b3adab06d180 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:04.081473 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 786/1558] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:04.082278 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406832ab-d526-4ab1-8a75-302ea3dccd96 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.084207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:04.092991 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406832ab-d526-4ab1-8a75-302ea3dccd96 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:04.094295 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 773/1559] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:04.095763 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483e476-3bbb-4b45-be5c-30e47f3bd6f4 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.096028 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483e476-3bbb-4b45-be5c-30e47f3bd6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.096304 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483e476-3bbb-4b45-be5c-30e47f3bd6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.097839 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a3147-2e97-435a-99e3-9dbeaf8f251d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:04.098455 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a3147-2e97-435a-99e3-9dbeaf8f251d admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.098793 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a3147-2e97-435a-99e3-9dbeaf8f251d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.099583 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a3147-2e97-435a-99e3-9dbeaf8f251d admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.100224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a3147-2e97-435a-99e3-9dbeaf8f251d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:04.102188 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a3147-2e97-435a-99e3-9dbeaf8f251d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:04.118898 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5483e476-3bbb-4b45-be5c-30e47f3bd6f4 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:04.120416 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5483e476-3bbb-4b45-be5c-30e47f3bd6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:04.131526 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 774/1560] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:04.132359 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9b393-82ea-4e7f-9625-3d340da19265 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.137412 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 787/1561] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:04 2022] POST /identity/v3/users => generated 284 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:04.137673 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9b393-82ea-4e7f-9625-3d340da19265 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.137673 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9b393-82ea-4e7f-9625-3d340da19265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.137983 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a3147-2e97-435a-99e3-9dbeaf8f251d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.150373 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a3147-2e97-435a-99e3-9dbeaf8f251d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:04.155975 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30949d-f297-49f3-a804-8ffe59c07a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:04.156615 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30949d-f297-49f3-a804-8ffe59c07a4b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.156888 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30949d-f297-49f3-a804-8ffe59c07a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.157201 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30949d-f297-49f3-a804-8ffe59c07a4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.157900 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30949d-f297-49f3-a804-8ffe59c07a4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:04.158137 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-63a9b393-82ea-4e7f-9625-3d340da19265 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:04.158386 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30949d-f297-49f3-a804-8ffe59c07a4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:04.159381 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-63a9b393-82ea-4e7f-9625-3d340da19265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:04.159779 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30949d-f297-49f3-a804-8ffe59c07a4b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:04.161804 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:04.168434 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 775/1562] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:04.169287 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9b393-82ea-4e7f-9625-3d340da19265 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.178017 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 788/1563] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:56:04.181986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9b393-82ea-4e7f-9625-3d340da19265 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:04.182193 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30949d-f297-49f3-a804-8ffe59c07a4b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.186979 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa0fc9-af51-4c6c-b3e1-6eed7cc2dae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:04.187616 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa0fc9-af51-4c6c-b3e1-6eed7cc2dae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.187901 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa0fc9-af51-4c6c-b3e1-6eed7cc2dae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.188171 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa0fc9-af51-4c6c-b3e1-6eed7cc2dae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.188867 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa0fc9-af51-4c6c-b3e1-6eed7cc2dae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:04.189203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa0fc9-af51-4c6c-b3e1-6eed7cc2dae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:04.190334 dv-cinder-master-3-smb devstack@keystone.service[81451]: WARNING py.warnings [None req-4daa0fc9-af51-4c6c-b3e1-6eed7cc2dae2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:56:04.190334 dv-cinder-master-3-smb devstack@keystone.service[81451]: warnings.warn(msg) Oct 02 00:56:04.190334 dv-cinder-master-3-smb devstack@keystone.service[81451]: Oct 02 00:56:04.191253 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa0fc9-af51-4c6c-b3e1-6eed7cc2dae2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:04.201197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30949d-f297-49f3-a804-8ffe59c07a4b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:04.213237 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 776/1564] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:56:04.213237 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa0fc9-af51-4c6c-b3e1-6eed7cc2dae2 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.213551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79250d-6cd8-4d28-b89c-a2e0a423517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:04.213551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79250d-6cd8-4d28-b89c-a2e0a423517e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.213551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79250d-6cd8-4d28-b89c-a2e0a423517e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.213551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79250d-6cd8-4d28-b89c-a2e0a423517e admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.214790 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79250d-6cd8-4d28-b89c-a2e0a423517e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:04.215323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79250d-6cd8-4d28-b89c-a2e0a423517e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:04.218566 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79250d-6cd8-4d28-b89c-a2e0a423517e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:04.218699 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa0fc9-af51-4c6c-b3e1-6eed7cc2dae2 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:04.225505 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a41ec1-f3df-4864-9a75-b9a300fde766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:04.226128 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a41ec1-f3df-4864-9a75-b9a300fde766 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.226412 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a41ec1-f3df-4864-9a75-b9a300fde766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.226687 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a41ec1-f3df-4864-9a75-b9a300fde766 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.227343 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a41ec1-f3df-4864-9a75-b9a300fde766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:04.227652 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a41ec1-f3df-4864-9a75-b9a300fde766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:04.229636 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a41ec1-f3df-4864-9a75-b9a300fde766 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:04.240959 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 789/1565] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:56:04.242478 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79250d-6cd8-4d28-b89c-a2e0a423517e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.256711 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 777/1566] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:56:04.256711 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a41ec1-f3df-4864-9a75-b9a300fde766 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.261218 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79250d-6cd8-4d28-b89c-a2e0a423517e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:04.265703 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a41ec1-f3df-4864-9a75-b9a300fde766 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:04.268904 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f52b52-b2c3-4b84-b085-e393da7e161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:04.270102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f52b52-b2c3-4b84-b085-e393da7e161d admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.270641 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f52b52-b2c3-4b84-b085-e393da7e161d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.271703 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f52b52-b2c3-4b84-b085-e393da7e161d admin admin] PATH_INFO: `/v3/projects/ae5875cb30504d3390f6499ec184022c/users/0c5772cc673e480fbec2cc6a87177203/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.272183 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c095d-509f-4f15-a244-ea4675194564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:04.273263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c095d-509f-4f15-a244-ea4675194564 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.273619 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c095d-509f-4f15-a244-ea4675194564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.274092 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c095d-509f-4f15-a244-ea4675194564 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.274968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c095d-509f-4f15-a244-ea4675194564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:04.278715 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c095d-509f-4f15-a244-ea4675194564 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:04.292152 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 778/1567] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:04.293495 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a6aef-31f0-4ab3-b268-aa9301e66be3 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.293786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a6aef-31f0-4ab3-b268-aa9301e66be3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.294080 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a6aef-31f0-4ab3-b268-aa9301e66be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.300495 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f52b52-b2c3-4b84-b085-e393da7e161d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5875cb30504d3390f6499ec184022c, user_id=0c5772cc673e480fbec2cc6a87177203, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:04.302647 dv-cinder-master-3-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-41f52b52-b2c3-4b84-b085-e393da7e161d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:56:04.302647 dv-cinder-master-3-smb devstack@keystone.service[81450]: warnings.warn(msg) Oct 02 00:56:04.302647 dv-cinder-master-3-smb devstack@keystone.service[81450]: Oct 02 00:56:04.306722 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f52b52-b2c3-4b84-b085-e393da7e161d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:04.317282 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-1f0a6aef-31f0-4ab3-b268-aa9301e66be3 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:04.319124 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1f0a6aef-31f0-4ab3-b268-aa9301e66be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:04.328255 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 790/1568] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:04 2022] PUT /identity/v3/projects/ae5875cb30504d3390f6499ec184022c/users/0c5772cc673e480fbec2cc6a87177203/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:04.329762 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f52b52-b2c3-4b84-b085-e393da7e161d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.407044 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 779/1569] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:04.407044 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a6aef-31f0-4ab3-b268-aa9301e66be3 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.419501 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a6aef-31f0-4ab3-b268-aa9301e66be3 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:04.428837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8f5d4-4751-46bf-b122-564fac801191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:04.429960 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8f5d4-4751-46bf-b122-564fac801191 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.430462 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8f5d4-4751-46bf-b122-564fac801191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.430944 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8f5d4-4751-46bf-b122-564fac801191 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.432146 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8f5d4-4751-46bf-b122-564fac801191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:04.435994 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8f5d4-4751-46bf-b122-564fac801191 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:04.440444 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f52b52-b2c3-4b84-b085-e393da7e161d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:04.445463 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186aad12-fb4c-4bbf-8319-3763c68528aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:04.446090 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aad12-fb4c-4bbf-8319-3763c68528aa admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.446377 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aad12-fb4c-4bbf-8319-3763c68528aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.446654 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aad12-fb4c-4bbf-8319-3763c68528aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.447314 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186aad12-fb4c-4bbf-8319-3763c68528aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:04.447619 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186aad12-fb4c-4bbf-8319-3763c68528aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:04.449278 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186aad12-fb4c-4bbf-8319-3763c68528aa admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:04.462058 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 791/1570] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:56:04.462925 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186aad12-fb4c-4bbf-8319-3763c68528aa admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.475463 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186aad12-fb4c-4bbf-8319-3763c68528aa admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:04.480440 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c521a4-ff5d-4b4c-a858-46599e45a164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:04.481093 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c521a4-ff5d-4b4c-a858-46599e45a164 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.481371 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c521a4-ff5d-4b4c-a858-46599e45a164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.481646 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c521a4-ff5d-4b4c-a858-46599e45a164 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.482286 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c521a4-ff5d-4b4c-a858-46599e45a164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:04.483328 dv-cinder-master-3-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-f6c521a4-ff5d-4b4c-a858-46599e45a164 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:56:04.483328 dv-cinder-master-3-smb devstack@keystone.service[81450]: warnings.warn(msg) Oct 02 00:56:04.483328 dv-cinder-master-3-smb devstack@keystone.service[81450]: Oct 02 00:56:04.484559 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c521a4-ff5d-4b4c-a858-46599e45a164 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:04.484753 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 780/1571] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:04 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:04.485534 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8f5d4-4751-46bf-b122-564fac801191 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.530254 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 792/1572] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:04 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:04.530254 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c521a4-ff5d-4b4c-a858-46599e45a164 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.560667 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8f5d4-4751-46bf-b122-564fac801191 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:04.603162 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:04.609032 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c521a4-ff5d-4b4c-a858-46599e45a164 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:04.615713 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db1ffc-338b-45ea-b7eb-2a0baafdad5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:04.616345 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db1ffc-338b-45ea-b7eb-2a0baafdad5d admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.616631 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db1ffc-338b-45ea-b7eb-2a0baafdad5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.616907 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db1ffc-338b-45ea-b7eb-2a0baafdad5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.617601 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db1ffc-338b-45ea-b7eb-2a0baafdad5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:04.619600 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db1ffc-338b-45ea-b7eb-2a0baafdad5d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:04.640622 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df3b4c-4f19-46f2-bc6b-fc5fae4dc204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:04.641347 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df3b4c-4f19-46f2-bc6b-fc5fae4dc204 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.641785 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df3b4c-4f19-46f2-bc6b-fc5fae4dc204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.642183 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df3b4c-4f19-46f2-bc6b-fc5fae4dc204 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.642806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df3b4c-4f19-46f2-bc6b-fc5fae4dc204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:04.645307 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df3b4c-4f19-46f2-bc6b-fc5fae4dc204 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:04.651577 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 793/1573] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:04 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:04.655839 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db1ffc-338b-45ea-b7eb-2a0baafdad5d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.667514 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:04.679465 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 781/1574] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:04 2022] POST /identity/v3/projects => generated 393 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:04.681190 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9baf5d5-7c31-4da0-91ca-6430f28e4d39 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.681344 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9baf5d5-7c31-4da0-91ca-6430f28e4d39 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.681615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9baf5d5-7c31-4da0-91ca-6430f28e4d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.725225 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a9baf5d5-7c31-4da0-91ca-6430f28e4d39 None None] MFA Rules not processed for user `0c5772cc673e480fbec2cc6a87177203`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:04.727201 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a9baf5d5-7c31-4da0-91ca-6430f28e4d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:04.744822 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db1ffc-338b-45ea-b7eb-2a0baafdad5d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:04.811780 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f22302-281b-456e-9759-88ce9aa78555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:04.812690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f22302-281b-456e-9759-88ce9aa78555 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.813175 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f22302-281b-456e-9759-88ce9aa78555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.813295 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f22302-281b-456e-9759-88ce9aa78555 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.813747 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 782/1575] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:04.814018 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f22302-281b-456e-9759-88ce9aa78555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:04.815632 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f22302-281b-456e-9759-88ce9aa78555 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:04.818462 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9baf5d5-7c31-4da0-91ca-6430f28e4d39 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.829613 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9baf5d5-7c31-4da0-91ca-6430f28e4d39 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:04.832969 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 794/1576] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:04.835286 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0a3f3-be6f-470f-8769-956c1ddeaea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:04.835286 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0a3f3-be6f-470f-8769-956c1ddeaea8 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.835601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0a3f3-be6f-470f-8769-956c1ddeaea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.836594 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0a3f3-be6f-470f-8769-956c1ddeaea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.836680 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0a3f3-be6f-470f-8769-956c1ddeaea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:04.836965 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0a3f3-be6f-470f-8769-956c1ddeaea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:04.838597 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0a3f3-be6f-470f-8769-956c1ddeaea8 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:04.839805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f22302-281b-456e-9759-88ce9aa78555 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.851979 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f22302-281b-456e-9759-88ce9aa78555 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:04.854660 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 783/1577] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:56:04.855436 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0a3f3-be6f-470f-8769-956c1ddeaea8 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.867445 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0a3f3-be6f-470f-8769-956c1ddeaea8 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:04.871674 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3fbef-7aab-425c-b7fe-ac2206e2a2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:04.872465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3fbef-7aab-425c-b7fe-ac2206e2a2fe admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.872754 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3fbef-7aab-425c-b7fe-ac2206e2a2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.873278 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3fbef-7aab-425c-b7fe-ac2206e2a2fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.874401 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3fbef-7aab-425c-b7fe-ac2206e2a2fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:04.874793 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcbcfd-4ac8-4926-9297-4624f9c2bda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:04.875404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcbcfd-4ac8-4926-9297-4624f9c2bda7 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:04.875681 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcbcfd-4ac8-4926-9297-4624f9c2bda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:04.875951 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcbcfd-4ac8-4926-9297-4624f9c2bda7 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:04.876386 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3fbef-7aab-425c-b7fe-ac2206e2a2fe admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:04.876577 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcbcfd-4ac8-4926-9297-4624f9c2bda7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:04.878559 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcbcfd-4ac8-4926-9297-4624f9c2bda7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:04.912252 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 784/1578] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:04 2022] POST /identity/v3/users => generated 288 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:04.912252 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcbcfd-4ac8-4926-9297-4624f9c2bda7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.912838 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 795/1579] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:04 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:04.912838 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3fbef-7aab-425c-b7fe-ac2206e2a2fe admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:04.922334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcbcfd-4ac8-4926-9297-4624f9c2bda7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.001116 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3fbef-7aab-425c-b7fe-ac2206e2a2fe admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.006097 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7683df-bcf4-4280-9d5d-dfc04e759711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.006331 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1164727-7f58-4a36-8624-ce3e2c7c1692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.006724 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7683df-bcf4-4280-9d5d-dfc04e759711 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.007004 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7683df-bcf4-4280-9d5d-dfc04e759711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.007192 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1164727-7f58-4a36-8624-ce3e2c7c1692 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.007371 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7683df-bcf4-4280-9d5d-dfc04e759711 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.007562 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1164727-7f58-4a36-8624-ce3e2c7c1692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.007900 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7683df-bcf4-4280-9d5d-dfc04e759711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.008099 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1164727-7f58-4a36-8624-ce3e2c7c1692 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.008718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1164727-7f58-4a36-8624-ce3e2c7c1692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.009896 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7683df-bcf4-4280-9d5d-dfc04e759711 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.011211 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1164727-7f58-4a36-8624-ce3e2c7c1692 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.038092 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 796/1580] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:04 2022] POST /identity/v3/users => generated 284 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:05.038328 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 785/1581] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:04 2022] POST /identity/v3/users => generated 295 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:05.038434 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7683df-bcf4-4280-9d5d-dfc04e759711 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.038525 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1164727-7f58-4a36-8624-ce3e2c7c1692 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.049114 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1164727-7f58-4a36-8624-ce3e2c7c1692 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.054027 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7683df-bcf4-4280-9d5d-dfc04e759711 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.056080 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4eff67-3994-464d-9978-37c198394c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.057284 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4eff67-3994-464d-9978-37c198394c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.057700 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4eff67-3994-464d-9978-37c198394c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.058095 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4eff67-3994-464d-9978-37c198394c11 admin admin] PATH_INFO: `/v3/projects/3ce900546ca04ef7b1483093e4c1e1f3/users/7ef1923828d44a86a25f945cb15dd02b/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.059198 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe163d7-fe91-4e68-9866-441e8efbc2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.059818 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe163d7-fe91-4e68-9866-441e8efbc2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.060104 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe163d7-fe91-4e68-9866-441e8efbc2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.060377 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe163d7-fe91-4e68-9866-441e8efbc2e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.061125 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe163d7-fe91-4e68-9866-441e8efbc2e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.063263 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe163d7-fe91-4e68-9866-441e8efbc2e6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.064912 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:05.086047 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4eff67-3994-464d-9978-37c198394c11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce900546ca04ef7b1483093e4c1e1f3, user_id=7ef1923828d44a86a25f945cb15dd02b, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.088836 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4eff67-3994-464d-9978-37c198394c11 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.089670 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 797/1582] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:05 2022] POST /identity/v3/users => generated 297 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:05.091244 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7783f-6427-473b-9a44-b0c554d374ca None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.091671 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7783f-6427-473b-9a44-b0c554d374ca None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.092162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7783f-6427-473b-9a44-b0c554d374ca None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.095176 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 798/1583] 10.222.0.26 () {54 vars in 961 bytes} [Sun Oct 2 00:56:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:56:05.095986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7783f-6427-473b-9a44-b0c554d374ca None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.107321 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 786/1584] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:05 2022] PUT /identity/v3/projects/3ce900546ca04ef7b1483093e4c1e1f3/users/7ef1923828d44a86a25f945cb15dd02b/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:05.107536 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:05.108708 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4eff67-3994-464d-9978-37c198394c11 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.181194 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4eff67-3994-464d-9978-37c198394c11 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.183340 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7783f-6427-473b-9a44-b0c554d374ca None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.187099 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f4cf5-0a30-4164-a9ab-2a787de8ca2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.187719 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f4cf5-0a30-4164-a9ab-2a787de8ca2d admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.188004 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f4cf5-0a30-4164-a9ab-2a787de8ca2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.188280 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f4cf5-0a30-4164-a9ab-2a787de8ca2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.188886 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958e4e5-9ba4-4a75-b5f6-12c4b4418baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.189053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f4cf5-0a30-4164-a9ab-2a787de8ca2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.189691 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958e4e5-9ba4-4a75-b5f6-12c4b4418baa admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.189969 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958e4e5-9ba4-4a75-b5f6-12c4b4418baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.190237 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958e4e5-9ba4-4a75-b5f6-12c4b4418baa admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.190573 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f4cf5-0a30-4164-a9ab-2a787de8ca2d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.190863 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958e4e5-9ba4-4a75-b5f6-12c4b4418baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.193408 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958e4e5-9ba4-4a75-b5f6-12c4b4418baa admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.202380 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 787/1585] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:05.203256 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f4cf5-0a30-4164-a9ab-2a787de8ca2d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.213689 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f4cf5-0a30-4164-a9ab-2a787de8ca2d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.219773 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26729e2-1928-4355-9a94-05605d8f11db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.220534 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26729e2-1928-4355-9a94-05605d8f11db admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.220829 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26729e2-1928-4355-9a94-05605d8f11db admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.221141 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26729e2-1928-4355-9a94-05605d8f11db admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.221779 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26729e2-1928-4355-9a94-05605d8f11db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.226548 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26729e2-1928-4355-9a94-05605d8f11db admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.232975 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 799/1586] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:05 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:05.233813 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958e4e5-9ba4-4a75-b5f6-12c4b4418baa admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.253984 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 788/1587] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:05 2022] POST /identity/v3/users => generated 288 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:05.254839 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26729e2-1928-4355-9a94-05605d8f11db admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.266356 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26729e2-1928-4355-9a94-05605d8f11db admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.318152 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958e4e5-9ba4-4a75-b5f6-12c4b4418baa admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.323007 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89e1c6-eb15-4ffa-b818-ab4e23c7237f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.323639 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89e1c6-eb15-4ffa-b818-ab4e23c7237f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.323910 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89e1c6-eb15-4ffa-b818-ab4e23c7237f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.324182 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89e1c6-eb15-4ffa-b818-ab4e23c7237f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.324837 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89e1c6-eb15-4ffa-b818-ab4e23c7237f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.326499 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89e1c6-eb15-4ffa-b818-ab4e23c7237f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.337719 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 800/1588] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:05.338485 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89e1c6-eb15-4ffa-b818-ab4e23c7237f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.344336 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37518a70-a5dc-40d0-b255-60ae0184154a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.345638 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37518a70-a5dc-40d0-b255-60ae0184154a admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.345924 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37518a70-a5dc-40d0-b255-60ae0184154a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.346225 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37518a70-a5dc-40d0-b255-60ae0184154a admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.346977 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37518a70-a5dc-40d0-b255-60ae0184154a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.348634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37518a70-a5dc-40d0-b255-60ae0184154a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.348830 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89e1c6-eb15-4ffa-b818-ab4e23c7237f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.354168 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0b9ab-de0f-4fe1-9463-4f7f0e99973d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.354788 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0b9ab-de0f-4fe1-9463-4f7f0e99973d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.355073 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0b9ab-de0f-4fe1-9463-4f7f0e99973d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.356005 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0b9ab-de0f-4fe1-9463-4f7f0e99973d admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.356005 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0b9ab-de0f-4fe1-9463-4f7f0e99973d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.357754 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0b9ab-de0f-4fe1-9463-4f7f0e99973d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.361718 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 789/1589] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:05.363329 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9d2d1-19f5-4b9d-a028-7c215692f855 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.364237 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9d2d1-19f5-4b9d-a028-7c215692f855 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.364237 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9d2d1-19f5-4b9d-a028-7c215692f855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.370527 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 801/1590] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:05.371890 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4b5cc-38f4-4f4c-a6fc-dd3307eb467b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.372244 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4b5cc-38f4-4f4c-a6fc-dd3307eb467b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.372462 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4b5cc-38f4-4f4c-a6fc-dd3307eb467b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.410117 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e2d9d2d1-19f5-4b9d-a028-7c215692f855 None None] MFA Rules not processed for user `81e0396b7ba341ce8d02b1a149786d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:05.411415 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e2d9d2d1-19f5-4b9d-a028-7c215692f855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:05.415519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-74c4b5cc-38f4-4f4c-a6fc-dd3307eb467b None None] MFA Rules not processed for user `7ef1923828d44a86a25f945cb15dd02b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:05.416773 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-74c4b5cc-38f4-4f4c-a6fc-dd3307eb467b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:05.461127 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:05.488607 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 802/1591] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:05.490344 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4b5cc-38f4-4f4c-a6fc-dd3307eb467b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.495507 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 790/1592] 10.222.0.26 () {58 vars in 1058 bytes} [Sun Oct 2 00:56:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:05.497230 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9d2d1-19f5-4b9d-a028-7c215692f855 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.503543 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4b5cc-38f4-4f4c-a6fc-dd3307eb467b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.510825 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9d2d1-19f5-4b9d-a028-7c215692f855 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.513742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acc5a1-63bc-45fa-a640-26236ac8787e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.514375 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acc5a1-63bc-45fa-a640-26236ac8787e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.514655 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acc5a1-63bc-45fa-a640-26236ac8787e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.514929 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acc5a1-63bc-45fa-a640-26236ac8787e admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.515590 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acc5a1-63bc-45fa-a640-26236ac8787e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.515698 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888f67a-c7ab-457c-af54-75870d74b933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.516233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888f67a-c7ab-457c-af54-75870d74b933 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.516514 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888f67a-c7ab-457c-af54-75870d74b933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.516787 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888f67a-c7ab-457c-af54-75870d74b933 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.517217 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acc5a1-63bc-45fa-a640-26236ac8787e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.517446 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888f67a-c7ab-457c-af54-75870d74b933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.518767 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:05.519700 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888f67a-c7ab-457c-af54-75870d74b933 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.537252 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 803/1593] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:05.537252 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acc5a1-63bc-45fa-a640-26236ac8787e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.543621 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acc5a1-63bc-45fa-a640-26236ac8787e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.544046 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 791/1594] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:05 2022] POST /identity/v3/users => generated 288 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:05.544890 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888f67a-c7ab-457c-af54-75870d74b933 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.548663 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23731784-6c6c-43c0-a57b-46ebb7210f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.549308 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23731784-6c6c-43c0-a57b-46ebb7210f93 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.549595 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23731784-6c6c-43c0-a57b-46ebb7210f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.549867 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23731784-6c6c-43c0-a57b-46ebb7210f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.550514 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23731784-6c6c-43c0-a57b-46ebb7210f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.552788 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23731784-6c6c-43c0-a57b-46ebb7210f93 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.557176 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888f67a-c7ab-457c-af54-75870d74b933 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.561882 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf3ecf-cb5a-4075-bbfc-47e98d282f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.562487 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf3ecf-cb5a-4075-bbfc-47e98d282f01 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.562735 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf3ecf-cb5a-4075-bbfc-47e98d282f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.563005 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf3ecf-cb5a-4075-bbfc-47e98d282f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.563639 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf3ecf-cb5a-4075-bbfc-47e98d282f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.568725 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 804/1595] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:05.568891 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf3ecf-cb5a-4075-bbfc-47e98d282f01 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.569028 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23731784-6c6c-43c0-a57b-46ebb7210f93 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.576416 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23731784-6c6c-43c0-a57b-46ebb7210f93 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.577661 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 792/1596] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:05.578509 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf3ecf-cb5a-4075-bbfc-47e98d282f01 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.581556 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcccac8-83ab-4925-a238-1a7bfa3e70f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.581999 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcccac8-83ab-4925-a238-1a7bfa3e70f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.582304 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcccac8-83ab-4925-a238-1a7bfa3e70f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.582572 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcccac8-83ab-4925-a238-1a7bfa3e70f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.583411 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcccac8-83ab-4925-a238-1a7bfa3e70f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.585171 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcccac8-83ab-4925-a238-1a7bfa3e70f1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.588830 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf3ecf-cb5a-4075-bbfc-47e98d282f01 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.593866 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205438b-f013-47fe-ae15-e92b7768cea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.594283 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205438b-f013-47fe-ae15-e92b7768cea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.594419 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205438b-f013-47fe-ae15-e92b7768cea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.594696 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205438b-f013-47fe-ae15-e92b7768cea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.595246 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205438b-f013-47fe-ae15-e92b7768cea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.596856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205438b-f013-47fe-ae15-e92b7768cea0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.599557 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 805/1597] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:05.604085 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcccac8-83ab-4925-a238-1a7bfa3e70f1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.613846 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 793/1598] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:05.613846 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205438b-f013-47fe-ae15-e92b7768cea0 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.619917 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcccac8-83ab-4925-a238-1a7bfa3e70f1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.628471 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f3ca6-fa51-4e5c-a160-679a936d4b3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.629223 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f3ca6-fa51-4e5c-a160-679a936d4b3b service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.629625 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f3ca6-fa51-4e5c-a160-679a936d4b3b service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.630557 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f3ca6-fa51-4e5c-a160-679a936d4b3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.674266 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205438b-f013-47fe-ae15-e92b7768cea0 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.678913 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310b945-f021-486b-a534-c1ed45f4396d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.679687 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310b945-f021-486b-a534-c1ed45f4396d service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.679956 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310b945-f021-486b-a534-c1ed45f4396d service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.680217 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310b945-f021-486b-a534-c1ed45f4396d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.689229 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310b945-f021-486b-a534-c1ed45f4396d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.690908 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310b945-f021-486b-a534-c1ed45f4396d service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.696369 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f3ca6-fa51-4e5c-a160-679a936d4b3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.698009 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f3ca6-fa51-4e5c-a160-679a936d4b3b service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.702924 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 794/1599] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:05.703943 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310b945-f021-486b-a534-c1ed45f4396d service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.709318 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 806/1600] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:05.710096 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f3ca6-fa51-4e5c-a160-679a936d4b3b service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.717394 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310b945-f021-486b-a534-c1ed45f4396d service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.722603 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f3ca6-fa51-4e5c-a160-679a936d4b3b service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.722881 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb089d-b0d0-4536-a924-5c75977918c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.723556 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb089d-b0d0-4536-a924-5c75977918c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.724378 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb089d-b0d0-4536-a924-5c75977918c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.724754 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb089d-b0d0-4536-a924-5c75977918c4 admin admin] PATH_INFO: `/v3/projects/f9c28bdfe12d4a6a956d0f52696c3721/users/4a82acab3a5b4808b62a72adf3c61d48/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.729355 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb51a6-491c-4d73-9fa0-bd0e8bc38ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.730245 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb51a6-491c-4d73-9fa0-bd0e8bc38ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.730594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb51a6-491c-4d73-9fa0-bd0e8bc38ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.730935 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb51a6-491c-4d73-9fa0-bd0e8bc38ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.731805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb51a6-491c-4d73-9fa0-bd0e8bc38ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.733736 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb51a6-491c-4d73-9fa0-bd0e8bc38ee5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.742009 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb089d-b0d0-4536-a924-5c75977918c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c28bdfe12d4a6a956d0f52696c3721, user_id=4a82acab3a5b4808b62a72adf3c61d48, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.745098 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb089d-b0d0-4536-a924-5c75977918c4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.749909 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 807/1601] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:05.749909 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb51a6-491c-4d73-9fa0-bd0e8bc38ee5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.768039 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb51a6-491c-4d73-9fa0-bd0e8bc38ee5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.768039 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c49d9c-681a-47b1-82db-c160751a3905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.768039 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c49d9c-681a-47b1-82db-c160751a3905 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.768039 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c49d9c-681a-47b1-82db-c160751a3905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.769007 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c49d9c-681a-47b1-82db-c160751a3905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.769007 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c49d9c-681a-47b1-82db-c160751a3905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.769290 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c49d9c-681a-47b1-82db-c160751a3905 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.782414 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 808/1603] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:05.783448 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c49d9c-681a-47b1-82db-c160751a3905 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.783625 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 795/1603] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:05 2022] PUT /identity/v3/projects/f9c28bdfe12d4a6a956d0f52696c3721/users/4a82acab3a5b4808b62a72adf3c61d48/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:05.794946 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb089d-b0d0-4536-a924-5c75977918c4 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.804194 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c49d9c-681a-47b1-82db-c160751a3905 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.912811 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c811d4-db87-4917-9f05-5b695e3205f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.914409 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c811d4-db87-4917-9f05-5b695e3205f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.914693 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c811d4-db87-4917-9f05-5b695e3205f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.914965 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c811d4-db87-4917-9f05-5b695e3205f8 admin admin] PATH_INFO: `/v3/projects/728f4ed412544bcea192bc3d5722807d/users/ebcd47421c4e4dc3a9b852bd82d1529d/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.935851 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb089d-b0d0-4536-a924-5c75977918c4 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:05.937850 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c811d4-db87-4917-9f05-5b695e3205f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=728f4ed412544bcea192bc3d5722807d, user_id=ebcd47421c4e4dc3a9b852bd82d1529d, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.940840 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6c6ed-a73d-46b4-92ed-2db3d131aeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:05.941562 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6c6ed-a73d-46b4-92ed-2db3d131aeeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:05.941726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c811d4-db87-4917-9f05-5b695e3205f8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.941835 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6c6ed-a73d-46b4-92ed-2db3d131aeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:05.942952 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6c6ed-a73d-46b4-92ed-2db3d131aeeb admin admin] PATH_INFO: `/v3/projects/346545279d0943359a5d495b9dc7f498/users/c21c29da391b4d78a063dbe50057b6eb/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:05.963865 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6c6ed-a73d-46b4-92ed-2db3d131aeeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=346545279d0943359a5d495b9dc7f498, user_id=c21c29da391b4d78a063dbe50057b6eb, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:05.967658 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 809/1604] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:05 2022] PUT /identity/v3/projects/728f4ed412544bcea192bc3d5722807d/users/ebcd47421c4e4dc3a9b852bd82d1529d/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:05.969471 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c811d4-db87-4917-9f05-5b695e3205f8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:05.973101 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6c6ed-a73d-46b4-92ed-2db3d131aeeb admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:05.993361 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:06.003183 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 796/1605] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:05 2022] PUT /identity/v3/projects/346545279d0943359a5d495b9dc7f498/users/c21c29da391b4d78a063dbe50057b6eb/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:06.008969 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6c6ed-a73d-46b4-92ed-2db3d131aeeb admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:06.041100 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:06.084053 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c811d4-db87-4917-9f05-5b695e3205f8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:06.087286 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6c6ed-a73d-46b4-92ed-2db3d131aeeb admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:06.092873 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b01d9-21af-401d-a1b2-864240904e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:06.093097 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcb2c1-8fd3-4a80-bde7-fe921f538afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:06.093674 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcb2c1-8fd3-4a80-bde7-fe921f538afe admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:06.093964 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcb2c1-8fd3-4a80-bde7-fe921f538afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:06.094571 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcb2c1-8fd3-4a80-bde7-fe921f538afe admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:06.094705 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b01d9-21af-401d-a1b2-864240904e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:06.095046 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcb2c1-8fd3-4a80-bde7-fe921f538afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:06.095433 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b01d9-21af-401d-a1b2-864240904e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:06.096082 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b01d9-21af-401d-a1b2-864240904e7d admin admin] PATH_INFO: `/v3/projects/9d154735aabe4f2b966f44f5d2ce92d6/users/5ff136440ace420997181fbf11999496/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:06.096733 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcb2c1-8fd3-4a80-bde7-fe921f538afe admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:06.108707 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 797/1606] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:06.113265 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0d853-f038-4bae-ae38-30bf5db61ad0 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:06.113550 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0d853-f038-4bae-ae38-30bf5db61ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:06.113902 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0d853-f038-4bae-ae38-30bf5db61ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:06.128254 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b01d9-21af-401d-a1b2-864240904e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d154735aabe4f2b966f44f5d2ce92d6, user_id=5ff136440ace420997181fbf11999496, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:06.131911 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b01d9-21af-401d-a1b2-864240904e7d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:06.136232 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-fdc0d853-f038-4bae-ae38-30bf5db61ad0 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:06.137257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fdc0d853-f038-4bae-ae38-30bf5db61ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:06.157234 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 798/1607] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:06.157234 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0d853-f038-4bae-ae38-30bf5db61ad0 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:06.160978 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 810/1608] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:05 2022] PUT /identity/v3/projects/9d154735aabe4f2b966f44f5d2ce92d6/users/5ff136440ace420997181fbf11999496/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:06.162899 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5420a-d0d9-49dd-97dc-1a2d0160a61f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:06.163171 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5420a-d0d9-49dd-97dc-1a2d0160a61f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:06.163447 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5420a-d0d9-49dd-97dc-1a2d0160a61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:06.175603 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0d853-f038-4bae-ae38-30bf5db61ad0 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:06.196857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-44d5420a-d0d9-49dd-97dc-1a2d0160a61f None None] MFA Rules not processed for user `ebcd47421c4e4dc3a9b852bd82d1529d`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:06.199804 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-44d5420a-d0d9-49dd-97dc-1a2d0160a61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:06.269046 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb0371-8bad-4ea3-a602-5ef726fc8a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:06.269751 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb0371-8bad-4ea3-a602-5ef726fc8a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:06.270057 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb0371-8bad-4ea3-a602-5ef726fc8a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:06.270306 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb0371-8bad-4ea3-a602-5ef726fc8a74 admin admin] PATH_INFO: `/v3/projects/33810d0b44214f3b8e8edb143f94ee66/users/e35159bbdd4d4899a3b6c7ad09b0ee37/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:06.290444 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb0371-8bad-4ea3-a602-5ef726fc8a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33810d0b44214f3b8e8edb143f94ee66, user_id=e35159bbdd4d4899a3b6c7ad09b0ee37, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:06.293823 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 811/1609] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:06.293987 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb0371-8bad-4ea3-a602-5ef726fc8a74 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:06.295115 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee7d4f-d796-4657-b263-0fb300914505 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:06.295648 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee7d4f-d796-4657-b263-0fb300914505 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:06.296214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee7d4f-d796-4657-b263-0fb300914505 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:06.298302 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 812/1610] 10.222.0.26 () {54 vars in 912 bytes} [Sun Oct 2 00:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:56:06.299375 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6f799-bb43-44cc-8943-f8039a2156bb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:06.299844 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6f799-bb43-44cc-8943-f8039a2156bb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:06.300222 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6f799-bb43-44cc-8943-f8039a2156bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:06.316281 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 799/1611] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:06 2022] PUT /identity/v3/projects/33810d0b44214f3b8e8edb143f94ee66/users/e35159bbdd4d4899a3b6c7ad09b0ee37/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:06.318156 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb0371-8bad-4ea3-a602-5ef726fc8a74 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:06.325179 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-66a6f799-bb43-44cc-8943-f8039a2156bb None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:06.326683 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-66a6f799-bb43-44cc-8943-f8039a2156bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:06.460655 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb0371-8bad-4ea3-a602-5ef726fc8a74 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:06.462117 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 813/1612] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:06.463688 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565b3a3-7c5a-4d48-9585-b0faf086f7f6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:06.464239 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565b3a3-7c5a-4d48-9585-b0faf086f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:06.464520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565b3a3-7c5a-4d48-9585-b0faf086f7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:06.477621 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c52f1-f2b1-40ba-8cf7-8426d78b5d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:06.479035 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c52f1-f2b1-40ba-8cf7-8426d78b5d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:06.479544 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c52f1-f2b1-40ba-8cf7-8426d78b5d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:06.480031 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c52f1-f2b1-40ba-8cf7-8426d78b5d03 admin admin] PATH_INFO: `/v3/projects/ef3cd95384ef44d58659e77a1cd99e05/users/1f392d3cac0149b09d4f83e83a930298/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:06.498038 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1565b3a3-7c5a-4d48-9585-b0faf086f7f6 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:06.500305 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1565b3a3-7c5a-4d48-9585-b0faf086f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:06.506537 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c52f1-f2b1-40ba-8cf7-8426d78b5d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef3cd95384ef44d58659e77a1cd99e05, user_id=1f392d3cac0149b09d4f83e83a930298, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:06.510216 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c52f1-f2b1-40ba-8cf7-8426d78b5d03 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:06.518882 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 814/1613] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:06.519613 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:06.520593 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565b3a3-7c5a-4d48-9585-b0faf086f7f6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:06.520593 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1565b3a3-7c5a-4d48-9585-b0faf086f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:06.545607 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 800/1614] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:06 2022] PUT /identity/v3/projects/ef3cd95384ef44d58659e77a1cd99e05/users/1f392d3cac0149b09d4f83e83a930298/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:06.550040 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c52f1-f2b1-40ba-8cf7-8426d78b5d03 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:06.590307 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:06.612534 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565b3a3-7c5a-4d48-9585-b0faf086f7f6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:06.668185 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c52f1-f2b1-40ba-8cf7-8426d78b5d03 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:06.674790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24092a63-26d4-4f0b-a9a7-af9726534b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:06.676299 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24092a63-26d4-4f0b-a9a7-af9726534b86 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:06.676596 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24092a63-26d4-4f0b-a9a7-af9726534b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:06.677477 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24092a63-26d4-4f0b-a9a7-af9726534b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:06.678290 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24092a63-26d4-4f0b-a9a7-af9726534b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:06.680403 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24092a63-26d4-4f0b-a9a7-af9726534b86 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:06.681566 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e921920-9aaf-4515-9ad3-9665f901eefc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:06.682237 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e921920-9aaf-4515-9ad3-9665f901eefc service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:06.682524 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e921920-9aaf-4515-9ad3-9665f901eefc service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:06.682795 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e921920-9aaf-4515-9ad3-9665f901eefc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:06.693017 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e921920-9aaf-4515-9ad3-9665f901eefc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:06.694489 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e921920-9aaf-4515-9ad3-9665f901eefc service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:06.706314 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 815/1615] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:06.707700 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb8f38-718e-4137-b0d0-24a750374ba9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:06.708180 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb8f38-718e-4137-b0d0-24a750374ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:06.708532 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb8f38-718e-4137-b0d0-24a750374ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:06.711387 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 801/1616] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:06 2022] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:06.712689 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee798f-d73c-4eb7-9b99-71f62f9a0dd1 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:06.713029 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee798f-d73c-4eb7-9b99-71f62f9a0dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:06.713291 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee798f-d73c-4eb7-9b99-71f62f9a0dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:06.730604 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-94bb8f38-718e-4137-b0d0-24a750374ba9 None None] MFA Rules not processed for user `81e0396b7ba341ce8d02b1a149786d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:06.732053 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-94bb8f38-718e-4137-b0d0-24a750374ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:06.750338 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3bee798f-d73c-4eb7-9b99-71f62f9a0dd1 None None] MFA Rules not processed for user `e35159bbdd4d4899a3b6c7ad09b0ee37`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:06.751724 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3bee798f-d73c-4eb7-9b99-71f62f9a0dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:06.845534 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 802/1617] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:06.845534 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee798f-d73c-4eb7-9b99-71f62f9a0dd1 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:06.872086 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 816/1618] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Oct 2 00:56:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:06.876227 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb8f38-718e-4137-b0d0-24a750374ba9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:06.939538 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee798f-d73c-4eb7-9b99-71f62f9a0dd1 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:06.944804 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427ee83-3303-4088-a905-f3848e511551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:06.945504 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427ee83-3303-4088-a905-f3848e511551 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:06.945898 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427ee83-3303-4088-a905-f3848e511551 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:06.946160 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427ee83-3303-4088-a905-f3848e511551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:07.005426 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:07.019394 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb8f38-718e-4137-b0d0-24a750374ba9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:07.027001 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58251d-3e34-43da-8ceb-33e5a3472513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:07.027634 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58251d-3e34-43da-8ceb-33e5a3472513 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:07.030777 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58251d-3e34-43da-8ceb-33e5a3472513 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:07.030777 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58251d-3e34-43da-8ceb-33e5a3472513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:07.110583 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427ee83-3303-4088-a905-f3848e511551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:07.114063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427ee83-3303-4088-a905-f3848e511551 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:07.124592 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:07.137988 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 803/1619] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:07.140246 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9f749-27a5-4df3-a5cb-45e26d752c48 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:07.140754 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9f749-27a5-4df3-a5cb-45e26d752c48 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:07.141261 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9f749-27a5-4df3-a5cb-45e26d752c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:07.162943 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58251d-3e34-43da-8ceb-33e5a3472513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:07.165931 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58251d-3e34-43da-8ceb-33e5a3472513 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:07.181100 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e3d9f749-27a5-4df3-a5cb-45e26d752c48 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:07.183363 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e3d9f749-27a5-4df3-a5cb-45e26d752c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:07.186455 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 817/1620] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:07.187969 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58251d-3e34-43da-8ceb-33e5a3472513 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:07.199300 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 804/1621] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:07.202514 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d1c38-5511-48d1-96fb-9149c455a2cb None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:07.203147 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d1c38-5511-48d1-96fb-9149c455a2cb None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:07.203739 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d1c38-5511-48d1-96fb-9149c455a2cb None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:07.209350 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58251d-3e34-43da-8ceb-33e5a3472513 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:07.215574 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 805/1622] 10.222.0.26 () {54 vars in 961 bytes} [Sun Oct 2 00:56:07 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:56:07.217911 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d1c38-5511-48d1-96fb-9149c455a2cb None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:07.218950 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0dc88-c1a7-41fc-98a5-a79bb76ce210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:07.219868 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0dc88-c1a7-41fc-98a5-a79bb76ce210 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:07.220422 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0dc88-c1a7-41fc-98a5-a79bb76ce210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:07.221016 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0dc88-c1a7-41fc-98a5-a79bb76ce210 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:07.222002 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0dc88-c1a7-41fc-98a5-a79bb76ce210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:07.226414 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0dc88-c1a7-41fc-98a5-a79bb76ce210 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:07.266799 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 818/1623] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:07 2022] POST /identity/v3/users => generated 290 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:07.268561 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f3806-9f36-4936-b48a-24b0c64e544d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:07.269019 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f3806-9f36-4936-b48a-24b0c64e544d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:07.271245 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f3806-9f36-4936-b48a-24b0c64e544d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:07.305782 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-910f3806-9f36-4936-b48a-24b0c64e544d None None] MFA Rules not processed for user `81e0396b7ba341ce8d02b1a149786d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:07.307429 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-910f3806-9f36-4936-b48a-24b0c64e544d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:07.328549 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 819/1624] 10.222.0.26 () {58 vars in 1058 bytes} [Sun Oct 2 00:56:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:07.330404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f3806-9f36-4936-b48a-24b0c64e544d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:07.343016 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f3806-9f36-4936-b48a-24b0c64e544d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:07.347723 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35404a6-306b-49ce-9dca-78aad503837a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:07.348419 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35404a6-306b-49ce-9dca-78aad503837a service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:07.349551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35404a6-306b-49ce-9dca-78aad503837a service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:07.349890 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35404a6-306b-49ce-9dca-78aad503837a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:07.363471 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35404a6-306b-49ce-9dca-78aad503837a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:07.365808 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35404a6-306b-49ce-9dca-78aad503837a service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:07.381586 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 820/1625] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:07.383500 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35404a6-306b-49ce-9dca-78aad503837a service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:07.385090 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d1c38-5511-48d1-96fb-9149c455a2cb None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:07.392425 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6b6c4-4f2b-4f48-ac07-ae1d18b5ec9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:07.393426 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6b6c4-4f2b-4f48-ac07-ae1d18b5ec9a service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:07.393852 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6b6c4-4f2b-4f48-ac07-ae1d18b5ec9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:07.394420 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6b6c4-4f2b-4f48-ac07-ae1d18b5ec9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:07.395844 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35404a6-306b-49ce-9dca-78aad503837a service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:07.401528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628fcb5-c1e3-46e3-a3fc-a94fb75291db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:07.402318 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628fcb5-c1e3-46e3-a3fc-a94fb75291db admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:07.402604 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628fcb5-c1e3-46e3-a3fc-a94fb75291db admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:07.403470 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628fcb5-c1e3-46e3-a3fc-a94fb75291db admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:07.403615 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628fcb5-c1e3-46e3-a3fc-a94fb75291db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:07.406176 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628fcb5-c1e3-46e3-a3fc-a94fb75291db admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:07.422271 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6b6c4-4f2b-4f48-ac07-ae1d18b5ec9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:07.423968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6b6c4-4f2b-4f48-ac07-ae1d18b5ec9a service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:07.446293 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 821/1626] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:07.448027 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628fcb5-c1e3-46e3-a3fc-a94fb75291db admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:07.467470 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628fcb5-c1e3-46e3-a3fc-a94fb75291db admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:07.472025 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 806/1627] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:07.476705 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55610acf-c3b3-4a85-9914-86c6f5a2caf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:07.478065 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55610acf-c3b3-4a85-9914-86c6f5a2caf5 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:07.478065 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55610acf-c3b3-4a85-9914-86c6f5a2caf5 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:07.478325 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6b6c4-4f2b-4f48-ac07-ae1d18b5ec9a service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:07.478419 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55610acf-c3b3-4a85-9914-86c6f5a2caf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:07.490715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55610acf-c3b3-4a85-9914-86c6f5a2caf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:07.492564 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55610acf-c3b3-4a85-9914-86c6f5a2caf5 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:07.507078 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 822/1628] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:07.526721 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6b6c4-4f2b-4f48-ac07-ae1d18b5ec9a service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:07.550306 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee16e3-a67a-48eb-8f9e-c520458799b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:07.551467 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee16e3-a67a-48eb-8f9e-c520458799b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:07.555257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee16e3-a67a-48eb-8f9e-c520458799b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:07.555257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee16e3-a67a-48eb-8f9e-c520458799b9 admin admin] PATH_INFO: `/v3/projects/512396a422d149c08c09e67175d45f4b/users/8a22a75a5c124ab1a7a019905d9e5bb2/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:07.621389 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee16e3-a67a-48eb-8f9e-c520458799b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=512396a422d149c08c09e67175d45f4b, user_id=8a22a75a5c124ab1a7a019905d9e5bb2, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:07.629236 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee16e3-a67a-48eb-8f9e-c520458799b9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:07.659121 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 807/1629] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:07 2022] PUT /identity/v3/projects/512396a422d149c08c09e67175d45f4b/users/8a22a75a5c124ab1a7a019905d9e5bb2/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:07.663621 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55610acf-c3b3-4a85-9914-86c6f5a2caf5 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:07.689502 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55610acf-c3b3-4a85-9914-86c6f5a2caf5 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:07.918508 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee844472-2726-464f-83d3-6a4b9f9b662b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:07.919642 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee844472-2726-464f-83d3-6a4b9f9b662b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:07.920563 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee844472-2726-464f-83d3-6a4b9f9b662b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:07.921106 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee844472-2726-464f-83d3-6a4b9f9b662b admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:07.922746 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee844472-2726-464f-83d3-6a4b9f9b662b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:07.931433 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee844472-2726-464f-83d3-6a4b9f9b662b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:07.956894 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 823/1630] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:07.974767 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee16e3-a67a-48eb-8f9e-c520458799b9 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:08.016402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee16e3-a67a-48eb-8f9e-c520458799b9 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:08.052896 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5632112-740c-4022-bd9f-a7cc6d6de34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:08.054150 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5632112-740c-4022-bd9f-a7cc6d6de34e admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:08.057900 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5632112-740c-4022-bd9f-a7cc6d6de34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:08.058468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5632112-740c-4022-bd9f-a7cc6d6de34e admin admin] PATH_INFO: `/v3/projects/512396a422d149c08c09e67175d45f4b/users/8a22a75a5c124ab1a7a019905d9e5bb2/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:08.072859 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5632112-740c-4022-bd9f-a7cc6d6de34e admin admin] RBAC: Authorizing `identity:create_grant(project_id=512396a422d149c08c09e67175d45f4b, user_id=8a22a75a5c124ab1a7a019905d9e5bb2, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:08.092888 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5632112-740c-4022-bd9f-a7cc6d6de34e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:08.136977 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 808/1631] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:07 2022] PUT /identity/v3/projects/512396a422d149c08c09e67175d45f4b/users/8a22a75a5c124ab1a7a019905d9e5bb2/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:08.144852 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621354f-a74a-47c5-8a01-29b0e104b2ff None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:08.145395 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621354f-a74a-47c5-8a01-29b0e104b2ff None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:08.146215 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e5eb8-eb00-4e88-9674-8cebbfb1b488 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:08.146756 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621354f-a74a-47c5-8a01-29b0e104b2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:08.151459 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e5eb8-eb00-4e88-9674-8cebbfb1b488 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:08.152423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e5eb8-eb00-4e88-9674-8cebbfb1b488 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:08.162796 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 824/1632] 10.222.0.26 () {54 vars in 912 bytes} [Sun Oct 2 00:56:08 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:56:08.179914 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c76fbf-456a-4e5b-953a-77d368d1f719 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:08.184353 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c76fbf-456a-4e5b-953a-77d368d1f719 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:08.184353 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c76fbf-456a-4e5b-953a-77d368d1f719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:08.235293 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4621354f-a74a-47c5-8a01-29b0e104b2ff None None] MFA Rules not processed for user `8a22a75a5c124ab1a7a019905d9e5bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:08.238130 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4621354f-a74a-47c5-8a01-29b0e104b2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:08.267053 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e0c76fbf-456a-4e5b-953a-77d368d1f719 None None] MFA Rules not processed for user `81e0396b7ba341ce8d02b1a149786d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:08.268347 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e0c76fbf-456a-4e5b-953a-77d368d1f719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:08.394765 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 825/1633] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Oct 2 00:56:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:08.452317 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c76fbf-456a-4e5b-953a-77d368d1f719 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:08.505682 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:08.569910 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 809/1634] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:08.588417 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621354f-a74a-47c5-8a01-29b0e104b2ff None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:08.619213 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:08.721856 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c76fbf-456a-4e5b-953a-77d368d1f719 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:08.742373 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d7ab6-8a2c-4588-a380-cfa678e4af49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:08.746265 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d7ab6-8a2c-4588-a380-cfa678e4af49 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:08.746977 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d7ab6-8a2c-4588-a380-cfa678e4af49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:08.747492 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d7ab6-8a2c-4588-a380-cfa678e4af49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:08.763053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621354f-a74a-47c5-8a01-29b0e104b2ff None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:08.768834 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d404bd1-519a-49a1-8c9e-1734acdf983d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:08.769539 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d404bd1-519a-49a1-8c9e-1734acdf983d service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:08.769820 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d404bd1-519a-49a1-8c9e-1734acdf983d service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:08.770091 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d404bd1-519a-49a1-8c9e-1734acdf983d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:08.782031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d7ab6-8a2c-4588-a380-cfa678e4af49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:08.783573 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d404bd1-519a-49a1-8c9e-1734acdf983d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:08.785416 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d7ab6-8a2c-4588-a380-cfa678e4af49 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:08.785643 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d404bd1-519a-49a1-8c9e-1734acdf983d service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:08.800228 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 810/1635] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:08.821365 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 826/1636] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:09.444979 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d404bd1-519a-49a1-8c9e-1734acdf983d service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:09.641378 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d404bd1-519a-49a1-8c9e-1734acdf983d service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:09.671983 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf28baa-c8ed-48f4-aa5f-cc0abe8019fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:09.675652 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf28baa-c8ed-48f4-aa5f-cc0abe8019fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:09.676294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf28baa-c8ed-48f4-aa5f-cc0abe8019fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:09.676697 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf28baa-c8ed-48f4-aa5f-cc0abe8019fa admin admin] PATH_INFO: `/v3/users/e35159bbdd4d4899a3b6c7ad09b0ee37` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:09.684168 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf28baa-c8ed-48f4-aa5f-cc0abe8019fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35159bbdd4d4899a3b6c7ad09b0ee37)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:09.690780 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf28baa-c8ed-48f4-aa5f-cc0abe8019fa admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:09.901694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2bf28baa-c8ed-48f4-aa5f-cc0abe8019fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35159bbdd4d4899a3b6c7ad09b0ee37'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:09.902784 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2bf28baa-c8ed-48f4-aa5f-cc0abe8019fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35159bbdd4d4899a3b6c7ad09b0ee37'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:09.918099 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2bf28baa-c8ed-48f4-aa5f-cc0abe8019fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35159bbdd4d4899a3b6c7ad09b0ee37'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:09.919254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2bf28baa-c8ed-48f4-aa5f-cc0abe8019fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35159bbdd4d4899a3b6c7ad09b0ee37'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:09.953129 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2bf28baa-c8ed-48f4-aa5f-cc0abe8019fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35159bbdd4d4899a3b6c7ad09b0ee37'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:10.040542 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 811/1637] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:09 2022] DELETE /identity/v3/users/e35159bbdd4d4899a3b6c7ad09b0ee37 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:10.042470 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34096f-8277-4c47-829f-783c218ec032 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:10.043132 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34096f-8277-4c47-829f-783c218ec032 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:10.044878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34096f-8277-4c47-829f-783c218ec032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:10.098217 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5a34096f-8277-4c47-829f-783c218ec032 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:10.101767 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5a34096f-8277-4c47-829f-783c218ec032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:10.273534 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 827/1638] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:10.332261 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf28baa-c8ed-48f4-aa5f-cc0abe8019fa admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:10.335417 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2bf28baa-c8ed-48f4-aa5f-cc0abe8019fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:10.451237 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:10.549267 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf28baa-c8ed-48f4-aa5f-cc0abe8019fa admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:10.571707 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7144b0-dfd1-4432-b2a8-2dce5fe6afe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:10.574594 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7144b0-dfd1-4432-b2a8-2dce5fe6afe6 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:10.576113 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7144b0-dfd1-4432-b2a8-2dce5fe6afe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:10.577720 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7144b0-dfd1-4432-b2a8-2dce5fe6afe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:10.613423 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7144b0-dfd1-4432-b2a8-2dce5fe6afe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:10.617893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7144b0-dfd1-4432-b2a8-2dce5fe6afe6 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:10.660648 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 812/1639] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:12.568374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34096f-8277-4c47-829f-783c218ec032 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:12.570818 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5a34096f-8277-4c47-829f-783c218ec032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:12.593452 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34096f-8277-4c47-829f-783c218ec032 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:12.605116 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3719b-0ece-4096-aa7f-691484156d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:12.605116 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3719b-0ece-4096-aa7f-691484156d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:12.606224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3719b-0ece-4096-aa7f-691484156d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:12.606224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3719b-0ece-4096-aa7f-691484156d4d admin admin] PATH_INFO: `/v3/users/ebcd47421c4e4dc3a9b852bd82d1529d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:12.607520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3719b-0ece-4096-aa7f-691484156d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebcd47421c4e4dc3a9b852bd82d1529d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:12.608736 dv-cinder-master-3-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-b9d3719b-0ece-4096-aa7f-691484156d4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:56:12.608736 dv-cinder-master-3-smb devstack@keystone.service[81450]: warnings.warn(msg) Oct 02 00:56:12.608736 dv-cinder-master-3-smb devstack@keystone.service[81450]: Oct 02 00:56:12.611120 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3719b-0ece-4096-aa7f-691484156d4d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:12.769738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9d3719b-0ece-4096-aa7f-691484156d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebcd47421c4e4dc3a9b852bd82d1529d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:12.774394 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9d3719b-0ece-4096-aa7f-691484156d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebcd47421c4e4dc3a9b852bd82d1529d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:12.837628 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9d3719b-0ece-4096-aa7f-691484156d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebcd47421c4e4dc3a9b852bd82d1529d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:12.861537 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9d3719b-0ece-4096-aa7f-691484156d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebcd47421c4e4dc3a9b852bd82d1529d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:12.862728 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9d3719b-0ece-4096-aa7f-691484156d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebcd47421c4e4dc3a9b852bd82d1529d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:12.982689 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 828/1640] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:12 2022] DELETE /identity/v3/users/ebcd47421c4e4dc3a9b852bd82d1529d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:12.989414 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afbe19-99be-49ca-92b8-51c65f703e1c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:12.991071 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afbe19-99be-49ca-92b8-51c65f703e1c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:12.992177 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afbe19-99be-49ca-92b8-51c65f703e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:13.083956 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-90afbe19-99be-49ca-92b8-51c65f703e1c None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:13.086771 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-90afbe19-99be-49ca-92b8-51c65f703e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:13.275082 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 813/1641] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:13.276608 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3719b-0ece-4096-aa7f-691484156d4d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:13.279273 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b9d3719b-0ece-4096-aa7f-691484156d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:13.312461 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afbe19-99be-49ca-92b8-51c65f703e1c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:13.314252 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-90afbe19-99be-49ca-92b8-51c65f703e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:13.315547 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3719b-0ece-4096-aa7f-691484156d4d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:13.331567 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40695590-3846-492b-bbdb-239628c8579b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:13.331925 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40695590-3846-492b-bbdb-239628c8579b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:13.332205 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40695590-3846-492b-bbdb-239628c8579b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:13.332484 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40695590-3846-492b-bbdb-239628c8579b admin admin] PATH_INFO: `/v3/projects/33810d0b44214f3b8e8edb143f94ee66` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:13.334592 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40695590-3846-492b-bbdb-239628c8579b admin admin] RBAC: Authorizing `identity:delete_project(project_id=33810d0b44214f3b8e8edb143f94ee66)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:13.341635 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40695590-3846-492b-bbdb-239628c8579b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:13.402199 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:13.470292 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afbe19-99be-49ca-92b8-51c65f703e1c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:13.478726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-40695590-3846-492b-bbdb-239628c8579b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33810d0b44214f3b8e8edb143f94ee66', 'request_id': 'req-40695590-3846-492b-bbdb-239628c8579b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:13.491523 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-40695590-3846-492b-bbdb-239628c8579b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33810d0b44214f3b8e8edb143f94ee66', 'request_id': 'req-40695590-3846-492b-bbdb-239628c8579b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:13.505375 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-40695590-3846-492b-bbdb-239628c8579b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33810d0b44214f3b8e8edb143f94ee66', 'request_id': 'req-40695590-3846-492b-bbdb-239628c8579b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:13.526072 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-40695590-3846-492b-bbdb-239628c8579b admin admin] The token cache is being invalidate because project 33810d0b44214f3b8e8edb143f94ee66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:56:13.526695 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-40695590-3846-492b-bbdb-239628c8579b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:13.527629 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-40695590-3846-492b-bbdb-239628c8579b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:13.529669 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 829/1642] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:13 2022] DELETE /identity/v3/projects/33810d0b44214f3b8e8edb143f94ee66 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:13.535005 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7181681-42b4-4512-9b4a-4971bcc1ad5b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:13.535472 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7181681-42b4-4512-9b4a-4971bcc1ad5b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:13.535886 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7181681-42b4-4512-9b4a-4971bcc1ad5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:13.565483 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a7181681-42b4-4512-9b4a-4971bcc1ad5b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:13.570102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a7181681-42b4-4512-9b4a-4971bcc1ad5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:13.640571 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d8c15-a614-41de-aac5-eb4463882abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:13.641120 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d8c15-a614-41de-aac5-eb4463882abb service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:13.641529 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d8c15-a614-41de-aac5-eb4463882abb service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:13.641808 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d8c15-a614-41de-aac5-eb4463882abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:13.651552 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ca1d8c15-a614-41de-aac5-eb4463882abb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:13.720128 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 830/1643] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:13.728867 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7ebf5-eb2c-4f86-8b19-c57e18b6e945 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:13.729511 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7ebf5-eb2c-4f86-8b19-c57e18b6e945 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:13.729961 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7ebf5-eb2c-4f86-8b19-c57e18b6e945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:13.757576 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:13.789407 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-55a7ebf5-eb2c-4f86-8b19-c57e18b6e945 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:13.792134 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-55a7ebf5-eb2c-4f86-8b19-c57e18b6e945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:13.804777 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 831/1644] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:56:13.808816 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7ebf5-eb2c-4f86-8b19-c57e18b6e945 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:13.823238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7ebf5-eb2c-4f86-8b19-c57e18b6e945 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:13.829391 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a7c2c-5e8d-4d4c-9c9f-d1280e2a7339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:13.830379 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a7c2c-5e8d-4d4c-9c9f-d1280e2a7339 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:13.830833 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a7c2c-5e8d-4d4c-9c9f-d1280e2a7339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:13.831272 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a7c2c-5e8d-4d4c-9c9f-d1280e2a7339 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:13.832158 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a7c2c-5e8d-4d4c-9c9f-d1280e2a7339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:13.833351 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a7c2c-5e8d-4d4c-9c9f-d1280e2a7339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:13.835860 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a7c2c-5e8d-4d4c-9c9f-d1280e2a7339 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:13.839597 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d8c15-a614-41de-aac5-eb4463882abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:13.841161 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d8c15-a614-41de-aac5-eb4463882abb service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:13.851820 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 832/1645] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:56:13.856465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a7c2c-5e8d-4d4c-9c9f-d1280e2a7339 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:13.867859 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 814/1646] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:56:13.920607 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a7c2c-5e8d-4d4c-9c9f-d1280e2a7339 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:13.955042 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4636f-3acf-47a7-8ac6-7f92f822aed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:13.956131 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4636f-3acf-47a7-8ac6-7f92f822aed7 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:13.956632 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4636f-3acf-47a7-8ac6-7f92f822aed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:13.957213 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4636f-3acf-47a7-8ac6-7f92f822aed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:13.958656 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4636f-3acf-47a7-8ac6-7f92f822aed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:13.961427 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4636f-3acf-47a7-8ac6-7f92f822aed7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:14.005233 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 833/1647] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:13 2022] POST /identity/v3/projects => generated 363 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:14.007522 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d8c15-a614-41de-aac5-eb4463882abb service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:14.022476 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d8c15-a614-41de-aac5-eb4463882abb service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:14.167616 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae180cf-8d40-42e7-bff6-f8ffb57ee413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:14.168342 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae180cf-8d40-42e7-bff6-f8ffb57ee413 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:14.168649 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae180cf-8d40-42e7-bff6-f8ffb57ee413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:14.168930 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae180cf-8d40-42e7-bff6-f8ffb57ee413 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:14.169651 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae180cf-8d40-42e7-bff6-f8ffb57ee413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:14.171786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae180cf-8d40-42e7-bff6-f8ffb57ee413 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:14.206839 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 815/1648] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:14 2022] POST /identity/v3/users => generated 282 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:56:14.211286 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4636f-3acf-47a7-8ac6-7f92f822aed7 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:14.281916 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4636f-3acf-47a7-8ac6-7f92f822aed7 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:14.309642 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cea79-e28f-4b63-bbd8-adac5054e8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:14.313219 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cea79-e28f-4b63-bbd8-adac5054e8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:14.315711 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cea79-e28f-4b63-bbd8-adac5054e8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:14.335790 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cea79-e28f-4b63-bbd8-adac5054e8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:14.338777 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cea79-e28f-4b63-bbd8-adac5054e8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:14.363421 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cea79-e28f-4b63-bbd8-adac5054e8d8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:14.407469 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 834/1649] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:14.412192 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae180cf-8d40-42e7-bff6-f8ffb57ee413 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:14.431283 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae180cf-8d40-42e7-bff6-f8ffb57ee413 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:14.444854 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91931c74-6a4d-4c3a-b719-aa039b5f213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:14.445545 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91931c74-6a4d-4c3a-b719-aa039b5f213c admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:14.446866 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91931c74-6a4d-4c3a-b719-aa039b5f213c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:14.447165 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91931c74-6a4d-4c3a-b719-aa039b5f213c admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:14.447985 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91931c74-6a4d-4c3a-b719-aa039b5f213c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:14.453625 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91931c74-6a4d-4c3a-b719-aa039b5f213c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:14.503472 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 816/1650] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:14.506233 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cea79-e28f-4b63-bbd8-adac5054e8d8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:14.525887 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cea79-e28f-4b63-bbd8-adac5054e8d8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:14.541220 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc33345-910b-4090-ba6b-15acdfbe98f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:14.541382 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc33345-910b-4090-ba6b-15acdfbe98f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:14.542040 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc33345-910b-4090-ba6b-15acdfbe98f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:14.542040 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc33345-910b-4090-ba6b-15acdfbe98f3 admin admin] PATH_INFO: `/v3/projects/d16e03f37ccd4b5a8d476b8236487fc2/users/b2c924598e0e40a0bc59f1d1800efffa/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:14.581169 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91931c74-6a4d-4c3a-b719-aa039b5f213c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:14.584990 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-91931c74-6a4d-4c3a-b719-aa039b5f213c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:14.609483 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc33345-910b-4090-ba6b-15acdfbe98f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16e03f37ccd4b5a8d476b8236487fc2, user_id=b2c924598e0e40a0bc59f1d1800efffa, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:14.627472 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc33345-910b-4090-ba6b-15acdfbe98f3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:14.654400 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91931c74-6a4d-4c3a-b719-aa039b5f213c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:14.668677 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98c643-fb62-462d-b61f-d534489e4112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:14.672776 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98c643-fb62-462d-b61f-d534489e4112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:14.673918 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98c643-fb62-462d-b61f-d534489e4112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:14.675837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98c643-fb62-462d-b61f-d534489e4112 admin admin] PATH_INFO: `/v3/users/0c5772cc673e480fbec2cc6a87177203` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:14.680814 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98c643-fb62-462d-b61f-d534489e4112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5772cc673e480fbec2cc6a87177203)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:14.687127 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98c643-fb62-462d-b61f-d534489e4112 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:14.691245 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 835/1651] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:14 2022] PUT /identity/v3/projects/d16e03f37ccd4b5a8d476b8236487fc2/users/b2c924598e0e40a0bc59f1d1800efffa/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:14.704333 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f1f9c-3980-4629-86d1-15ee2c4e29fe None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:14.704925 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f1f9c-3980-4629-86d1-15ee2c4e29fe None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:14.705435 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f1f9c-3980-4629-86d1-15ee2c4e29fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:14.771238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-304f1f9c-3980-4629-86d1-15ee2c4e29fe None None] MFA Rules not processed for user `b2c924598e0e40a0bc59f1d1800efffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:14.773140 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-304f1f9c-3980-4629-86d1-15ee2c4e29fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:14.811770 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4c98c643-fb62-462d-b61f-d534489e4112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5772cc673e480fbec2cc6a87177203'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:14.814152 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4c98c643-fb62-462d-b61f-d534489e4112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5772cc673e480fbec2cc6a87177203'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:14.826214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:14.828539 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4c98c643-fb62-462d-b61f-d534489e4112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5772cc673e480fbec2cc6a87177203'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:14.829634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4c98c643-fb62-462d-b61f-d534489e4112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5772cc673e480fbec2cc6a87177203'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:14.859553 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4c98c643-fb62-462d-b61f-d534489e4112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5772cc673e480fbec2cc6a87177203'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:14.939055 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 817/1652] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:14 2022] DELETE /identity/v3/users/0c5772cc673e480fbec2cc6a87177203 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:56:14.954588 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d0ae4-1538-45ee-aff7-49f5775995ad None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:14.957434 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d0ae4-1538-45ee-aff7-49f5775995ad None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:14.957434 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d0ae4-1538-45ee-aff7-49f5775995ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:15.048468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3c7d0ae4-1538-45ee-aff7-49f5775995ad None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:15.049871 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3c7d0ae4-1538-45ee-aff7-49f5775995ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:15.067155 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 836/1653] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:56:15.071933 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f1f9c-3980-4629-86d1-15ee2c4e29fe None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:15.099199 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-304f1f9c-3980-4629-86d1-15ee2c4e29fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:15.110593 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:15.186766 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 818/1654] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:15.204252 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d0ae4-1538-45ee-aff7-49f5775995ad None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:15.207013 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3c7d0ae4-1538-45ee-aff7-49f5775995ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:15.351629 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f1f9c-3980-4629-86d1-15ee2c4e29fe None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:15.364410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fae6e-30e6-4fda-ab10-d60551fc020f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:15.372768 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d0ae4-1538-45ee-aff7-49f5775995ad None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:15.383130 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fae6e-30e6-4fda-ab10-d60551fc020f admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:15.383777 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fae6e-30e6-4fda-ab10-d60551fc020f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:15.385199 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fae6e-30e6-4fda-ab10-d60551fc020f admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:15.385531 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e1c36-6d90-4d7f-9770-366ab025785f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:15.386628 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e1c36-6d90-4d7f-9770-366ab025785f service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:15.386900 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e1c36-6d90-4d7f-9770-366ab025785f service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:15.387179 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e1c36-6d90-4d7f-9770-366ab025785f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:15.387969 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fae6e-30e6-4fda-ab10-d60551fc020f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:15.398113 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fae6e-30e6-4fda-ab10-d60551fc020f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:15.426207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e1c36-6d90-4d7f-9770-366ab025785f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:15.427761 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e1c36-6d90-4d7f-9770-366ab025785f service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:15.462126 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 819/1655] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:56:15.495339 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 837/1656] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:15 2022] POST /identity/v3/projects => generated 363 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:15.498206 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e1c36-6d90-4d7f-9770-366ab025785f service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:15.514201 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e1c36-6d90-4d7f-9770-366ab025785f service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:15.757887 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a52a3d-a75e-47fc-8f20-a959b71c97d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:15.760161 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a52a3d-a75e-47fc-8f20-a959b71c97d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:15.762705 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a52a3d-a75e-47fc-8f20-a959b71c97d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:15.763240 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a52a3d-a75e-47fc-8f20-a959b71c97d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:15.764205 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a52a3d-a75e-47fc-8f20-a959b71c97d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:15.771970 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a52a3d-a75e-47fc-8f20-a959b71c97d7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:15.870730 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fae6e-30e6-4fda-ab10-d60551fc020f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:15.872560 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 820/1657] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:15 2022] POST /identity/v3/users => generated 288 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:15.898094 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fae6e-30e6-4fda-ab10-d60551fc020f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:15.912996 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fd377-ff26-43e8-99c8-ced4e6e44e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:15.914321 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fd377-ff26-43e8-99c8-ced4e6e44e48 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:15.914719 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fd377-ff26-43e8-99c8-ced4e6e44e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:15.915062 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fd377-ff26-43e8-99c8-ced4e6e44e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:15.916143 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fd377-ff26-43e8-99c8-ced4e6e44e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:15.921238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fd377-ff26-43e8-99c8-ced4e6e44e48 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:15.945788 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a52a3d-a75e-47fc-8f20-a959b71c97d7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:15.956888 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 838/1658] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:15.966459 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a52a3d-a75e-47fc-8f20-a959b71c97d7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:15.976013 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cdf0b-bc66-4492-8c20-1bda1742ea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:15.977416 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cdf0b-bc66-4492-8c20-1bda1742ea7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:15.978004 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cdf0b-bc66-4492-8c20-1bda1742ea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:15.978592 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cdf0b-bc66-4492-8c20-1bda1742ea7f admin admin] PATH_INFO: `/v3/projects/e9c7a6a09e674d299ec88cb77689ca37/users/3c145183e18341eda116588ee9b9cc37/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:16.024338 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cdf0b-bc66-4492-8c20-1bda1742ea7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c7a6a09e674d299ec88cb77689ca37, user_id=3c145183e18341eda116588ee9b9cc37, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:16.029745 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cdf0b-bc66-4492-8c20-1bda1742ea7f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:16.076646 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 821/1659] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:15 2022] PUT /identity/v3/projects/e9c7a6a09e674d299ec88cb77689ca37/users/3c145183e18341eda116588ee9b9cc37/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:16.085615 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fd377-ff26-43e8-99c8-ced4e6e44e48 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:16.141838 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fd377-ff26-43e8-99c8-ced4e6e44e48 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:16.399953 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384b7d8-de50-4cbe-935b-0e75abfba4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:16.400708 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384b7d8-de50-4cbe-935b-0e75abfba4bf admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:16.400889 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384b7d8-de50-4cbe-935b-0e75abfba4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:16.401257 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384b7d8-de50-4cbe-935b-0e75abfba4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:16.402138 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384b7d8-de50-4cbe-935b-0e75abfba4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:16.434110 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384b7d8-de50-4cbe-935b-0e75abfba4bf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:16.488348 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 839/1660] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:16.490330 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cdf0b-bc66-4492-8c20-1bda1742ea7f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:16.515051 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cdf0b-bc66-4492-8c20-1bda1742ea7f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:16.534076 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cdace-4b61-45ca-b8cc-2f0c4ce2796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:16.534758 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cdace-4b61-45ca-b8cc-2f0c4ce2796a admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:16.535036 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cdace-4b61-45ca-b8cc-2f0c4ce2796a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:16.535303 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cdace-4b61-45ca-b8cc-2f0c4ce2796a admin admin] PATH_INFO: `/v3/projects/e9c7a6a09e674d299ec88cb77689ca37/users/3c145183e18341eda116588ee9b9cc37/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:16.545849 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cdace-4b61-45ca-b8cc-2f0c4ce2796a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c7a6a09e674d299ec88cb77689ca37, user_id=3c145183e18341eda116588ee9b9cc37, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:16.554400 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cdace-4b61-45ca-b8cc-2f0c4ce2796a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:16.612710 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 822/1661] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:16 2022] PUT /identity/v3/projects/e9c7a6a09e674d299ec88cb77689ca37/users/3c145183e18341eda116588ee9b9cc37/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:16.624922 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdad38-3f52-4260-9ffb-ca41bc318e87 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:16.625239 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdad38-3f52-4260-9ffb-ca41bc318e87 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:16.625557 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdad38-3f52-4260-9ffb-ca41bc318e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:16.710595 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-05bdad38-3f52-4260-9ffb-ca41bc318e87 None None] MFA Rules not processed for user `3c145183e18341eda116588ee9b9cc37`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:16.713172 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-05bdad38-3f52-4260-9ffb-ca41bc318e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:16.808889 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cdace-4b61-45ca-b8cc-2f0c4ce2796a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:16.811227 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-959cdace-4b61-45ca-b8cc-2f0c4ce2796a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:16.842070 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:16.935126 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:17.086042 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 840/1662] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:17.107450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdad38-3f52-4260-9ffb-ca41bc318e87 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:17.110668 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-05bdad38-3f52-4260-9ffb-ca41bc318e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:17.112146 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cdace-4b61-45ca-b8cc-2f0c4ce2796a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:17.127729 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d30025-ad79-437a-9c22-b083d19955f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:17.128413 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d30025-ad79-437a-9c22-b083d19955f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:17.128686 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d30025-ad79-437a-9c22-b083d19955f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:17.129174 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d30025-ad79-437a-9c22-b083d19955f3 admin admin] PATH_INFO: `/v3/projects/728f4ed412544bcea192bc3d5722807d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:17.132514 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d30025-ad79-437a-9c22-b083d19955f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=728f4ed412544bcea192bc3d5722807d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:17.138562 dv-cinder-master-3-smb devstack@keystone.service[81451]: WARNING py.warnings [None req-f9d30025-ad79-437a-9c22-b083d19955f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:56:17.138562 dv-cinder-master-3-smb devstack@keystone.service[81451]: warnings.warn(msg) Oct 02 00:56:17.138562 dv-cinder-master-3-smb devstack@keystone.service[81451]: Oct 02 00:56:17.140342 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d30025-ad79-437a-9c22-b083d19955f3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:17.338807 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdad38-3f52-4260-9ffb-ca41bc318e87 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:17.471048 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f9d30025-ad79-437a-9c22-b083d19955f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '728f4ed412544bcea192bc3d5722807d', 'request_id': 'req-f9d30025-ad79-437a-9c22-b083d19955f3'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:17.536653 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f9d30025-ad79-437a-9c22-b083d19955f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '728f4ed412544bcea192bc3d5722807d', 'request_id': 'req-f9d30025-ad79-437a-9c22-b083d19955f3'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:17.581459 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f9d30025-ad79-437a-9c22-b083d19955f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '728f4ed412544bcea192bc3d5722807d', 'request_id': 'req-f9d30025-ad79-437a-9c22-b083d19955f3'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:17.608274 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfb164-d203-4a71-ad16-0d29d214d4e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:17.609916 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfb164-d203-4a71-ad16-0d29d214d4e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:17.611651 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfb164-d203-4a71-ad16-0d29d214d4e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:17.612040 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfb164-d203-4a71-ad16-0d29d214d4e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:17.624248 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f9d30025-ad79-437a-9c22-b083d19955f3 admin admin] The token cache is being invalidate because project 728f4ed412544bcea192bc3d5722807d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:56:17.624551 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f9d30025-ad79-437a-9c22-b083d19955f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:17.627536 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f9d30025-ad79-437a-9c22-b083d19955f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:17.633512 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 823/1663] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:16 2022] DELETE /identity/v3/projects/728f4ed412544bcea192bc3d5722807d => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:17.642496 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d30025-ad79-437a-9c22-b083d19955f3 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:17.647853 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f9d30025-ad79-437a-9c22-b083d19955f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:17.826180 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d30025-ad79-437a-9c22-b083d19955f3 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:17.848834 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dfb164-d203-4a71-ad16-0d29d214d4e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:17.851129 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dfb164-d203-4a71-ad16-0d29d214d4e4 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:17.851244 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb4ace-e979-457e-8430-0cb13f3afdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:17.851900 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb4ace-e979-457e-8430-0cb13f3afdf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:17.852187 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb4ace-e979-457e-8430-0cb13f3afdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:17.852460 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb4ace-e979-457e-8430-0cb13f3afdf0 admin admin] PATH_INFO: `/v3/users/8a22a75a5c124ab1a7a019905d9e5bb2` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:17.859786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb4ace-e979-457e-8430-0cb13f3afdf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a22a75a5c124ab1a7a019905d9e5bb2)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:17.864911 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb4ace-e979-457e-8430-0cb13f3afdf0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:17.899345 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 841/1664] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 794 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:17.994363 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b0bb4ace-e979-457e-8430-0cb13f3afdf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a22a75a5c124ab1a7a019905d9e5bb2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:18.000029 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b0bb4ace-e979-457e-8430-0cb13f3afdf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a22a75a5c124ab1a7a019905d9e5bb2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:18.018198 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b0bb4ace-e979-457e-8430-0cb13f3afdf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a22a75a5c124ab1a7a019905d9e5bb2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:18.018835 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b0bb4ace-e979-457e-8430-0cb13f3afdf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a22a75a5c124ab1a7a019905d9e5bb2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:18.022117 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:18.053672 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b0bb4ace-e979-457e-8430-0cb13f3afdf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a22a75a5c124ab1a7a019905d9e5bb2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:18.135197 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 824/1665] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:17 2022] DELETE /identity/v3/users/8a22a75a5c124ab1a7a019905d9e5bb2 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:18.376584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfb164-d203-4a71-ad16-0d29d214d4e4 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:18.378662 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-39dfb164-d203-4a71-ad16-0d29d214d4e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:18.405576 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfb164-d203-4a71-ad16-0d29d214d4e4 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:18.470808 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:18.593432 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87eb14-1491-4883-80be-f1fdd87168d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:18.594190 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87eb14-1491-4883-80be-f1fdd87168d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:18.594554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87eb14-1491-4883-80be-f1fdd87168d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:18.594908 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87eb14-1491-4883-80be-f1fdd87168d0 admin admin] PATH_INFO: `/v3/projects/ae5875cb30504d3390f6499ec184022c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:18.598988 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87eb14-1491-4883-80be-f1fdd87168d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae5875cb30504d3390f6499ec184022c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:18.601023 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87eb14-1491-4883-80be-f1fdd87168d0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:18.721188 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5f87eb14-1491-4883-80be-f1fdd87168d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae5875cb30504d3390f6499ec184022c', 'request_id': 'req-5f87eb14-1491-4883-80be-f1fdd87168d0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:18.743591 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5f87eb14-1491-4883-80be-f1fdd87168d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae5875cb30504d3390f6499ec184022c', 'request_id': 'req-5f87eb14-1491-4883-80be-f1fdd87168d0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:18.765480 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5f87eb14-1491-4883-80be-f1fdd87168d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae5875cb30504d3390f6499ec184022c', 'request_id': 'req-5f87eb14-1491-4883-80be-f1fdd87168d0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:18.791433 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5f87eb14-1491-4883-80be-f1fdd87168d0 admin admin] The token cache is being invalidate because project ae5875cb30504d3390f6499ec184022c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:56:18.791873 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5f87eb14-1491-4883-80be-f1fdd87168d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:18.793009 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5f87eb14-1491-4883-80be-f1fdd87168d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:18.795284 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 842/1666] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:18 2022] DELETE /identity/v3/projects/ae5875cb30504d3390f6499ec184022c => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:18.802818 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87251514-38e3-45ed-99af-ff2123c83790 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:18.802818 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87251514-38e3-45ed-99af-ff2123c83790 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:18.802818 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87251514-38e3-45ed-99af-ff2123c83790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:18.846435 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-87251514-38e3-45ed-99af-ff2123c83790 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:18.847700 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-87251514-38e3-45ed-99af-ff2123c83790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:19.174985 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728cb5a-f1e2-431a-bf69-e0fcdf6f7640 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:19.175273 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728cb5a-f1e2-431a-bf69-e0fcdf6f7640 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:19.175863 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728cb5a-f1e2-431a-bf69-e0fcdf6f7640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:19.181652 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 825/1667] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:19.257983 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1728cb5a-f1e2-431a-bf69-e0fcdf6f7640 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:19.259263 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1728cb5a-f1e2-431a-bf69-e0fcdf6f7640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:19.315164 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 843/1668] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:56:19.315974 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87251514-38e3-45ed-99af-ff2123c83790 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:19.341312 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87251514-38e3-45ed-99af-ff2123c83790 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:19.387308 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3452a01-0504-4f9b-abfe-ee997ae9617d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:19.392521 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3452a01-0504-4f9b-abfe-ee997ae9617d admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:19.394586 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3452a01-0504-4f9b-abfe-ee997ae9617d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:19.395049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3452a01-0504-4f9b-abfe-ee997ae9617d admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:19.396032 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3452a01-0504-4f9b-abfe-ee997ae9617d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:19.396428 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3452a01-0504-4f9b-abfe-ee997ae9617d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:19.398392 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3452a01-0504-4f9b-abfe-ee997ae9617d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:19.454658 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728cb5a-f1e2-431a-bf69-e0fcdf6f7640 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:19.458523 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1728cb5a-f1e2-431a-bf69-e0fcdf6f7640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:19.476981 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 826/1669] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:56:19.481487 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3452a01-0504-4f9b-abfe-ee997ae9617d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:19.483486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728cb5a-f1e2-431a-bf69-e0fcdf6f7640 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:19.503118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032ad67-ff0d-428d-8491-9d775bbd2a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:19.503955 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032ad67-ff0d-428d-8491-9d775bbd2a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:19.507162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032ad67-ff0d-428d-8491-9d775bbd2a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:19.509430 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032ad67-ff0d-428d-8491-9d775bbd2a46 admin admin] PATH_INFO: `/v3/users/b2c924598e0e40a0bc59f1d1800efffa` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:19.516977 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032ad67-ff0d-428d-8491-9d775bbd2a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c924598e0e40a0bc59f1d1800efffa)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:19.523931 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032ad67-ff0d-428d-8491-9d775bbd2a46 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:19.544162 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3452a01-0504-4f9b-abfe-ee997ae9617d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:19.570570 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88388970-56c9-44d6-8261-450d0a82c5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:19.571208 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88388970-56c9-44d6-8261-450d0a82c5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:19.571489 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88388970-56c9-44d6-8261-450d0a82c5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:19.571761 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88388970-56c9-44d6-8261-450d0a82c5f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:19.572401 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88388970-56c9-44d6-8261-450d0a82c5f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:19.574463 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88388970-56c9-44d6-8261-450d0a82c5f2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:19.648933 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6032ad67-ff0d-428d-8491-9d775bbd2a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c924598e0e40a0bc59f1d1800efffa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:19.651482 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6032ad67-ff0d-428d-8491-9d775bbd2a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c924598e0e40a0bc59f1d1800efffa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:19.685002 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6032ad67-ff0d-428d-8491-9d775bbd2a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c924598e0e40a0bc59f1d1800efffa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:19.699683 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 827/1670] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:19 2022] POST /identity/v3/projects => generated 405 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:19.703503 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6032ad67-ff0d-428d-8491-9d775bbd2a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c924598e0e40a0bc59f1d1800efffa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:19.704199 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6032ad67-ff0d-428d-8491-9d775bbd2a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c924598e0e40a0bc59f1d1800efffa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:19.704347 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88388970-56c9-44d6-8261-450d0a82c5f2 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:19.711037 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-88388970-56c9-44d6-8261-450d0a82c5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:19.738714 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 844/1671] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:19 2022] DELETE /identity/v3/users/b2c924598e0e40a0bc59f1d1800efffa => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:19.739830 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032ad67-ff0d-428d-8491-9d775bbd2a46 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:19.745855 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6032ad67-ff0d-428d-8491-9d775bbd2a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:19.791057 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:19.913760 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88388970-56c9-44d6-8261-450d0a82c5f2 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:19.930826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae96766-d0ad-47ad-a1ef-1e4be7adc2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:19.936911 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae96766-d0ad-47ad-a1ef-1e4be7adc2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:19.937303 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae96766-d0ad-47ad-a1ef-1e4be7adc2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:19.937933 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae96766-d0ad-47ad-a1ef-1e4be7adc2f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:19.938714 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae96766-d0ad-47ad-a1ef-1e4be7adc2f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:19.942644 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae96766-d0ad-47ad-a1ef-1e4be7adc2f3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:19.947729 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032ad67-ff0d-428d-8491-9d775bbd2a46 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:19.958952 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7745f-e6af-49f7-82df-b8c3aa66c85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:19.959620 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7745f-e6af-49f7-82df-b8c3aa66c85b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:19.959906 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7745f-e6af-49f7-82df-b8c3aa66c85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:19.960187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7745f-e6af-49f7-82df-b8c3aa66c85b admin admin] PATH_INFO: `/v3/users/7ef1923828d44a86a25f945cb15dd02b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:19.961760 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7745f-e6af-49f7-82df-b8c3aa66c85b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef1923828d44a86a25f945cb15dd02b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:19.967023 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7745f-e6af-49f7-82df-b8c3aa66c85b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:20.005418 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 828/1672] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:19 2022] POST /identity/v3/users => generated 303 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:20.008128 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360d4f7-758e-488d-9286-493192b3e0e7 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:20.010174 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360d4f7-758e-488d-9286-493192b3e0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:20.010589 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360d4f7-758e-488d-9286-493192b3e0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:20.062879 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8360d4f7-758e-488d-9286-493192b3e0e7 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:20.066238 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8360d4f7-758e-488d-9286-493192b3e0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:20.087337 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 829/1673] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:20.089114 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360d4f7-758e-488d-9286-493192b3e0e7 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:20.108110 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-15d7745f-e6af-49f7-82df-b8c3aa66c85b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef1923828d44a86a25f945cb15dd02b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:20.110268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-15d7745f-e6af-49f7-82df-b8c3aa66c85b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef1923828d44a86a25f945cb15dd02b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:20.110637 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360d4f7-758e-488d-9286-493192b3e0e7 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:20.126983 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194dbe6-e687-4c57-8651-88ae8ed2c5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:20.127900 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194dbe6-e687-4c57-8651-88ae8ed2c5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:20.128325 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194dbe6-e687-4c57-8651-88ae8ed2c5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:20.128741 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194dbe6-e687-4c57-8651-88ae8ed2c5e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:20.130371 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194dbe6-e687-4c57-8651-88ae8ed2c5e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:20.132285 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194dbe6-e687-4c57-8651-88ae8ed2c5e4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:20.147868 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 830/1674] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:20.155038 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194dbe6-e687-4c57-8651-88ae8ed2c5e4 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:20.157893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6194dbe6-e687-4c57-8651-88ae8ed2c5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:20.158710 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-15d7745f-e6af-49f7-82df-b8c3aa66c85b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef1923828d44a86a25f945cb15dd02b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:20.179055 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-15d7745f-e6af-49f7-82df-b8c3aa66c85b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef1923828d44a86a25f945cb15dd02b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:20.179759 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-15d7745f-e6af-49f7-82df-b8c3aa66c85b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef1923828d44a86a25f945cb15dd02b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:20.182512 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194dbe6-e687-4c57-8651-88ae8ed2c5e4 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:20.192746 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd16b93-eee0-4da1-ae00-16ef38e18d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:20.193668 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd16b93-eee0-4da1-ae00-16ef38e18d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:20.194088 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd16b93-eee0-4da1-ae00-16ef38e18d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:20.194496 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd16b93-eee0-4da1-ae00-16ef38e18d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:20.195308 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd16b93-eee0-4da1-ae00-16ef38e18d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:20.197172 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd16b93-eee0-4da1-ae00-16ef38e18d0b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:20.204279 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 845/1675] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:19 2022] DELETE /identity/v3/users/7ef1923828d44a86a25f945cb15dd02b => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:20.209895 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:20.211129 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca3f6c-d53a-4666-b039-0c84c5e90ce5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:20.211582 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca3f6c-d53a-4666-b039-0c84c5e90ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:20.211874 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca3f6c-d53a-4666-b039-0c84c5e90ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:20.228819 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 831/1676] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:20.233629 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd16b93-eee0-4da1-ae00-16ef38e18d0b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:20.255998 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd16b93-eee0-4da1-ae00-16ef38e18d0b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:20.262298 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c7ca3f6c-d53a-4666-b039-0c84c5e90ce5 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:20.263867 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c7ca3f6c-d53a-4666-b039-0c84c5e90ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:20.412217 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 846/1677] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:20.412217 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca3f6c-d53a-4666-b039-0c84c5e90ce5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:20.412217 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c7ca3f6c-d53a-4666-b039-0c84c5e90ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:20.422214 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fecf8-d241-475b-9b5e-e4bce1cbb400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:20.423323 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fecf8-d241-475b-9b5e-e4bce1cbb400 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:20.423741 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fecf8-d241-475b-9b5e-e4bce1cbb400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:20.424334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fecf8-d241-475b-9b5e-e4bce1cbb400 admin admin] PATH_INFO: `/v3/projects/1074800bdac847f38d86290865603baf/users/956d6c86088547ac8da4c69752bc2e01/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:20.449907 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1fecf8-d241-475b-9b5e-e4bce1cbb400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1074800bdac847f38d86290865603baf, user_id=956d6c86088547ac8da4c69752bc2e01, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:20.453731 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1fecf8-d241-475b-9b5e-e4bce1cbb400 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:20.481245 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 832/1678] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:20 2022] PUT /identity/v3/projects/1074800bdac847f38d86290865603baf/users/956d6c86088547ac8da4c69752bc2e01/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:20.484760 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fecf8-d241-475b-9b5e-e4bce1cbb400 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:20.491050 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2e1fecf8-d241-475b-9b5e-e4bce1cbb400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:20.499015 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:20.548626 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca3f6c-d53a-4666-b039-0c84c5e90ce5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:20.598075 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fecf8-d241-475b-9b5e-e4bce1cbb400 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:20.605661 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46917365-5386-44bb-a8db-138bfddd2076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:20.606297 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46917365-5386-44bb-a8db-138bfddd2076 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:20.607083 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46917365-5386-44bb-a8db-138bfddd2076 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:20.607374 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46917365-5386-44bb-a8db-138bfddd2076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:20.681868 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0334a-c667-47c0-b387-7e30270df131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:20.682522 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0334a-c667-47c0-b387-7e30270df131 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:20.682802 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0334a-c667-47c0-b387-7e30270df131 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:20.683082 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0334a-c667-47c0-b387-7e30270df131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:20.690228 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-94a0334a-c667-47c0-b387-7e30270df131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:20.758421 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46917365-5386-44bb-a8db-138bfddd2076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:20.760710 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46917365-5386-44bb-a8db-138bfddd2076 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:20.797559 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 833/1679] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:20.798813 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46917365-5386-44bb-a8db-138bfddd2076 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:20.802339 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-46917365-5386-44bb-a8db-138bfddd2076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:20.835595 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46917365-5386-44bb-a8db-138bfddd2076 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:20.835714 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0334a-c667-47c0-b387-7e30270df131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:20.837134 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0334a-c667-47c0-b387-7e30270df131 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:20.849100 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6434b-5eaa-42e2-bb2d-b655e1287079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:20.850336 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6434b-5eaa-42e2-bb2d-b655e1287079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:20.853965 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6434b-5eaa-42e2-bb2d-b655e1287079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:20.855038 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6434b-5eaa-42e2-bb2d-b655e1287079 admin admin] PATH_INFO: `/v3/projects/512396a422d149c08c09e67175d45f4b` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:20.857452 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 847/1680] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:20.857768 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6434b-5eaa-42e2-bb2d-b655e1287079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=512396a422d149c08c09e67175d45f4b)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:20.858781 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1581b-a63e-4938-a64d-89509bceadda None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:20.859073 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1581b-a63e-4938-a64d-89509bceadda None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:20.859354 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1581b-a63e-4938-a64d-89509bceadda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:20.865438 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6434b-5eaa-42e2-bb2d-b655e1287079 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:20.902723 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-80f1581b-a63e-4938-a64d-89509bceadda None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:20.903915 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-80f1581b-a63e-4938-a64d-89509bceadda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:20.920141 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 848/1681] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:20.937452 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:21.002696 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1581b-a63e-4938-a64d-89509bceadda None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:21.004966 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-80f1581b-a63e-4938-a64d-89509bceadda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:21.037305 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1581b-a63e-4938-a64d-89509bceadda None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:21.041607 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b5c6434b-5eaa-42e2-bb2d-b655e1287079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '512396a422d149c08c09e67175d45f4b', 'request_id': 'req-b5c6434b-5eaa-42e2-bb2d-b655e1287079'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:21.054010 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b5c6434b-5eaa-42e2-bb2d-b655e1287079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '512396a422d149c08c09e67175d45f4b', 'request_id': 'req-b5c6434b-5eaa-42e2-bb2d-b655e1287079'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:21.079846 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b5c6434b-5eaa-42e2-bb2d-b655e1287079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '512396a422d149c08c09e67175d45f4b', 'request_id': 'req-b5c6434b-5eaa-42e2-bb2d-b655e1287079'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:21.108732 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b5c6434b-5eaa-42e2-bb2d-b655e1287079 admin admin] The token cache is being invalidate because project 512396a422d149c08c09e67175d45f4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:56:21.112264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b5c6434b-5eaa-42e2-bb2d-b655e1287079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:21.115024 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b5c6434b-5eaa-42e2-bb2d-b655e1287079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:21.119840 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 834/1682] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:20 2022] DELETE /identity/v3/projects/512396a422d149c08c09e67175d45f4b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:21.126785 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bf423-7135-4199-8127-63d606364f43 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:21.127120 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bf423-7135-4199-8127-63d606364f43 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:21.127322 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bf423-7135-4199-8127-63d606364f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:21.153877 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65258849-9566-4961-9ce1-aa1d1779dd8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:21.154450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65258849-9566-4961-9ce1-aa1d1779dd8c service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:21.154737 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65258849-9566-4961-9ce1-aa1d1779dd8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:21.155016 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65258849-9566-4961-9ce1-aa1d1779dd8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:21.157130 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-65258849-9566-4961-9ce1-aa1d1779dd8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:21.193425 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-2f7bf423-7135-4199-8127-63d606364f43 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:21.196498 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2f7bf423-7135-4199-8127-63d606364f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:21.264647 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:21.300794 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65258849-9566-4961-9ce1-aa1d1779dd8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:21.302698 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65258849-9566-4961-9ce1-aa1d1779dd8c service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:21.337374 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 849/1683] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:21.363898 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 835/1684] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:21.365680 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500139e-2bb4-4911-8a14-245f40f2d988 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:21.365972 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500139e-2bb4-4911-8a14-245f40f2d988 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:21.366255 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500139e-2bb4-4911-8a14-245f40f2d988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:21.406654 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7500139e-2bb4-4911-8a14-245f40f2d988 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:21.408738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7500139e-2bb4-4911-8a14-245f40f2d988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:21.431177 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 850/1685] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:21.436362 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bf423-7135-4199-8127-63d606364f43 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:21.457661 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bf423-7135-4199-8127-63d606364f43 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:21.471196 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7138a-00a0-44dc-994d-fc4675eb71ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:21.471837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7138a-00a0-44dc-994d-fc4675eb71ba admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:21.472123 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7138a-00a0-44dc-994d-fc4675eb71ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:21.472400 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7138a-00a0-44dc-994d-fc4675eb71ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:21.473203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7138a-00a0-44dc-994d-fc4675eb71ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:21.473482 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7138a-00a0-44dc-994d-fc4675eb71ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:21.475326 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7138a-00a0-44dc-994d-fc4675eb71ba admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:21.515310 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 836/1686] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:56:21.516479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500139e-2bb4-4911-8a14-245f40f2d988 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:21.530382 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500139e-2bb4-4911-8a14-245f40f2d988 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:21.542921 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d820b0f-cf20-4b7c-a364-fc564e3a762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:21.543555 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d820b0f-cf20-4b7c-a364-fc564e3a762c admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:21.543838 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d820b0f-cf20-4b7c-a364-fc564e3a762c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:21.544115 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d820b0f-cf20-4b7c-a364-fc564e3a762c admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:21.544773 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d820b0f-cf20-4b7c-a364-fc564e3a762c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:21.546768 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d820b0f-cf20-4b7c-a364-fc564e3a762c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:21.588770 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 851/1687] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:21 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:21.593037 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7138a-00a0-44dc-994d-fc4675eb71ba admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:21.610430 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7138a-00a0-44dc-994d-fc4675eb71ba admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:21.711107 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644389d-6d27-4449-8e73-ada60567f69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:21.711788 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644389d-6d27-4449-8e73-ada60567f69d admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:21.712291 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644389d-6d27-4449-8e73-ada60567f69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:21.712639 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644389d-6d27-4449-8e73-ada60567f69d admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:21.713410 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644389d-6d27-4449-8e73-ada60567f69d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:21.715970 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644389d-6d27-4449-8e73-ada60567f69d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:21.761289 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 837/1688] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:21 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:21.765755 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d820b0f-cf20-4b7c-a364-fc564e3a762c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:21.780753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d820b0f-cf20-4b7c-a364-fc564e3a762c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:21.790365 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cb115-d9c9-49b9-8e97-840855e7b880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:21.791002 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cb115-d9c9-49b9-8e97-840855e7b880 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:21.791318 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cb115-d9c9-49b9-8e97-840855e7b880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:21.791652 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cb115-d9c9-49b9-8e97-840855e7b880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:21.792366 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cb115-d9c9-49b9-8e97-840855e7b880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:21.794227 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cb115-d9c9-49b9-8e97-840855e7b880 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:21.816470 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 852/1689] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:21.820838 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644389d-6d27-4449-8e73-ada60567f69d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:21.847048 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644389d-6d27-4449-8e73-ada60567f69d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:21.862731 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b6e05-8310-41ca-ad3f-9f7b95b400d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:21.863655 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b6e05-8310-41ca-ad3f-9f7b95b400d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:21.863764 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b6e05-8310-41ca-ad3f-9f7b95b400d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:21.864185 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b6e05-8310-41ca-ad3f-9f7b95b400d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:21.864804 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b6e05-8310-41ca-ad3f-9f7b95b400d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:21.866463 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b6e05-8310-41ca-ad3f-9f7b95b400d6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:21.899552 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 838/1690] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:21.900282 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cb115-d9c9-49b9-8e97-840855e7b880 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:21.915700 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cb115-d9c9-49b9-8e97-840855e7b880 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:21.924904 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1c41d-aea7-48d0-b4dd-7f4b4f94911b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:21.927876 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1c41d-aea7-48d0-b4dd-7f4b4f94911b admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:21.928672 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1c41d-aea7-48d0-b4dd-7f4b4f94911b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:21.929189 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1c41d-aea7-48d0-b4dd-7f4b4f94911b admin admin] PATH_INFO: `/v3/projects/e8cde1b3095e428f9ecf45d111ef2566/users/461f08913b1e439c9c2bc3d7011e9d8f/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:21.956523 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1c41d-aea7-48d0-b4dd-7f4b4f94911b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8cde1b3095e428f9ecf45d111ef2566, user_id=461f08913b1e439c9c2bc3d7011e9d8f, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:21.960291 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1c41d-aea7-48d0-b4dd-7f4b4f94911b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:21.990017 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 853/1691] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:21 2022] PUT /identity/v3/projects/e8cde1b3095e428f9ecf45d111ef2566/users/461f08913b1e439c9c2bc3d7011e9d8f/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:56:22.013859 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad5fa2-57e4-438b-9f3e-fba5a0cb74bb None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:22.014759 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad5fa2-57e4-438b-9f3e-fba5a0cb74bb None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:22.017280 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad5fa2-57e4-438b-9f3e-fba5a0cb74bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:22.186121 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-31ad5fa2-57e4-438b-9f3e-fba5a0cb74bb None None] MFA Rules not processed for user `461f08913b1e439c9c2bc3d7011e9d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:22.190287 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-31ad5fa2-57e4-438b-9f3e-fba5a0cb74bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:22.216745 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:22.307805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1c41d-aea7-48d0-b4dd-7f4b4f94911b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:22.309853 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2fb1c41d-aea7-48d0-b4dd-7f4b4f94911b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:22.428595 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 839/1692] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:22.429576 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad5fa2-57e4-438b-9f3e-fba5a0cb74bb None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:22.436469 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-31ad5fa2-57e4-438b-9f3e-fba5a0cb74bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:22.487019 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1c41d-aea7-48d0-b4dd-7f4b4f94911b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:22.493292 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589eac6-80cb-4576-b352-fd277f4fb275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:22.494407 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589eac6-80cb-4576-b352-fd277f4fb275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:22.494922 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589eac6-80cb-4576-b352-fd277f4fb275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:22.495380 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589eac6-80cb-4576-b352-fd277f4fb275 admin admin] PATH_INFO: `/v3/projects/d16e03f37ccd4b5a8d476b8236487fc2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:22.497184 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589eac6-80cb-4576-b352-fd277f4fb275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d16e03f37ccd4b5a8d476b8236487fc2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:22.499848 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589eac6-80cb-4576-b352-fd277f4fb275 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:22.599509 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d589eac6-80cb-4576-b352-fd277f4fb275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd16e03f37ccd4b5a8d476b8236487fc2', 'request_id': 'req-d589eac6-80cb-4576-b352-fd277f4fb275'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:22.610556 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d589eac6-80cb-4576-b352-fd277f4fb275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd16e03f37ccd4b5a8d476b8236487fc2', 'request_id': 'req-d589eac6-80cb-4576-b352-fd277f4fb275'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:22.626710 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d589eac6-80cb-4576-b352-fd277f4fb275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd16e03f37ccd4b5a8d476b8236487fc2', 'request_id': 'req-d589eac6-80cb-4576-b352-fd277f4fb275'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:22.658412 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d589eac6-80cb-4576-b352-fd277f4fb275 admin admin] The token cache is being invalidate because project d16e03f37ccd4b5a8d476b8236487fc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:56:22.658763 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d589eac6-80cb-4576-b352-fd277f4fb275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:22.661657 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d589eac6-80cb-4576-b352-fd277f4fb275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:22.662679 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad5fa2-57e4-438b-9f3e-fba5a0cb74bb None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:22.667462 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 854/1693] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:22 2022] DELETE /identity/v3/projects/d16e03f37ccd4b5a8d476b8236487fc2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:56:22.667462 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589eac6-80cb-4576-b352-fd277f4fb275 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:22.669760 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d589eac6-80cb-4576-b352-fd277f4fb275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:22.705711 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:22.839181 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22438c-9e10-45f8-8e29-cff0074dfab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:22.840301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22438c-9e10-45f8-8e29-cff0074dfab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:22.840795 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22438c-9e10-45f8-8e29-cff0074dfab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:22.841334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22438c-9e10-45f8-8e29-cff0074dfab9 admin admin] PATH_INFO: `/v3/projects/3ce900546ca04ef7b1483093e4c1e1f3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:22.843084 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22438c-9e10-45f8-8e29-cff0074dfab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce900546ca04ef7b1483093e4c1e1f3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:22.845286 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22438c-9e10-45f8-8e29-cff0074dfab9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:22.850746 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589eac6-80cb-4576-b352-fd277f4fb275 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:22.867411 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d735bca-d2e5-4b42-ac45-3f9869dba016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:22.868172 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d735bca-d2e5-4b42-ac45-3f9869dba016 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:22.868615 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d735bca-d2e5-4b42-ac45-3f9869dba016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:22.868901 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d735bca-d2e5-4b42-ac45-3f9869dba016 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:22.869587 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d735bca-d2e5-4b42-ac45-3f9869dba016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:22.875845 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d735bca-d2e5-4b42-ac45-3f9869dba016 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:22.950537 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 855/1694] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:22 2022] POST /identity/v3/projects => generated 377 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:22.951706 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d735bca-d2e5-4b42-ac45-3f9869dba016 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:22.953894 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-af22438c-9e10-45f8-8e29-cff0074dfab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce900546ca04ef7b1483093e4c1e1f3', 'request_id': 'req-af22438c-9e10-45f8-8e29-cff0074dfab9'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:22.955146 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8d735bca-d2e5-4b42-ac45-3f9869dba016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:22.968222 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-af22438c-9e10-45f8-8e29-cff0074dfab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce900546ca04ef7b1483093e4c1e1f3', 'request_id': 'req-af22438c-9e10-45f8-8e29-cff0074dfab9'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:22.977366 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:22.986484 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-af22438c-9e10-45f8-8e29-cff0074dfab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce900546ca04ef7b1483093e4c1e1f3', 'request_id': 'req-af22438c-9e10-45f8-8e29-cff0074dfab9'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:23.031259 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-af22438c-9e10-45f8-8e29-cff0074dfab9 admin admin] The token cache is being invalidate because project 3ce900546ca04ef7b1483093e4c1e1f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:56:23.033743 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-af22438c-9e10-45f8-8e29-cff0074dfab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:23.041901 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-af22438c-9e10-45f8-8e29-cff0074dfab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:23.045521 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 840/1695] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:22 2022] DELETE /identity/v3/projects/3ce900546ca04ef7b1483093e4c1e1f3 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:23.047204 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22438c-9e10-45f8-8e29-cff0074dfab9 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:23.050294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-af22438c-9e10-45f8-8e29-cff0074dfab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:23.140286 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d735bca-d2e5-4b42-ac45-3f9869dba016 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:23.158685 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69981aa-569b-4aa7-a5a6-f0df459efd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:23.162115 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69981aa-569b-4aa7-a5a6-f0df459efd2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:23.162714 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69981aa-569b-4aa7-a5a6-f0df459efd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:23.163972 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69981aa-569b-4aa7-a5a6-f0df459efd2b admin admin] PATH_INFO: `/v3/users/3c145183e18341eda116588ee9b9cc37` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:23.168334 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69981aa-569b-4aa7-a5a6-f0df459efd2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c145183e18341eda116588ee9b9cc37)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:23.175130 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69981aa-569b-4aa7-a5a6-f0df459efd2b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:23.254561 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22438c-9e10-45f8-8e29-cff0074dfab9 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:23.263631 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1389b-66eb-480d-a485-67731debf536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:23.264417 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1389b-66eb-480d-a485-67731debf536 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:23.264772 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1389b-66eb-480d-a485-67731debf536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:23.265190 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1389b-66eb-480d-a485-67731debf536 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:23.266244 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1389b-66eb-480d-a485-67731debf536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:23.273132 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1389b-66eb-480d-a485-67731debf536 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:23.307467 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e69981aa-569b-4aa7-a5a6-f0df459efd2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c145183e18341eda116588ee9b9cc37'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:23.309012 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e69981aa-569b-4aa7-a5a6-f0df459efd2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c145183e18341eda116588ee9b9cc37'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:23.344397 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 841/1696] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:23 2022] POST /identity/v3/users => generated 295 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:23.345949 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b6abe-b768-4216-8e2f-7304348d34d3 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:23.346245 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b6abe-b768-4216-8e2f-7304348d34d3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:23.346528 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b6abe-b768-4216-8e2f-7304348d34d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:23.373164 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e69981aa-569b-4aa7-a5a6-f0df459efd2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c145183e18341eda116588ee9b9cc37'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:23.397751 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e69981aa-569b-4aa7-a5a6-f0df459efd2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c145183e18341eda116588ee9b9cc37'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:23.398404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e69981aa-569b-4aa7-a5a6-f0df459efd2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c145183e18341eda116588ee9b9cc37'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:23.433190 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-0b2b6abe-b768-4216-8e2f-7304348d34d3 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:23.445312 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0b2b6abe-b768-4216-8e2f-7304348d34d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:23.454856 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 856/1697] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:22 2022] DELETE /identity/v3/users/3c145183e18341eda116588ee9b9cc37 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:23.456434 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69981aa-569b-4aa7-a5a6-f0df459efd2b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:23.462931 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e69981aa-569b-4aa7-a5a6-f0df459efd2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:23.474364 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 842/1698] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:23.476144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7131cc-bff9-4ec5-9f6c-ee382845aa50 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:23.476440 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7131cc-bff9-4ec5-9f6c-ee382845aa50 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:23.476721 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7131cc-bff9-4ec5-9f6c-ee382845aa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:23.512418 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:23.523690 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-7a7131cc-bff9-4ec5-9f6c-ee382845aa50 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:23.530414 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7a7131cc-bff9-4ec5-9f6c-ee382845aa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:23.637152 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69981aa-569b-4aa7-a5a6-f0df459efd2b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:23.649329 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7bbd3-faa5-44bb-b08c-f74a7e5ec64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:23.651611 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7bbd3-faa5-44bb-b08c-f74a7e5ec64c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:23.651914 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7bbd3-faa5-44bb-b08c-f74a7e5ec64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:23.652191 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7bbd3-faa5-44bb-b08c-f74a7e5ec64c admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:23.652875 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7bbd3-faa5-44bb-b08c-f74a7e5ec64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:23.654551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7bbd3-faa5-44bb-b08c-f74a7e5ec64c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:23.685827 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 843/1699] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:23.698130 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7131cc-bff9-4ec5-9f6c-ee382845aa50 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:23.717818 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7131cc-bff9-4ec5-9f6c-ee382845aa50 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:23.734352 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 857/1700] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:23.737369 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7bbd3-faa5-44bb-b08c-f74a7e5ec64c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:23.737510 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba953f8-25f4-4f3c-8d78-310bd2b8595b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:23.737510 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba953f8-25f4-4f3c-8d78-310bd2b8595b admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:23.737510 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba953f8-25f4-4f3c-8d78-310bd2b8595b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:23.737510 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba953f8-25f4-4f3c-8d78-310bd2b8595b admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:23.737840 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba953f8-25f4-4f3c-8d78-310bd2b8595b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:23.737979 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba953f8-25f4-4f3c-8d78-310bd2b8595b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:23.740983 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba953f8-25f4-4f3c-8d78-310bd2b8595b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:23.763929 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7bbd3-faa5-44bb-b08c-f74a7e5ec64c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:23.779499 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 844/1701] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:56:23.779792 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef7be5-83a6-4735-8e3a-cbe57e71503e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:23.780190 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef7be5-83a6-4735-8e3a-cbe57e71503e admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:23.780546 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef7be5-83a6-4735-8e3a-cbe57e71503e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:23.780736 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef7be5-83a6-4735-8e3a-cbe57e71503e admin admin] PATH_INFO: `/v3/projects/bf73fb99315e454e9d00e0c2c9dc5a30/users/1f8fa15b46ab460985c78ad0afbe0f8e/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:23.783803 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba953f8-25f4-4f3c-8d78-310bd2b8595b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:23.808706 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba953f8-25f4-4f3c-8d78-310bd2b8595b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:23.818425 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef7be5-83a6-4735-8e3a-cbe57e71503e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf73fb99315e454e9d00e0c2c9dc5a30, user_id=1f8fa15b46ab460985c78ad0afbe0f8e, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:23.820312 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b3b30-749e-4e3c-8495-a54a5a0727af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:23.825071 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b3b30-749e-4e3c-8495-a54a5a0727af admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:23.825351 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef7be5-83a6-4735-8e3a-cbe57e71503e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:23.828129 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b3b30-749e-4e3c-8495-a54a5a0727af admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:23.830078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b3b30-749e-4e3c-8495-a54a5a0727af admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:23.836544 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b3b30-749e-4e3c-8495-a54a5a0727af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:23.845443 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b3b30-749e-4e3c-8495-a54a5a0727af admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:23.861338 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 858/1702] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:23 2022] PUT /identity/v3/projects/bf73fb99315e454e9d00e0c2c9dc5a30/users/1f8fa15b46ab460985c78ad0afbe0f8e/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:23.866883 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef7be5-83a6-4735-8e3a-cbe57e71503e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:23.920233 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 845/1703] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:23 2022] POST /identity/v3/projects => generated 357 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:23.922794 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b3b30-749e-4e3c-8495-a54a5a0727af admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:24.045187 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:24.079571 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef7be5-83a6-4735-8e3a-cbe57e71503e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:24.102940 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b3b30-749e-4e3c-8495-a54a5a0727af admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:24.117070 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dad9a7-91d9-4262-bc12-0bd46c77b470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:24.117903 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dad9a7-91d9-4262-bc12-0bd46c77b470 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:24.118173 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dad9a7-91d9-4262-bc12-0bd46c77b470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:24.118499 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dad9a7-91d9-4262-bc12-0bd46c77b470 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:24.119491 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dad9a7-91d9-4262-bc12-0bd46c77b470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:24.122754 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dad9a7-91d9-4262-bc12-0bd46c77b470 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:24.194786 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 846/1704] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:23 2022] POST /identity/v3/users => generated 279 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:24.196457 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555a94a-28c5-4dd4-a71d-a8e1e6d447e1 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:24.197681 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555a94a-28c5-4dd4-a71d-a8e1e6d447e1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:24.201402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555a94a-28c5-4dd4-a71d-a8e1e6d447e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:24.275165 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815396c8-b77a-46ba-a4c9-3bcb565bf823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:24.278589 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815396c8-b77a-46ba-a4c9-3bcb565bf823 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:24.279032 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815396c8-b77a-46ba-a4c9-3bcb565bf823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:24.279381 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815396c8-b77a-46ba-a4c9-3bcb565bf823 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:24.280444 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815396c8-b77a-46ba-a4c9-3bcb565bf823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:24.283822 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815396c8-b77a-46ba-a4c9-3bcb565bf823 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:24.289877 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-f555a94a-28c5-4dd4-a71d-a8e1e6d447e1 None None] MFA Rules not processed for user `4a82acab3a5b4808b62a72adf3c61d48`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:24.291420 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f555a94a-28c5-4dd4-a71d-a8e1e6d447e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:24.328144 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 859/1705] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:24.328144 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815396c8-b77a-46ba-a4c9-3bcb565bf823 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:24.364490 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815396c8-b77a-46ba-a4c9-3bcb565bf823 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:24.388892 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c33f4-d297-46b3-81af-4bc766b7f6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:24.391359 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c33f4-d297-46b3-81af-4bc766b7f6ce admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:24.391829 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c33f4-d297-46b3-81af-4bc766b7f6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:24.392308 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c33f4-d297-46b3-81af-4bc766b7f6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:24.398053 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c33f4-d297-46b3-81af-4bc766b7f6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:24.403480 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c33f4-d297-46b3-81af-4bc766b7f6ce admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:24.434197 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 860/1706] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:24.443458 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c33f4-d297-46b3-81af-4bc766b7f6ce admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:24.465428 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c33f4-d297-46b3-81af-4bc766b7f6ce admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:24.479378 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44d5de-d2f7-4bb1-8490-8e3bce906393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:24.481162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44d5de-d2f7-4bb1-8490-8e3bce906393 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:24.482360 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44d5de-d2f7-4bb1-8490-8e3bce906393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:24.482666 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44d5de-d2f7-4bb1-8490-8e3bce906393 admin admin] PATH_INFO: `/v3/projects/bf73fb99315e454e9d00e0c2c9dc5a30/users/1f8fa15b46ab460985c78ad0afbe0f8e/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:24.491453 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44d5de-d2f7-4bb1-8490-8e3bce906393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf73fb99315e454e9d00e0c2c9dc5a30, user_id=1f8fa15b46ab460985c78ad0afbe0f8e, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:24.494615 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44d5de-d2f7-4bb1-8490-8e3bce906393 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:24.506776 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 847/1707] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:24.512744 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555a94a-28c5-4dd4-a71d-a8e1e6d447e1 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:24.536548 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 861/1708] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:24 2022] PUT /identity/v3/projects/bf73fb99315e454e9d00e0c2c9dc5a30/users/1f8fa15b46ab460985c78ad0afbe0f8e/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:24.538649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74b7a8-af7c-4fc3-a8be-165124c9aff9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:24.538938 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74b7a8-af7c-4fc3-a8be-165124c9aff9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:24.539213 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74b7a8-af7c-4fc3-a8be-165124c9aff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:24.541481 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555a94a-28c5-4dd4-a71d-a8e1e6d447e1 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:24.567900 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:24.585015 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9d74b7a8-af7c-4fc3-a8be-165124c9aff9 None None] MFA Rules not processed for user `4a82acab3a5b4808b62a72adf3c61d48`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:24.586833 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9d74b7a8-af7c-4fc3-a8be-165124c9aff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:24.672643 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b905fe-af3c-4d41-90f1-ecf164fce0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:24.673338 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b905fe-af3c-4d41-90f1-ecf164fce0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:24.673616 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b905fe-af3c-4d41-90f1-ecf164fce0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:24.673891 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b905fe-af3c-4d41-90f1-ecf164fce0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:24.674554 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b905fe-af3c-4d41-90f1-ecf164fce0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:24.676803 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b905fe-af3c-4d41-90f1-ecf164fce0c6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:24.704723 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 848/1709] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:24.706159 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8266c6-4aa9-4a9c-998e-f35b1508a24b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:24.706277 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8266c6-4aa9-4a9c-998e-f35b1508a24b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:24.706509 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8266c6-4aa9-4a9c-998e-f35b1508a24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:24.778689 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3d8266c6-4aa9-4a9c-998e-f35b1508a24b None None] MFA Rules not processed for user `1f8fa15b46ab460985c78ad0afbe0f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:24.779961 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3d8266c6-4aa9-4a9c-998e-f35b1508a24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:24.808265 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 862/1710] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:24.839601 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74b7a8-af7c-4fc3-a8be-165124c9aff9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:24.866283 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:24.880761 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74b7a8-af7c-4fc3-a8be-165124c9aff9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:24.893062 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55e07f-9a86-4308-805b-ff543f5c751f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:24.893757 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55e07f-9a86-4308-805b-ff543f5c751f admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:24.894043 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55e07f-9a86-4308-805b-ff543f5c751f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:24.894319 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55e07f-9a86-4308-805b-ff543f5c751f admin admin] PATH_INFO: `/v3/projects/b85afdda40a046c6a04d3e4d47de1915/users/63ec654e2e884caf8d881e0448087bb5/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:24.933748 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 849/1711] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:24.933748 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8266c6-4aa9-4a9c-998e-f35b1508a24b None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:24.933748 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3d8266c6-4aa9-4a9c-998e-f35b1508a24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:24.944301 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55e07f-9a86-4308-805b-ff543f5c751f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85afdda40a046c6a04d3e4d47de1915, user_id=63ec654e2e884caf8d881e0448087bb5, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:24.950763 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55e07f-9a86-4308-805b-ff543f5c751f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:24.985383 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 863/1712] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:24 2022] PUT /identity/v3/projects/b85afdda40a046c6a04d3e4d47de1915/users/63ec654e2e884caf8d881e0448087bb5/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:24.986776 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5f985-768a-41ad-b37d-ea3df444e430 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:24.990029 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5f985-768a-41ad-b37d-ea3df444e430 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:24.991345 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5f985-768a-41ad-b37d-ea3df444e430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:25.082989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0de5f985-768a-41ad-b37d-ea3df444e430 None None] MFA Rules not processed for user `956d6c86088547ac8da4c69752bc2e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:25.087986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0de5f985-768a-41ad-b37d-ea3df444e430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:25.096649 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8266c6-4aa9-4a9c-998e-f35b1508a24b None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:25.270763 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9be845-7e83-414c-a25b-ee3aec6373e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:25.271503 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9be845-7e83-414c-a25b-ee3aec6373e3 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:25.271790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9be845-7e83-414c-a25b-ee3aec6373e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:25.272069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9be845-7e83-414c-a25b-ee3aec6373e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:25.330301 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 864/1713] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:24 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:25.330301 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5f985-768a-41ad-b37d-ea3df444e430 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:25.331250 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0de5f985-768a-41ad-b37d-ea3df444e430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:25.462584 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9be845-7e83-414c-a25b-ee3aec6373e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:25.464221 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9be845-7e83-414c-a25b-ee3aec6373e3 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:25.493185 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5f985-768a-41ad-b37d-ea3df444e430 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:25.497057 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 850/1714] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:25.498705 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e23d5c-a506-4a29-b258-3d4e7bb0f086 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:25.499092 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e23d5c-a506-4a29-b258-3d4e7bb0f086 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:25.499395 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e23d5c-a506-4a29-b258-3d4e7bb0f086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:25.516028 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b7eca-56e0-4155-9974-5254f57acb33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:25.516725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b7eca-56e0-4155-9974-5254f57acb33 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:25.517072 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b7eca-56e0-4155-9974-5254f57acb33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:25.517334 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b7eca-56e0-4155-9974-5254f57acb33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:25.529813 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-430b7eca-56e0-4155-9974-5254f57acb33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:25.556289 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:25.562787 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-95e23d5c-a506-4a29-b258-3d4e7bb0f086 None None] MFA Rules not processed for user `63ec654e2e884caf8d881e0448087bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:25.564310 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-95e23d5c-a506-4a29-b258-3d4e7bb0f086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:25.652967 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 851/1715] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:25.656554 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e23d5c-a506-4a29-b258-3d4e7bb0f086 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:25.656554 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-95e23d5c-a506-4a29-b258-3d4e7bb0f086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:25.671163 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:25.767549 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b7eca-56e0-4155-9974-5254f57acb33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:25.770444 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b7eca-56e0-4155-9974-5254f57acb33 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:25.812031 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 865/1716] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:25.813015 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b7eca-56e0-4155-9974-5254f57acb33 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:25.813217 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e23d5c-a506-4a29-b258-3d4e7bb0f086 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:25.818145 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-430b7eca-56e0-4155-9974-5254f57acb33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:25.819717 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352c511-f413-402b-97d5-96f0616502a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:25.820499 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352c511-f413-402b-97d5-96f0616502a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:25.820884 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352c511-f413-402b-97d5-96f0616502a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:25.821646 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352c511-f413-402b-97d5-96f0616502a5 admin admin] PATH_INFO: `/v3/projects/e9c7a6a09e674d299ec88cb77689ca37` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:25.823410 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352c511-f413-402b-97d5-96f0616502a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9c7a6a09e674d299ec88cb77689ca37)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:25.825609 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352c511-f413-402b-97d5-96f0616502a5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:25.865246 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b7eca-56e0-4155-9974-5254f57acb33 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:25.875956 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f6902-6fa0-4a51-aa91-ef7481906a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:25.880116 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f6902-6fa0-4a51-aa91-ef7481906a49 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:25.880782 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f6902-6fa0-4a51-aa91-ef7481906a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:25.881408 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f6902-6fa0-4a51-aa91-ef7481906a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:25.883216 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f6902-6fa0-4a51-aa91-ef7481906a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:25.889397 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f6902-6fa0-4a51-aa91-ef7481906a49 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:25.958838 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 866/1717] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:25 2022] POST /identity/v3/projects => generated 405 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:25.958838 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f6902-6fa0-4a51-aa91-ef7481906a49 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:25.966965 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7352c511-f413-402b-97d5-96f0616502a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9c7a6a09e674d299ec88cb77689ca37', 'request_id': 'req-7352c511-f413-402b-97d5-96f0616502a5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:25.986454 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7352c511-f413-402b-97d5-96f0616502a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9c7a6a09e674d299ec88cb77689ca37', 'request_id': 'req-7352c511-f413-402b-97d5-96f0616502a5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:26.002886 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7352c511-f413-402b-97d5-96f0616502a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9c7a6a09e674d299ec88cb77689ca37', 'request_id': 'req-7352c511-f413-402b-97d5-96f0616502a5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:26.032559 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7352c511-f413-402b-97d5-96f0616502a5 admin admin] The token cache is being invalidate because project e9c7a6a09e674d299ec88cb77689ca37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:56:26.032862 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7352c511-f413-402b-97d5-96f0616502a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:26.034764 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7352c511-f413-402b-97d5-96f0616502a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:26.042856 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 852/1718] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:25 2022] DELETE /identity/v3/projects/e9c7a6a09e674d299ec88cb77689ca37 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:26.042856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d095fe0-808a-4c9b-a3d6-36484f7b7688 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:26.042856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d095fe0-808a-4c9b-a3d6-36484f7b7688 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:26.043266 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d095fe0-808a-4c9b-a3d6-36484f7b7688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:26.118117 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4d095fe0-808a-4c9b-a3d6-36484f7b7688 None None] MFA Rules not processed for user `c21c29da391b4d78a063dbe50057b6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:26.120326 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4d095fe0-808a-4c9b-a3d6-36484f7b7688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:26.143687 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f6902-6fa0-4a51-aa91-ef7481906a49 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:26.156851 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8503cc6-7aa9-4732-8930-bdb6d7e8b2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:26.157640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8503cc6-7aa9-4732-8930-bdb6d7e8b2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:26.157922 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8503cc6-7aa9-4732-8930-bdb6d7e8b2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:26.158193 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8503cc6-7aa9-4732-8930-bdb6d7e8b2a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:26.158897 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8503cc6-7aa9-4732-8930-bdb6d7e8b2a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:26.160890 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8503cc6-7aa9-4732-8930-bdb6d7e8b2a4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:26.166232 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:26.226655 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 867/1719] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:25 2022] POST /identity/v3/projects => generated 355 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:26.230981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8503cc6-7aa9-4732-8930-bdb6d7e8b2a4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:26.236714 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c8503cc6-7aa9-4732-8930-bdb6d7e8b2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:26.295883 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 853/1720] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:26.306882 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed4e91-81e4-4484-b06a-d4f13323a855 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:26.308275 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed4e91-81e4-4484-b06a-d4f13323a855 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:26.308646 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed4e91-81e4-4484-b06a-d4f13323a855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:26.352275 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-03ed4e91-81e4-4484-b06a-d4f13323a855 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:26.356823 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-03ed4e91-81e4-4484-b06a-d4f13323a855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:26.393904 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8503cc6-7aa9-4732-8930-bdb6d7e8b2a4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:26.413153 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83016aef-5550-4a81-89f4-b340ecb410a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:26.414337 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83016aef-5550-4a81-89f4-b340ecb410a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:26.414337 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83016aef-5550-4a81-89f4-b340ecb410a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:26.414642 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83016aef-5550-4a81-89f4-b340ecb410a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:26.415293 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83016aef-5550-4a81-89f4-b340ecb410a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:26.418931 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83016aef-5550-4a81-89f4-b340ecb410a0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:26.464326 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 868/1721] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:26 2022] POST /identity/v3/users => generated 309 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:26.464796 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83016aef-5550-4a81-89f4-b340ecb410a0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:26.473952 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-83016aef-5550-4a81-89f4-b340ecb410a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:26.505716 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83016aef-5550-4a81-89f4-b340ecb410a0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:26.515865 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7fce2-3e95-4cea-894d-c1a8a0a34dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:26.516498 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7fce2-3e95-4cea-894d-c1a8a0a34dcb admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:26.516774 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7fce2-3e95-4cea-894d-c1a8a0a34dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:26.517137 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7fce2-3e95-4cea-894d-c1a8a0a34dcb admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:26.517327 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 854/1722] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:26.518004 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7fce2-3e95-4cea-894d-c1a8a0a34dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:26.518211 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed4e91-81e4-4484-b06a-d4f13323a855 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:26.520271 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-03ed4e91-81e4-4484-b06a-d4f13323a855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:26.521104 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7fce2-3e95-4cea-894d-c1a8a0a34dcb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:26.577461 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 869/1723] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:26 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:26.578510 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7fce2-3e95-4cea-894d-c1a8a0a34dcb admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:26.614346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7fce2-3e95-4cea-894d-c1a8a0a34dcb admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:26.632127 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a57195-4bb0-4797-bed4-a484d528bb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:26.632985 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a57195-4bb0-4797-bed4-a484d528bb66 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:26.633432 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a57195-4bb0-4797-bed4-a484d528bb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:26.633807 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a57195-4bb0-4797-bed4-a484d528bb66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:26.634719 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a57195-4bb0-4797-bed4-a484d528bb66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:26.636402 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a57195-4bb0-4797-bed4-a484d528bb66 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:26.638337 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:26.665533 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 870/1724] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:26.667163 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eadf8a-2d77-4a50-a95c-71e3bd70b626 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:26.669744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eadf8a-2d77-4a50-a95c-71e3bd70b626 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:26.670137 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eadf8a-2d77-4a50-a95c-71e3bd70b626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:26.736612 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-04eadf8a-2d77-4a50-a95c-71e3bd70b626 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:26.738712 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-04eadf8a-2d77-4a50-a95c-71e3bd70b626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:26.760235 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 871/1725] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:26.764314 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eadf8a-2d77-4a50-a95c-71e3bd70b626 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:26.784700 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eadf8a-2d77-4a50-a95c-71e3bd70b626 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:26.798829 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acc1bd-1b27-419f-af87-8b8b7376781e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:26.799532 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc1bd-1b27-419f-af87-8b8b7376781e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:26.799888 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc1bd-1b27-419f-af87-8b8b7376781e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:26.800235 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc1bd-1b27-419f-af87-8b8b7376781e admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:26.801524 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acc1bd-1b27-419f-af87-8b8b7376781e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:26.803653 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acc1bd-1b27-419f-af87-8b8b7376781e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:26.813845 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed4e91-81e4-4484-b06a-d4f13323a855 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:26.838162 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 872/1726] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:26.838162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acc1bd-1b27-419f-af87-8b8b7376781e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:26.840723 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a0c92-645e-49f5-8f62-52f27eb5e121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:26.841665 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a0c92-645e-49f5-8f62-52f27eb5e121 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:26.842022 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a0c92-645e-49f5-8f62-52f27eb5e121 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:26.842440 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a0c92-645e-49f5-8f62-52f27eb5e121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:26.858455 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acc1bd-1b27-419f-af87-8b8b7376781e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:26.871341 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138724c2-a31d-4cc2-b675-eb1542e2ec0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:26.872139 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138724c2-a31d-4cc2-b675-eb1542e2ec0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:26.872525 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138724c2-a31d-4cc2-b675-eb1542e2ec0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:26.872924 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138724c2-a31d-4cc2-b675-eb1542e2ec0c admin admin] PATH_INFO: `/v3/projects/ba6b5bd2124d40a6a0246c1fa1cc3d2f/users/90a9bb2492ce4c169ae54124adc9b3a6/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:26.906432 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138724c2-a31d-4cc2-b675-eb1542e2ec0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6b5bd2124d40a6a0246c1fa1cc3d2f, user_id=90a9bb2492ce4c169ae54124adc9b3a6, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:26.909677 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138724c2-a31d-4cc2-b675-eb1542e2ec0c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:26.949308 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 873/1727] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:26 2022] PUT /identity/v3/projects/ba6b5bd2124d40a6a0246c1fa1cc3d2f/users/90a9bb2492ce4c169ae54124adc9b3a6/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:26.949308 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138724c2-a31d-4cc2-b675-eb1542e2ec0c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:26.998139 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a0c92-645e-49f5-8f62-52f27eb5e121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:27.000078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a0c92-645e-49f5-8f62-52f27eb5e121 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:27.010742 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:27.039237 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 855/1728] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:27.040312 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a0c92-645e-49f5-8f62-52f27eb5e121 service nova] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:27.069793 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a0c92-645e-49f5-8f62-52f27eb5e121 service nova] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:27.106679 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138724c2-a31d-4cc2-b675-eb1542e2ec0c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:27.120854 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff4f9f-4110-415b-a122-76f98b9e5e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:27.122222 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff4f9f-4110-415b-a122-76f98b9e5e0d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:27.123064 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff4f9f-4110-415b-a122-76f98b9e5e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:27.124084 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff4f9f-4110-415b-a122-76f98b9e5e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:27.127256 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff4f9f-4110-415b-a122-76f98b9e5e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:27.128155 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff4f9f-4110-415b-a122-76f98b9e5e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:27.132408 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff4f9f-4110-415b-a122-76f98b9e5e0d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:27.149442 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 874/1729] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:56:27.149442 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be2c7c-5a7e-4b20-8fcb-f09c1f422f3f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:27.149442 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be2c7c-5a7e-4b20-8fcb-f09c1f422f3f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:27.149442 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be2c7c-5a7e-4b20-8fcb-f09c1f422f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:27.241979 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f2be2c7c-5a7e-4b20-8fcb-f09c1f422f3f None None] MFA Rules not processed for user `1f392d3cac0149b09d4f83e83a930298`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:27.243512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f2be2c7c-5a7e-4b20-8fcb-f09c1f422f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:27.330206 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c3a54-9ad1-42c2-a300-0fb4fd9e6e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:27.330933 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c3a54-9ad1-42c2-a300-0fb4fd9e6e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:27.331219 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c3a54-9ad1-42c2-a300-0fb4fd9e6e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:27.335643 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c3a54-9ad1-42c2-a300-0fb4fd9e6e07 admin admin] PATH_INFO: `/v3/projects/9f3e2bc8eb0642e2b0be1b3e10473b36/users/edc85b92fd444d31a87f79e4dc8c2066/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:27.382541 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c3a54-9ad1-42c2-a300-0fb4fd9e6e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3e2bc8eb0642e2b0be1b3e10473b36, user_id=edc85b92fd444d31a87f79e4dc8c2066, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:27.387916 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c3a54-9ad1-42c2-a300-0fb4fd9e6e07 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:27.427275 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 856/1730] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:27 2022] PUT /identity/v3/projects/9f3e2bc8eb0642e2b0be1b3e10473b36/users/edc85b92fd444d31a87f79e4dc8c2066/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:27.427729 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c3a54-9ad1-42c2-a300-0fb4fd9e6e07 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:27.456742 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 875/1731] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:27.469537 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cac6ca-c069-47a9-9337-51a5ce209114 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:27.477618 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cac6ca-c069-47a9-9337-51a5ce209114 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:27.478214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cac6ca-c069-47a9-9337-51a5ce209114 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:27.483865 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 876/1732] 10.222.0.26 () {54 vars in 912 bytes} [Sun Oct 2 00:56:27 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:56:27.487101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cac6ca-c069-47a9-9337-51a5ce209114 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:27.592236 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c3a54-9ad1-42c2-a300-0fb4fd9e6e07 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:27.611718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fd9ba-4035-426f-9836-da8ad967941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:27.615583 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fd9ba-4035-426f-9836-da8ad967941f admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:27.616860 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fd9ba-4035-426f-9836-da8ad967941f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:27.617438 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fd9ba-4035-426f-9836-da8ad967941f admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:27.619898 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fd9ba-4035-426f-9836-da8ad967941f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:27.628715 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fd9ba-4035-426f-9836-da8ad967941f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:27.649184 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 857/1733] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:27.650902 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fd9ba-4035-426f-9836-da8ad967941f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:27.669400 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:27.681630 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fd9ba-4035-426f-9836-da8ad967941f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:27.703120 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32833f76-2db3-405c-9821-d55eb554efd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:27.703120 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32833f76-2db3-405c-9821-d55eb554efd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:27.703120 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32833f76-2db3-405c-9821-d55eb554efd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:27.703120 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32833f76-2db3-405c-9821-d55eb554efd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:27.710829 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32833f76-2db3-405c-9821-d55eb554efd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:27.713239 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32833f76-2db3-405c-9821-d55eb554efd8 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:27.768768 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 858/1734] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:27.768768 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32833f76-2db3-405c-9821-d55eb554efd8 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:27.782375 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cac6ca-c069-47a9-9337-51a5ce209114 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:27.792438 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc248f34-fb3f-4abc-bf31-53ee4929ba14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:27.793575 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc248f34-fb3f-4abc-bf31-53ee4929ba14 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:27.794249 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc248f34-fb3f-4abc-bf31-53ee4929ba14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:27.794679 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc248f34-fb3f-4abc-bf31-53ee4929ba14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:27.796468 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc248f34-fb3f-4abc-bf31-53ee4929ba14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:27.801384 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc248f34-fb3f-4abc-bf31-53ee4929ba14 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:27.897740 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 877/1735] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:27 2022] POST /identity/v3/projects => generated 365 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:27.903292 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4dc36-47ed-4d62-b5ae-57af3caaaf93 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:27.903636 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4dc36-47ed-4d62-b5ae-57af3caaaf93 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:27.904023 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4dc36-47ed-4d62-b5ae-57af3caaaf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:27.959873 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32833f76-2db3-405c-9821-d55eb554efd8 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:27.968266 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:27.997104 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e7c4dc36-47ed-4d62-b5ae-57af3caaaf93 None None] MFA Rules not processed for user `5100db0c968c406fa89e117877604c50`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:28.003584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e7c4dc36-47ed-4d62-b5ae-57af3caaaf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:28.144897 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b592cd-2b0a-4d6b-8fd4-347bdf1932c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:28.145648 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b592cd-2b0a-4d6b-8fd4-347bdf1932c5 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:28.145932 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b592cd-2b0a-4d6b-8fd4-347bdf1932c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:28.146203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b592cd-2b0a-4d6b-8fd4-347bdf1932c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:28.156558 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 878/1736] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Oct 2 00:56:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:28.158381 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4dc36-47ed-4d62-b5ae-57af3caaaf93 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:28.311032 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b592cd-2b0a-4d6b-8fd4-347bdf1932c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:28.315264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b592cd-2b0a-4d6b-8fd4-347bdf1932c5 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:28.351631 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 859/1737] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:28.356428 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c2a26-6ea8-4ade-b045-22fee58a72c3 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:28.357351 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c2a26-6ea8-4ade-b045-22fee58a72c3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:28.357636 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c2a26-6ea8-4ade-b045-22fee58a72c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:28.368280 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4dc36-47ed-4d62-b5ae-57af3caaaf93 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:28.389563 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ee8cd-2583-482b-ada4-34d527d1eade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:28.390634 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ee8cd-2583-482b-ada4-34d527d1eade admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:28.391145 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ee8cd-2583-482b-ada4-34d527d1eade admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:28.391624 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ee8cd-2583-482b-ada4-34d527d1eade admin admin] PATH_INFO: `/v3/projects/ba6b5bd2124d40a6a0246c1fa1cc3d2f/users/90a9bb2492ce4c169ae54124adc9b3a6/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:28.399705 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ee8cd-2583-482b-ada4-34d527d1eade admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6b5bd2124d40a6a0246c1fa1cc3d2f, user_id=90a9bb2492ce4c169ae54124adc9b3a6, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:28.403669 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ee8cd-2583-482b-ada4-34d527d1eade admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:28.435446 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 879/1738] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:28 2022] PUT /identity/v3/projects/ba6b5bd2124d40a6a0246c1fa1cc3d2f/users/90a9bb2492ce4c169ae54124adc9b3a6/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:28.440913 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ee8cd-2583-482b-ada4-34d527d1eade admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:28.469120 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-862c2a26-6ea8-4ade-b045-22fee58a72c3 None None] MFA Rules not processed for user `5ff136440ace420997181fbf11999496`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:28.475200 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-862c2a26-6ea8-4ade-b045-22fee58a72c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:28.548801 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:28.569948 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ee8cd-2583-482b-ada4-34d527d1eade admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:28.589955 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c016a-0279-4174-9145-41ddf7d7e68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:28.591539 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c016a-0279-4174-9145-41ddf7d7e68b admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:28.593773 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c016a-0279-4174-9145-41ddf7d7e68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:28.594151 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c016a-0279-4174-9145-41ddf7d7e68b admin admin] PATH_INFO: `/v3/projects/9f3e2bc8eb0642e2b0be1b3e10473b36/users/edc85b92fd444d31a87f79e4dc8c2066/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:28.606811 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c016a-0279-4174-9145-41ddf7d7e68b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3e2bc8eb0642e2b0be1b3e10473b36, user_id=edc85b92fd444d31a87f79e4dc8c2066, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:28.632157 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c016a-0279-4174-9145-41ddf7d7e68b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:28.666019 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 880/1739] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:28 2022] PUT /identity/v3/projects/9f3e2bc8eb0642e2b0be1b3e10473b36/users/edc85b92fd444d31a87f79e4dc8c2066/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:28.667033 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c016a-0279-4174-9145-41ddf7d7e68b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:28.712809 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 860/1740] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:28.714133 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c2a26-6ea8-4ade-b045-22fee58a72c3 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:28.723752 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-862c2a26-6ea8-4ade-b045-22fee58a72c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:28.801536 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c016a-0279-4174-9145-41ddf7d7e68b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:28.807039 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:28.817084 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e5f87-94ef-46a5-8685-3d15e5e3f8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:28.817788 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e5f87-94ef-46a5-8685-3d15e5e3f8ad admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:28.819289 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e5f87-94ef-46a5-8685-3d15e5e3f8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:28.819536 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e5f87-94ef-46a5-8685-3d15e5e3f8ad admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:28.820204 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e5f87-94ef-46a5-8685-3d15e5e3f8ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:28.826594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e5f87-94ef-46a5-8685-3d15e5e3f8ad admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:28.870882 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c2a26-6ea8-4ade-b045-22fee58a72c3 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:28.881490 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 881/1741] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:28 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:28.883154 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39666810-edd1-4d87-aeaf-dc087c328561 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:28.883550 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39666810-edd1-4d87-aeaf-dc087c328561 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:28.883855 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39666810-edd1-4d87-aeaf-dc087c328561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:28.961978 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-39666810-edd1-4d87-aeaf-dc087c328561 None None] MFA Rules not processed for user `edc85b92fd444d31a87f79e4dc8c2066`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:28.963251 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-39666810-edd1-4d87-aeaf-dc087c328561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:29.003386 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40557eec-8df3-4184-b59d-5f1056503792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:29.005584 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40557eec-8df3-4184-b59d-5f1056503792 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:29.006094 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40557eec-8df3-4184-b59d-5f1056503792 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:29.006912 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40557eec-8df3-4184-b59d-5f1056503792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:29.016902 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40557eec-8df3-4184-b59d-5f1056503792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:29.019045 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40557eec-8df3-4184-b59d-5f1056503792 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:29.034398 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 861/1742] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:29.036042 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74499e51-aef2-474f-9b1d-e3aff037ff80 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:29.036394 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74499e51-aef2-474f-9b1d-e3aff037ff80 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:29.036739 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74499e51-aef2-474f-9b1d-e3aff037ff80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:29.067125 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-74499e51-aef2-474f-9b1d-e3aff037ff80 None None] MFA Rules not processed for user `5ff136440ace420997181fbf11999496`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:29.069819 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-74499e51-aef2-474f-9b1d-e3aff037ff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:29.141447 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 882/1743] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:29.141447 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39666810-edd1-4d87-aeaf-dc087c328561 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:29.155350 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39666810-edd1-4d87-aeaf-dc087c328561 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:29.187327 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533aa77-8473-4f49-9e9d-df75e905a49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:29.190250 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533aa77-8473-4f49-9e9d-df75e905a49e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:29.193423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533aa77-8473-4f49-9e9d-df75e905a49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:29.194244 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533aa77-8473-4f49-9e9d-df75e905a49e admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:29.196568 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533aa77-8473-4f49-9e9d-df75e905a49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:29.201009 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533aa77-8473-4f49-9e9d-df75e905a49e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:29.219061 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 883/1744] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:29.221243 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533aa77-8473-4f49-9e9d-df75e905a49e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:29.223999 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a533aa77-8473-4f49-9e9d-df75e905a49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:29.248552 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 862/1745] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:29.252524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74499e51-aef2-474f-9b1d-e3aff037ff80 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:29.279394 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74499e51-aef2-474f-9b1d-e3aff037ff80 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:29.294295 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a606ede-41cc-4358-abd6-9f6e4009f19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:29.297645 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a606ede-41cc-4358-abd6-9f6e4009f19b admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:29.298389 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a606ede-41cc-4358-abd6-9f6e4009f19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:29.299118 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a606ede-41cc-4358-abd6-9f6e4009f19b admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:29.301259 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a606ede-41cc-4358-abd6-9f6e4009f19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:29.307453 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a606ede-41cc-4358-abd6-9f6e4009f19b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:29.324038 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533aa77-8473-4f49-9e9d-df75e905a49e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:29.334899 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 863/1746] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:29.334899 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a606ede-41cc-4358-abd6-9f6e4009f19b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:29.335185 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc580e3-a95f-4739-bcf9-77d7d93e713f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:29.335694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc580e3-a95f-4739-bcf9-77d7d93e713f service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:29.336212 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc580e3-a95f-4739-bcf9-77d7d93e713f service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:29.336587 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc580e3-a95f-4739-bcf9-77d7d93e713f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:29.351057 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:29.361014 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc580e3-a95f-4739-bcf9-77d7d93e713f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:29.366771 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc580e3-a95f-4739-bcf9-77d7d93e713f service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:29.395984 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 884/1747] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:29 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:29.413381 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc580e3-a95f-4739-bcf9-77d7d93e713f service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:29.471433 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a606ede-41cc-4358-abd6-9f6e4009f19b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:29.477995 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc580e3-a95f-4739-bcf9-77d7d93e713f service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:29.493221 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b789cb-84b8-4fba-94d3-fc4f906f8336 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:29.494019 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b789cb-84b8-4fba-94d3-fc4f906f8336 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:29.494475 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b789cb-84b8-4fba-94d3-fc4f906f8336 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:29.495145 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b789cb-84b8-4fba-94d3-fc4f906f8336 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:29.514656 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee8b13-5ad4-4b23-abf7-195bb3cd9c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:29.515342 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee8b13-5ad4-4b23-abf7-195bb3cd9c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:29.519815 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee8b13-5ad4-4b23-abf7-195bb3cd9c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:29.520219 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee8b13-5ad4-4b23-abf7-195bb3cd9c42 admin admin] PATH_INFO: `/v3/projects/c133f345f5aa4956a331ad44e77fc4d4/users/9d4212722c324b0692d62dd1987c5cfa/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:29.523775 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b789cb-84b8-4fba-94d3-fc4f906f8336 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:29.526876 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b789cb-84b8-4fba-94d3-fc4f906f8336 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:29.557664 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee8b13-5ad4-4b23-abf7-195bb3cd9c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c133f345f5aa4956a331ad44e77fc4d4, user_id=9d4212722c324b0692d62dd1987c5cfa, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:29.560351 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 864/1748] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:29.562321 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b789cb-84b8-4fba-94d3-fc4f906f8336 service nova] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:29.562455 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee8b13-5ad4-4b23-abf7-195bb3cd9c42 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:29.570931 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-59b789cb-84b8-4fba-94d3-fc4f906f8336 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:29.604980 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 885/1749] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:29 2022] PUT /identity/v3/projects/c133f345f5aa4956a331ad44e77fc4d4/users/9d4212722c324b0692d62dd1987c5cfa/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:29.604980 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee8b13-5ad4-4b23-abf7-195bb3cd9c42 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:29.606242 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b789cb-84b8-4fba-94d3-fc4f906f8336 service nova] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:29.616359 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:29.772082 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117516a-186f-4e4c-9813-73f1040fff7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:29.773513 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117516a-186f-4e4c-9813-73f1040fff7c service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:29.773959 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117516a-186f-4e4c-9813-73f1040fff7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:29.774743 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117516a-186f-4e4c-9813-73f1040fff7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:29.777740 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f117516a-186f-4e4c-9813-73f1040fff7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:29.850214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee8b13-5ad4-4b23-abf7-195bb3cd9c42 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:29.863900 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dc365-b562-4d26-a65a-255d9edb0dc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:29.865108 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dc365-b562-4d26-a65a-255d9edb0dc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:29.865108 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dc365-b562-4d26-a65a-255d9edb0dc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:29.865108 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dc365-b562-4d26-a65a-255d9edb0dc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:29.872392 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f17dc365-b562-4d26-a65a-255d9edb0dc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:29.943574 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117516a-186f-4e4c-9813-73f1040fff7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:29.947123 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117516a-186f-4e4c-9813-73f1040fff7c service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:29.998756 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 865/1750] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:30.008286 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfd368-2dec-4982-92a9-3276308cc30e None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:30.008557 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfd368-2dec-4982-92a9-3276308cc30e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:30.008864 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfd368-2dec-4982-92a9-3276308cc30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:30.099212 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17dc365-b562-4d26-a65a-255d9edb0dc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:30.114000 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17dc365-b562-4d26-a65a-255d9edb0dc4 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:30.147886 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-adbfd368-2dec-4982-92a9-3276308cc30e None None] MFA Rules not processed for user `9d4212722c324b0692d62dd1987c5cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:30.148836 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 886/1751] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:30.150650 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dc365-b562-4d26-a65a-255d9edb0dc4 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:30.155566 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f17dc365-b562-4d26-a65a-255d9edb0dc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:30.159360 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-adbfd368-2dec-4982-92a9-3276308cc30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:30.329562 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dc365-b562-4d26-a65a-255d9edb0dc4 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:30.348028 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c75f27-ec28-4656-bd9e-471765049411 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78481cceebd4138b893eba7e51c9c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:30.350240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c75f27-ec28-4656-bd9e-471765049411 service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:30.350818 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c75f27-ec28-4656-bd9e-471765049411 service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:30.351317 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c75f27-ec28-4656-bd9e-471765049411 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:30.354923 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b3c75f27-ec28-4656-bd9e-471765049411 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:30.376874 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c75f27-ec28-4656-bd9e-471765049411 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:30.380417 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c75f27-ec28-4656-bd9e-471765049411 service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:30.425117 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 887/1752] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:30.447220 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 866/1753] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:30.460802 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c75f27-ec28-4656-bd9e-471765049411 service placement] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:30.493978 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:30.607907 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d65f1-288e-4f20-b61c-174a39def26e None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:30.608256 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d65f1-288e-4f20-b61c-174a39def26e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:30.608441 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d65f1-288e-4f20-b61c-174a39def26e None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:30.610120 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 867/1754] 10.222.0.26 () {54 vars in 912 bytes} [Sun Oct 2 00:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:56:30.616744 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21f905-c436-472a-af22-43a1bd15dd29 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:30.617668 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21f905-c436-472a-af22-43a1bd15dd29 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:30.622611 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21f905-c436-472a-af22-43a1bd15dd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:30.714802 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-2a21f905-c436-472a-af22-43a1bd15dd29 None None] MFA Rules not processed for user `5100db0c968c406fa89e117877604c50`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:30.717139 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2a21f905-c436-472a-af22-43a1bd15dd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:30.729402 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c75f27-ec28-4656-bd9e-471765049411 service placement] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:30.776729 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ae302-307b-406c-8b25-3b6c5cf696b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:30.779539 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ae302-307b-406c-8b25-3b6c5cf696b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:30.780092 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ae302-307b-406c-8b25-3b6c5cf696b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:30.780819 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ae302-307b-406c-8b25-3b6c5cf696b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:30.785577 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ae302-307b-406c-8b25-3b6c5cf696b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:30.790218 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ae302-307b-406c-8b25-3b6c5cf696b0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:30.993663 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 888/1755] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:30 2022] POST /identity/v3/projects => generated 365 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:30.995904 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1b194-d147-4642-89ff-38039fcbb646 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:30.996329 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1b194-d147-4642-89ff-38039fcbb646 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:31.001025 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1b194-d147-4642-89ff-38039fcbb646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:31.047995 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:31.079164 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 868/1756] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Oct 2 00:56:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:31.085065 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21f905-c436-472a-af22-43a1bd15dd29 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:31.111426 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21f905-c436-472a-af22-43a1bd15dd29 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:31.179822 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-92f1b194-d147-4642-89ff-38039fcbb646 None None] MFA Rules not processed for user `90a9bb2492ce4c169ae54124adc9b3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:31.186088 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-92f1b194-d147-4642-89ff-38039fcbb646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:31.295628 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08091fc7-1b55-4c2b-9332-7fde929228c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:31.297802 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08091fc7-1b55-4c2b-9332-7fde929228c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:31.297963 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08091fc7-1b55-4c2b-9332-7fde929228c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:31.299524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08091fc7-1b55-4c2b-9332-7fde929228c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:31.301147 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08091fc7-1b55-4c2b-9332-7fde929228c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:31.305700 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08091fc7-1b55-4c2b-9332-7fde929228c5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:31.379470 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 869/1757] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:31 2022] POST /identity/v3/users => generated 289 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:31.379683 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08091fc7-1b55-4c2b-9332-7fde929228c5 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:31.430168 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 889/1758] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:30 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:31.431736 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1b194-d147-4642-89ff-38039fcbb646 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:31.454721 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1b194-d147-4642-89ff-38039fcbb646 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:31.462891 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa53a2-0d13-4b90-ae6e-8e2521580040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:31.464185 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa53a2-0d13-4b90-ae6e-8e2521580040 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:31.464686 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa53a2-0d13-4b90-ae6e-8e2521580040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:31.465224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa53a2-0d13-4b90-ae6e-8e2521580040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:31.467312 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa53a2-0d13-4b90-ae6e-8e2521580040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:31.470336 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa53a2-0d13-4b90-ae6e-8e2521580040 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:31.483853 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 890/1759] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:31.489761 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa53a2-0d13-4b90-ae6e-8e2521580040 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:31.519086 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa53a2-0d13-4b90-ae6e-8e2521580040 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:31.542920 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39038955-324e-4903-8c88-ea7585b8e112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:31.543914 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39038955-324e-4903-8c88-ea7585b8e112 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:31.546414 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08091fc7-1b55-4c2b-9332-7fde929228c5 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:31.546716 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39038955-324e-4903-8c88-ea7585b8e112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:31.547449 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39038955-324e-4903-8c88-ea7585b8e112 admin admin] PATH_INFO: `/v3/projects/d7794d477fda461fb174e42a75a56d93/users/2a1f9ccaf6c94873929b30bec291ff6f/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:31.552387 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3bcb6-b6aa-4492-9afa-cc5ca945821d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:31.553157 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3bcb6-b6aa-4492-9afa-cc5ca945821d service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:31.553441 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3bcb6-b6aa-4492-9afa-cc5ca945821d service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:31.553849 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3bcb6-b6aa-4492-9afa-cc5ca945821d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:31.574495 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3bcb6-b6aa-4492-9afa-cc5ca945821d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:31.576754 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3bcb6-b6aa-4492-9afa-cc5ca945821d service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:31.592542 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39038955-324e-4903-8c88-ea7585b8e112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7794d477fda461fb174e42a75a56d93, user_id=2a1f9ccaf6c94873929b30bec291ff6f, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:31.598640 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 870/1760] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:31.601070 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39038955-324e-4903-8c88-ea7585b8e112 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:31.642521 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 891/1761] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:31 2022] PUT /identity/v3/projects/d7794d477fda461fb174e42a75a56d93/users/2a1f9ccaf6c94873929b30bec291ff6f/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:56:31.647441 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3bcb6-b6aa-4492-9afa-cc5ca945821d service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:31.667021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3bcb6-b6aa-4492-9afa-cc5ca945821d service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:31.907503 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf060c-eff9-43a0-9e65-676792ce9240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:31.912271 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf060c-eff9-43a0-9e65-676792ce9240 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:31.913120 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf060c-eff9-43a0-9e65-676792ce9240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:31.913410 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf060c-eff9-43a0-9e65-676792ce9240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:31.917347 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf060c-eff9-43a0-9e65-676792ce9240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:31.923171 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf060c-eff9-43a0-9e65-676792ce9240 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:31.988338 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 871/1762] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:31.990614 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39038955-324e-4903-8c88-ea7585b8e112 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:32.010520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39038955-324e-4903-8c88-ea7585b8e112 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:32.032337 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ab816-622a-4c1d-be6d-e134b080f47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:32.033031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ab816-622a-4c1d-be6d-e134b080f47e admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:32.033444 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ab816-622a-4c1d-be6d-e134b080f47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:32.033550 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ab816-622a-4c1d-be6d-e134b080f47e admin admin] PATH_INFO: `/v3/projects/d7794d477fda461fb174e42a75a56d93/users/2a1f9ccaf6c94873929b30bec291ff6f/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:32.037706 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ab816-622a-4c1d-be6d-e134b080f47e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7794d477fda461fb174e42a75a56d93, user_id=2a1f9ccaf6c94873929b30bec291ff6f, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:32.054698 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ab816-622a-4c1d-be6d-e134b080f47e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:32.096335 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 892/1763] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:31 2022] PUT /identity/v3/projects/d7794d477fda461fb174e42a75a56d93/users/2a1f9ccaf6c94873929b30bec291ff6f/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:32.099295 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8debee-2d6a-42b5-a789-08b9c0b1439c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:32.099780 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8debee-2d6a-42b5-a789-08b9c0b1439c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:32.099864 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8debee-2d6a-42b5-a789-08b9c0b1439c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:32.167672 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ed8debee-2d6a-42b5-a789-08b9c0b1439c None None] MFA Rules not processed for user `2a1f9ccaf6c94873929b30bec291ff6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:32.171337 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ed8debee-2d6a-42b5-a789-08b9c0b1439c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:32.218056 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:32.323981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970b364-d7ec-4d4b-9ccd-9841386eb7ed None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:32.324461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970b364-d7ec-4d4b-9ccd-9841386eb7ed None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:32.324668 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970b364-d7ec-4d4b-9ccd-9841386eb7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:32.396493 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e970b364-d7ec-4d4b-9ccd-9841386eb7ed None None] MFA Rules not processed for user `c21c29da391b4d78a063dbe50057b6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:32.398201 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e970b364-d7ec-4d4b-9ccd-9841386eb7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:32.422272 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 872/1764] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:32.432293 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8debee-2d6a-42b5-a789-08b9c0b1439c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:32.485383 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:32.599744 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 893/1765] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:32.641236 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8debee-2d6a-42b5-a789-08b9c0b1439c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:32.658156 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3445dd-0960-4297-963a-ab08f359f991 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:32.658803 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3445dd-0960-4297-963a-ab08f359f991 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:32.659080 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3445dd-0960-4297-963a-ab08f359f991 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:32.659351 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3445dd-0960-4297-963a-ab08f359f991 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:32.690942 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3445dd-0960-4297-963a-ab08f359f991 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:32.692558 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3445dd-0960-4297-963a-ab08f359f991 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:32.720256 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 873/1766] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:32.917821 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970b364-d7ec-4d4b-9ccd-9841386eb7ed None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:32.935873 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970b364-d7ec-4d4b-9ccd-9841386eb7ed None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:32.947175 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4fb72-158b-460d-a274-439d6c1c8278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:32.947612 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4fb72-158b-460d-a274-439d6c1c8278 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:32.947891 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4fb72-158b-460d-a274-439d6c1c8278 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:32.948270 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4fb72-158b-460d-a274-439d6c1c8278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:33.192779 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4fb72-158b-460d-a274-439d6c1c8278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:33.195913 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4fb72-158b-460d-a274-439d6c1c8278 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:33.246159 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 894/1767] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:34.040926 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff5ec6-ba3d-44a8-a33d-583ba94a4f5e None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:34.041475 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff5ec6-ba3d-44a8-a33d-583ba94a4f5e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:34.041475 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff5ec6-ba3d-44a8-a33d-583ba94a4f5e None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:34.043218 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 874/1768] 10.222.0.26 () {54 vars in 921 bytes} [Sun Oct 2 00:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:56:34.138985 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637ef2f-1ff4-4b17-9848-80d0501e0533 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:34.139624 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637ef2f-1ff4-4b17-9848-80d0501e0533 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:34.139624 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637ef2f-1ff4-4b17-9848-80d0501e0533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:34.241367 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3637ef2f-1ff4-4b17-9848-80d0501e0533 None None] MFA Rules not processed for user `a78481cceebd4138b893eba7e51c9c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:34.250044 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3637ef2f-1ff4-4b17-9848-80d0501e0533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:34.486214 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 895/1769] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Oct 2 00:56:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:34.631718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13a56d-70dd-44ad-b1ed-d1d247962d37 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:34.632018 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13a56d-70dd-44ad-b1ed-d1d247962d37 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:34.632301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13a56d-70dd-44ad-b1ed-d1d247962d37 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:34.634421 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 875/1770] 10.222.0.26 () {54 vars in 961 bytes} [Sun Oct 2 00:56:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:56:34.642004 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821a857-f87e-4f45-887c-01f59815cfb2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:34.642576 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821a857-f87e-4f45-887c-01f59815cfb2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:34.642855 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821a857-f87e-4f45-887c-01f59815cfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:34.696621 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2821a857-f87e-4f45-887c-01f59815cfb2 None None] MFA Rules not processed for user `a78481cceebd4138b893eba7e51c9c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:34.699461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2821a857-f87e-4f45-887c-01f59815cfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:34.773119 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 896/1771] 10.222.0.26 () {58 vars in 1058 bytes} [Sun Oct 2 00:56:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:56:34.782299 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13a56d-70dd-44ad-b1ed-d1d247962d37 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:34.828684 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13a56d-70dd-44ad-b1ed-d1d247962d37 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:34.873469 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e0f75-24fd-438e-98b7-7481ba43827e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78481cceebd4138b893eba7e51c9c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:34.890987 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e0f75-24fd-438e-98b7-7481ba43827e service placement] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:34.891624 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e0f75-24fd-438e-98b7-7481ba43827e service placement] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:34.891971 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e0f75-24fd-438e-98b7-7481ba43827e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:34.895922 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d5798-be7d-4343-9b08-707d982c6f61 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:34.896028 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d5798-be7d-4343-9b08-707d982c6f61 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:34.896270 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d5798-be7d-4343-9b08-707d982c6f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:34.976881 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e0f75-24fd-438e-98b7-7481ba43827e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:34.980206 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e0f75-24fd-438e-98b7-7481ba43827e service placement] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:35.027453 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 876/1772] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:35.162303 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3d9d5798-be7d-4343-9b08-707d982c6f61 None None] MFA Rules not processed for user `42dcae7ba3c241eb8d7d0894aadb467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:35.164169 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3d9d5798-be7d-4343-9b08-707d982c6f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:35.291713 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:35.367948 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 897/1773] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Oct 2 00:56:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:56:35.448289 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab30ddb-2954-4f54-9d46-d8270ced1cb9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:35.448289 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab30ddb-2954-4f54-9d46-d8270ced1cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:35.448289 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab30ddb-2954-4f54-9d46-d8270ced1cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:35.495983 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5ab30ddb-2954-4f54-9d46-d8270ced1cb9 None None] MFA Rules not processed for user `5ff136440ace420997181fbf11999496`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:35.505727 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5ab30ddb-2954-4f54-9d46-d8270ced1cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:35.755778 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d5798-be7d-4343-9b08-707d982c6f61 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:35.759731 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3d9d5798-be7d-4343-9b08-707d982c6f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:35.844467 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 877/1774] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:36.233572 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d5798-be7d-4343-9b08-707d982c6f61 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:36.245689 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24194478-57a0-4200-8857-6dbdb4d3f3e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784579d2ddf4cc99fe0e1d109e5cdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:36.247163 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24194478-57a0-4200-8857-6dbdb4d3f3e0 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:36.249439 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24194478-57a0-4200-8857-6dbdb4d3f3e0 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:36.249973 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24194478-57a0-4200-8857-6dbdb4d3f3e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:36.299177 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24194478-57a0-4200-8857-6dbdb4d3f3e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:36.305086 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24194478-57a0-4200-8857-6dbdb4d3f3e0 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:36.353887 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 898/1775] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Oct 2 00:56:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 00:56:36.980977 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab30ddb-2954-4f54-9d46-d8270ced1cb9 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:37.280839 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:37.364873 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab30ddb-2954-4f54-9d46-d8270ced1cb9 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:37.394281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fce7d-701f-4a46-bf61-0c33b8042ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:37.396419 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fce7d-701f-4a46-bf61-0c33b8042ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:37.398154 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fce7d-701f-4a46-bf61-0c33b8042ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:37.399324 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fce7d-701f-4a46-bf61-0c33b8042ee3 admin admin] PATH_INFO: `/v3/users/9d4212722c324b0692d62dd1987c5cfa` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:37.402688 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40fce7d-701f-4a46-bf61-0c33b8042ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4212722c324b0692d62dd1987c5cfa)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:37.419479 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40fce7d-701f-4a46-bf61-0c33b8042ee3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:37.604790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b40fce7d-701f-4a46-bf61-0c33b8042ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4212722c324b0692d62dd1987c5cfa'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:37.606577 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b40fce7d-701f-4a46-bf61-0c33b8042ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4212722c324b0692d62dd1987c5cfa'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:37.636161 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b40fce7d-701f-4a46-bf61-0c33b8042ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4212722c324b0692d62dd1987c5cfa'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:37.640219 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b40fce7d-701f-4a46-bf61-0c33b8042ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4212722c324b0692d62dd1987c5cfa'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:37.675245 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b40fce7d-701f-4a46-bf61-0c33b8042ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4212722c324b0692d62dd1987c5cfa'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:37.732387 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 878/1776] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:36 2022] DELETE /identity/v3/users/9d4212722c324b0692d62dd1987c5cfa => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:37.741715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d387500-48f2-4324-8085-4d5afd9b7c14 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:37.742288 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d387500-48f2-4324-8085-4d5afd9b7c14 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:37.742634 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d387500-48f2-4324-8085-4d5afd9b7c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:37.890193 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4d387500-48f2-4324-8085-4d5afd9b7c14 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:37.897413 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4d387500-48f2-4324-8085-4d5afd9b7c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:38.207173 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 899/1777] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:38.222468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fce7d-701f-4a46-bf61-0c33b8042ee3 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:38.224078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b40fce7d-701f-4a46-bf61-0c33b8042ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:38.344986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1510a2a-16c5-4423-a9f7-a23e35b680bc None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:38.346507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1510a2a-16c5-4423-a9f7-a23e35b680bc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:38.347560 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1510a2a-16c5-4423-a9f7-a23e35b680bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:38.421744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c1510a2a-16c5-4423-a9f7-a23e35b680bc None None] MFA Rules not processed for user `5100db0c968c406fa89e117877604c50`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:38.423520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c1510a2a-16c5-4423-a9f7-a23e35b680bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:38.536597 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:38.544868 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fce7d-701f-4a46-bf61-0c33b8042ee3 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:38.554384 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 900/1778] 10.222.0.36 () {58 vars in 1015 bytes} [Sun Oct 2 00:56:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:38.560544 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadf4d4-2a9c-4331-b84e-aadc1212de76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:38.561205 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadf4d4-2a9c-4331-b84e-aadc1212de76 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:38.561513 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadf4d4-2a9c-4331-b84e-aadc1212de76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:38.561763 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadf4d4-2a9c-4331-b84e-aadc1212de76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:38.575821 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadf4d4-2a9c-4331-b84e-aadc1212de76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:38.577404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1510a2a-16c5-4423-a9f7-a23e35b680bc None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:38.577826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadf4d4-2a9c-4331-b84e-aadc1212de76 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:38.590707 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1510a2a-16c5-4423-a9f7-a23e35b680bc None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:38.591185 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 879/1779] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:38.604380 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e017619-2612-48d7-ab7f-240c033b8410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:38.605596 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e017619-2612-48d7-ab7f-240c033b8410 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:38.607299 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e017619-2612-48d7-ab7f-240c033b8410 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:38.607663 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e017619-2612-48d7-ab7f-240c033b8410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:38.630883 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e017619-2612-48d7-ab7f-240c033b8410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:38.632529 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e017619-2612-48d7-ab7f-240c033b8410 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:38.657249 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 901/1780] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:56:40.262398 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeee49a-41f6-4b8f-8ace-9c91862343fd None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:40.262958 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeee49a-41f6-4b8f-8ace-9c91862343fd None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:40.263039 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeee49a-41f6-4b8f-8ace-9c91862343fd None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:40.273392 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 880/1781] 10.222.0.26 () {54 vars in 921 bytes} [Sun Oct 2 00:56:40 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:56:40.315770 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5456f-6ebf-4b35-bce4-c1fd1e358ca0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:40.317398 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5456f-6ebf-4b35-bce4-c1fd1e358ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:40.317841 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5456f-6ebf-4b35-bce4-c1fd1e358ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:40.379659 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bff5456f-6ebf-4b35-bce4-c1fd1e358ca0 None None] MFA Rules not processed for user `a78481cceebd4138b893eba7e51c9c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:40.387396 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bff5456f-6ebf-4b35-bce4-c1fd1e358ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:40.583306 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 902/1782] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Oct 2 00:56:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:40.595542 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeee49a-41f6-4b8f-8ace-9c91862343fd None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:40.599209 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0eeee49a-41f6-4b8f-8ace-9c91862343fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:40.625089 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5456f-6ebf-4b35-bce4-c1fd1e358ca0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:40.627143 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bff5456f-6ebf-4b35-bce4-c1fd1e358ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:40.669308 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5456f-6ebf-4b35-bce4-c1fd1e358ca0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:40.685008 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeee49a-41f6-4b8f-8ace-9c91862343fd None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:40.708242 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e493cf-2678-460f-8561-f3927198d6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:40.709549 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e493cf-2678-460f-8561-f3927198d6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:40.709843 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e493cf-2678-460f-8561-f3927198d6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:40.711537 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ff457-ecb6-4456-9008-e49fe5b86e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:40.711853 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e493cf-2678-460f-8561-f3927198d6b8 admin admin] PATH_INFO: `/v3/projects/c133f345f5aa4956a331ad44e77fc4d4` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:40.713598 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ff457-ecb6-4456-9008-e49fe5b86e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:40.714803 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ff457-ecb6-4456-9008-e49fe5b86e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:40.715537 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e493cf-2678-460f-8561-f3927198d6b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c133f345f5aa4956a331ad44e77fc4d4)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:40.716428 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ff457-ecb6-4456-9008-e49fe5b86e61 admin admin] PATH_INFO: `/v3/users/956d6c86088547ac8da4c69752bc2e01` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:40.720666 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ff457-ecb6-4456-9008-e49fe5b86e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=956d6c86088547ac8da4c69752bc2e01)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:40.723575 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e493cf-2678-460f-8561-f3927198d6b8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:40.731960 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ff457-ecb6-4456-9008-e49fe5b86e61 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:40.930928 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3c3ff457-ecb6-4456-9008-e49fe5b86e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956d6c86088547ac8da4c69752bc2e01'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:40.934726 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3c3ff457-ecb6-4456-9008-e49fe5b86e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956d6c86088547ac8da4c69752bc2e01'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:40.942329 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e7e493cf-2678-460f-8561-f3927198d6b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c133f345f5aa4956a331ad44e77fc4d4', 'request_id': 'req-e7e493cf-2678-460f-8561-f3927198d6b8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:40.951990 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3c3ff457-ecb6-4456-9008-e49fe5b86e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956d6c86088547ac8da4c69752bc2e01'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:40.953102 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3c3ff457-ecb6-4456-9008-e49fe5b86e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956d6c86088547ac8da4c69752bc2e01'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:40.979383 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e7e493cf-2678-460f-8561-f3927198d6b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c133f345f5aa4956a331ad44e77fc4d4', 'request_id': 'req-e7e493cf-2678-460f-8561-f3927198d6b8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:40.997443 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3c3ff457-ecb6-4456-9008-e49fe5b86e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956d6c86088547ac8da4c69752bc2e01'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:41.004834 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:41.008541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e7e493cf-2678-460f-8561-f3927198d6b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c133f345f5aa4956a331ad44e77fc4d4', 'request_id': 'req-e7e493cf-2678-460f-8561-f3927198d6b8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:41.068670 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e7e493cf-2678-460f-8561-f3927198d6b8 admin admin] The token cache is being invalidate because project c133f345f5aa4956a331ad44e77fc4d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:56:41.069173 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e7e493cf-2678-460f-8561-f3927198d6b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:41.075465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e7e493cf-2678-460f-8561-f3927198d6b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:41.087029 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 903/1783] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:40 2022] DELETE /identity/v3/projects/c133f345f5aa4956a331ad44e77fc4d4 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:41.090381 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e493cf-2678-460f-8561-f3927198d6b8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:41.094670 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e7e493cf-2678-460f-8561-f3927198d6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:41.100424 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 881/1784] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:40 2022] DELETE /identity/v3/users/956d6c86088547ac8da4c69752bc2e01 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:41.101181 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ff457-ecb6-4456-9008-e49fe5b86e61 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:41.124702 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3c3ff457-ecb6-4456-9008-e49fe5b86e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:41.353943 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ff457-ecb6-4456-9008-e49fe5b86e61 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:41.365177 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf70747-219d-467c-b6f3-a79092f620bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:41.365948 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf70747-219d-467c-b6f3-a79092f620bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:41.366404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf70747-219d-467c-b6f3-a79092f620bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:41.366837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf70747-219d-467c-b6f3-a79092f620bd admin admin] PATH_INFO: `/v3/users/2a1f9ccaf6c94873929b30bec291ff6f` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:41.370524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf70747-219d-467c-b6f3-a79092f620bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1f9ccaf6c94873929b30bec291ff6f)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:41.377807 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf70747-219d-467c-b6f3-a79092f620bd admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:41.513474 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-abf70747-219d-467c-b6f3-a79092f620bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1f9ccaf6c94873929b30bec291ff6f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:41.514500 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-abf70747-219d-467c-b6f3-a79092f620bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1f9ccaf6c94873929b30bec291ff6f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:41.529806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-abf70747-219d-467c-b6f3-a79092f620bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1f9ccaf6c94873929b30bec291ff6f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:41.530662 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-abf70747-219d-467c-b6f3-a79092f620bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1f9ccaf6c94873929b30bec291ff6f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:41.547288 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-abf70747-219d-467c-b6f3-a79092f620bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1f9ccaf6c94873929b30bec291ff6f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:41.552268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e493cf-2678-460f-8561-f3927198d6b8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:41.576384 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:41.597600 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 882/1785] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:41 2022] DELETE /identity/v3/users/2a1f9ccaf6c94873929b30bec291ff6f => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:41.599180 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294204b-4145-4b63-822c-ac4e487e24bd None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:41.599466 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294204b-4145-4b63-822c-ac4e487e24bd None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:41.599743 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294204b-4145-4b63-822c-ac4e487e24bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:41.673507 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-0294204b-4145-4b63-822c-ac4e487e24bd None None] MFA Rules not processed for user `1f392d3cac0149b09d4f83e83a930298`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:41.674806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0294204b-4145-4b63-822c-ac4e487e24bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:41.779315 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34477f-0222-4e8f-8b0a-2c0963d2f3cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78481cceebd4138b893eba7e51c9c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:41.785272 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34477f-0222-4e8f-8b0a-2c0963d2f3cc service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:41.787995 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34477f-0222-4e8f-8b0a-2c0963d2f3cc service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:41.788431 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34477f-0222-4e8f-8b0a-2c0963d2f3cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:41.800592 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ed34477f-0222-4e8f-8b0a-2c0963d2f3cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:41.825674 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34477f-0222-4e8f-8b0a-2c0963d2f3cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:41.827365 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34477f-0222-4e8f-8b0a-2c0963d2f3cc service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:41.849712 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 883/1786] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:41.865606 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 904/1787] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 778 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:42.503426 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb322f72-c3c6-4fdc-ae6b-c84a8a7e29df None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:42.504789 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb322f72-c3c6-4fdc-ae6b-c84a8a7e29df None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:42.506565 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb322f72-c3c6-4fdc-ae6b-c84a8a7e29df None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:42.511595 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 884/1788] 10.222.0.26 () {54 vars in 921 bytes} [Sun Oct 2 00:56:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:56:42.524750 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e2d3e-91cd-47de-8abe-429c23b0ffe4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:42.525686 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e2d3e-91cd-47de-8abe-429c23b0ffe4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:42.526246 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e2d3e-91cd-47de-8abe-429c23b0ffe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:42.589937 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e16e2d3e-91cd-47de-8abe-429c23b0ffe4 None None] MFA Rules not processed for user `81e0396b7ba341ce8d02b1a149786d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:42.594257 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e16e2d3e-91cd-47de-8abe-429c23b0ffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:42.953444 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 905/1789] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Oct 2 00:56:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:43.200453 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb322f72-c3c6-4fdc-ae6b-c84a8a7e29df None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:43.202844 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fb322f72-c3c6-4fdc-ae6b-c84a8a7e29df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:43.216599 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:43.499848 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb322f72-c3c6-4fdc-ae6b-c84a8a7e29df None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:43.514966 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17de693-19a1-46da-b564-93a3d0f20ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:43.515683 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17de693-19a1-46da-b564-93a3d0f20ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:43.515886 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17de693-19a1-46da-b564-93a3d0f20ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:43.516156 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17de693-19a1-46da-b564-93a3d0f20ce2 admin admin] PATH_INFO: `/v3/projects/1074800bdac847f38d86290865603baf` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:43.525484 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17de693-19a1-46da-b564-93a3d0f20ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1074800bdac847f38d86290865603baf)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:43.527477 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17de693-19a1-46da-b564-93a3d0f20ce2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:43.769316 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a17de693-19a1-46da-b564-93a3d0f20ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1074800bdac847f38d86290865603baf', 'request_id': 'req-a17de693-19a1-46da-b564-93a3d0f20ce2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:43.800879 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a17de693-19a1-46da-b564-93a3d0f20ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1074800bdac847f38d86290865603baf', 'request_id': 'req-a17de693-19a1-46da-b564-93a3d0f20ce2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:43.836758 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a17de693-19a1-46da-b564-93a3d0f20ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1074800bdac847f38d86290865603baf', 'request_id': 'req-a17de693-19a1-46da-b564-93a3d0f20ce2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:43.856780 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a17de693-19a1-46da-b564-93a3d0f20ce2 admin admin] The token cache is being invalidate because project 1074800bdac847f38d86290865603baf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:56:43.857147 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a17de693-19a1-46da-b564-93a3d0f20ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:43.858147 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a17de693-19a1-46da-b564-93a3d0f20ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:43.865042 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 885/1790] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:43 2022] DELETE /identity/v3/projects/1074800bdac847f38d86290865603baf => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:43.866015 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e2d3e-91cd-47de-8abe-429c23b0ffe4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:43.912891 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e2d3e-91cd-47de-8abe-429c23b0ffe4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:44.311212 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deaa9e-de2e-41d1-aaf1-7589b937d81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:44.314507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deaa9e-de2e-41d1-aaf1-7589b937d81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:44.314852 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deaa9e-de2e-41d1-aaf1-7589b937d81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:44.318396 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deaa9e-de2e-41d1-aaf1-7589b937d81d admin admin] PATH_INFO: `/v3/users/90a9bb2492ce4c169ae54124adc9b3a6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:44.324639 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26deaa9e-de2e-41d1-aaf1-7589b937d81d admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a9bb2492ce4c169ae54124adc9b3a6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:44.333872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26deaa9e-de2e-41d1-aaf1-7589b937d81d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:44.483502 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:44.563470 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-26deaa9e-de2e-41d1-aaf1-7589b937d81d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a9bb2492ce4c169ae54124adc9b3a6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:44.565854 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-26deaa9e-de2e-41d1-aaf1-7589b937d81d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a9bb2492ce4c169ae54124adc9b3a6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:44.617336 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-26deaa9e-de2e-41d1-aaf1-7589b937d81d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a9bb2492ce4c169ae54124adc9b3a6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:44.636835 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-26deaa9e-de2e-41d1-aaf1-7589b937d81d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a9bb2492ce4c169ae54124adc9b3a6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:44.638776 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-26deaa9e-de2e-41d1-aaf1-7589b937d81d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a9bb2492ce4c169ae54124adc9b3a6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:44.692845 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 906/1791] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:43 2022] DELETE /identity/v3/users/90a9bb2492ce4c169ae54124adc9b3a6 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:45.680889 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17de693-19a1-46da-b564-93a3d0f20ce2 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:45.685664 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a17de693-19a1-46da-b564-93a3d0f20ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:45.719266 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17de693-19a1-46da-b564-93a3d0f20ce2 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:45.932001 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230125b-7c7c-48e4-87a5-9fb88f41bfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:45.949980 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230125b-7c7c-48e4-87a5-9fb88f41bfcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:45.951213 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230125b-7c7c-48e4-87a5-9fb88f41bfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:45.951741 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230125b-7c7c-48e4-87a5-9fb88f41bfcd admin admin] PATH_INFO: `/v3/projects/ba6b5bd2124d40a6a0246c1fa1cc3d2f` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:45.954307 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230125b-7c7c-48e4-87a5-9fb88f41bfcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba6b5bd2124d40a6a0246c1fa1cc3d2f)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:45.958256 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230125b-7c7c-48e4-87a5-9fb88f41bfcd admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:46.041096 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deaa9e-de2e-41d1-aaf1-7589b937d81d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:46.044580 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-26deaa9e-de2e-41d1-aaf1-7589b937d81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:46.067621 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:46.093284 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a230125b-7c7c-48e4-87a5-9fb88f41bfcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba6b5bd2124d40a6a0246c1fa1cc3d2f', 'request_id': 'req-a230125b-7c7c-48e4-87a5-9fb88f41bfcd'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:46.105630 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a230125b-7c7c-48e4-87a5-9fb88f41bfcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba6b5bd2124d40a6a0246c1fa1cc3d2f', 'request_id': 'req-a230125b-7c7c-48e4-87a5-9fb88f41bfcd'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:46.123726 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a230125b-7c7c-48e4-87a5-9fb88f41bfcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba6b5bd2124d40a6a0246c1fa1cc3d2f', 'request_id': 'req-a230125b-7c7c-48e4-87a5-9fb88f41bfcd'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:46.149774 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a230125b-7c7c-48e4-87a5-9fb88f41bfcd admin admin] The token cache is being invalidate because project ba6b5bd2124d40a6a0246c1fa1cc3d2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:56:46.150057 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a230125b-7c7c-48e4-87a5-9fb88f41bfcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:46.151675 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a230125b-7c7c-48e4-87a5-9fb88f41bfcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:46.159446 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 886/1792] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:45 2022] DELETE /identity/v3/projects/ba6b5bd2124d40a6a0246c1fa1cc3d2f => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:46.164731 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd43fd2-224d-4112-9243-bb983d306856 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:46.165053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd43fd2-224d-4112-9243-bb983d306856 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:46.165336 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd43fd2-224d-4112-9243-bb983d306856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:46.219374 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8fd43fd2-224d-4112-9243-bb983d306856 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:46.221120 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8fd43fd2-224d-4112-9243-bb983d306856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:46.316349 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deaa9e-de2e-41d1-aaf1-7589b937d81d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:46.379863 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 887/1793] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:56:46.387069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f6bcd-dc5d-4bf5-bf71-60f70337f138 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:46.387475 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f6bcd-dc5d-4bf5-bf71-60f70337f138 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:46.387765 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f6bcd-dc5d-4bf5-bf71-60f70337f138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:46.462936 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4e0f6bcd-dc5d-4bf5-bf71-60f70337f138 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:46.473643 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4e0f6bcd-dc5d-4bf5-bf71-60f70337f138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:46.503098 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 888/1794] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:46.505132 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f6bcd-dc5d-4bf5-bf71-60f70337f138 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:46.514845 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09855c8-dc08-4182-8575-dd4afa0a99d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:46.515484 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09855c8-dc08-4182-8575-dd4afa0a99d1 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:46.520421 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09855c8-dc08-4182-8575-dd4afa0a99d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:46.520804 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09855c8-dc08-4182-8575-dd4afa0a99d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:46.525858 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e09855c8-dc08-4182-8575-dd4afa0a99d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:46.527590 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f6bcd-dc5d-4bf5-bf71-60f70337f138 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:46.544685 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d42756-9243-40c1-8270-5362e52ad575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:46.545355 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d42756-9243-40c1-8270-5362e52ad575 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:46.545640 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d42756-9243-40c1-8270-5362e52ad575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:46.545980 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d42756-9243-40c1-8270-5362e52ad575 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:46.549392 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d42756-9243-40c1-8270-5362e52ad575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:46.550392 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d42756-9243-40c1-8270-5362e52ad575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:46.552451 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d42756-9243-40c1-8270-5362e52ad575 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:46.575349 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09855c8-dc08-4182-8575-dd4afa0a99d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:46.579913 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09855c8-dc08-4182-8575-dd4afa0a99d1 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:46.598878 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 889/1795] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:56:46.608550 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d42756-9243-40c1-8270-5362e52ad575 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:46.613247 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 907/1796] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:56:46.623060 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d42756-9243-40c1-8270-5362e52ad575 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:46.629604 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab1f7d-dbfd-4348-bb48-3c15b1291620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:46.630321 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab1f7d-dbfd-4348-bb48-3c15b1291620 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:46.630568 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab1f7d-dbfd-4348-bb48-3c15b1291620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:46.630831 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab1f7d-dbfd-4348-bb48-3c15b1291620 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:46.631735 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab1f7d-dbfd-4348-bb48-3c15b1291620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:46.633869 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab1f7d-dbfd-4348-bb48-3c15b1291620 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:46.699035 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 890/1797] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:46 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:46.705995 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09855c8-dc08-4182-8575-dd4afa0a99d1 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:46.737901 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09855c8-dc08-4182-8575-dd4afa0a99d1 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:46.880661 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:46.973442 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab1f7d-dbfd-4348-bb48-3c15b1291620 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:46.975405 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2dab1f7d-dbfd-4348-bb48-3c15b1291620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:47.004283 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26f094-d0a4-4039-8b12-5ae05c40e668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:47.004972 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26f094-d0a4-4039-8b12-5ae05c40e668 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:47.006533 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26f094-d0a4-4039-8b12-5ae05c40e668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:47.006840 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26f094-d0a4-4039-8b12-5ae05c40e668 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:47.007478 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26f094-d0a4-4039-8b12-5ae05c40e668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:47.014956 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26f094-d0a4-4039-8b12-5ae05c40e668 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:47.116804 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 908/1798] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:46 2022] POST /identity/v3/users => generated 291 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:47.124705 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26f094-d0a4-4039-8b12-5ae05c40e668 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:47.169217 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26f094-d0a4-4039-8b12-5ae05c40e668 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:47.185532 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371abb8-f474-41dd-abdd-c197be697c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:47.186171 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371abb8-f474-41dd-abdd-c197be697c1b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:47.186453 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371abb8-f474-41dd-abdd-c197be697c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:47.186724 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371abb8-f474-41dd-abdd-c197be697c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:47.187388 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371abb8-f474-41dd-abdd-c197be697c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:47.189061 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371abb8-f474-41dd-abdd-c197be697c1b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:47.217510 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 909/1799] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:47.224043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab1f7d-dbfd-4348-bb48-3c15b1291620 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:47.225652 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371abb8-f474-41dd-abdd-c197be697c1b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:47.242634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adcce9-372b-44dd-93e1-fe846169394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:47.243641 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adcce9-372b-44dd-93e1-fe846169394c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:47.244137 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adcce9-372b-44dd-93e1-fe846169394c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:47.244568 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adcce9-372b-44dd-93e1-fe846169394c admin admin] PATH_INFO: `/v3/projects/d7794d477fda461fb174e42a75a56d93` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:47.248257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49adcce9-372b-44dd-93e1-fe846169394c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7794d477fda461fb174e42a75a56d93)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:47.250461 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49adcce9-372b-44dd-93e1-fe846169394c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:47.253575 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371abb8-f474-41dd-abdd-c197be697c1b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:47.274801 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f6193-0926-44c2-a73c-14cc7c0910d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:47.275754 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f6193-0926-44c2-a73c-14cc7c0910d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:47.280481 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f6193-0926-44c2-a73c-14cc7c0910d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:47.281010 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f6193-0926-44c2-a73c-14cc7c0910d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:47.283795 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f6193-0926-44c2-a73c-14cc7c0910d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:47.295031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f6193-0926-44c2-a73c-14cc7c0910d1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:47.377822 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 910/1800] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:47.387650 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f6193-0926-44c2-a73c-14cc7c0910d1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:47.435500 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f6193-0926-44c2-a73c-14cc7c0910d1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:47.441107 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:47.449787 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4968be7-7359-4815-a4ce-22b7daa765b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:47.453078 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4968be7-7359-4815-a4ce-22b7daa765b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:47.456373 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4968be7-7359-4815-a4ce-22b7daa765b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:47.456850 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4968be7-7359-4815-a4ce-22b7daa765b5 admin admin] PATH_INFO: `/v3/projects/84faeadb3ec44c1b849b186d7a280aa4/users/97d95deee25b4f16a823867d865300ca/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:47.479933 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-49adcce9-372b-44dd-93e1-fe846169394c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7794d477fda461fb174e42a75a56d93', 'request_id': 'req-49adcce9-372b-44dd-93e1-fe846169394c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:47.498832 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-49adcce9-372b-44dd-93e1-fe846169394c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7794d477fda461fb174e42a75a56d93', 'request_id': 'req-49adcce9-372b-44dd-93e1-fe846169394c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:47.503227 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4968be7-7359-4815-a4ce-22b7daa765b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84faeadb3ec44c1b849b186d7a280aa4, user_id=97d95deee25b4f16a823867d865300ca, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:47.514774 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4968be7-7359-4815-a4ce-22b7daa765b5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:47.516435 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-49adcce9-372b-44dd-93e1-fe846169394c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7794d477fda461fb174e42a75a56d93', 'request_id': 'req-49adcce9-372b-44dd-93e1-fe846169394c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:47.542398 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-49adcce9-372b-44dd-93e1-fe846169394c admin admin] The token cache is being invalidate because project d7794d477fda461fb174e42a75a56d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:56:47.542836 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-49adcce9-372b-44dd-93e1-fe846169394c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:47.547355 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-49adcce9-372b-44dd-93e1-fe846169394c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:47.548348 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 911/1801] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:47 2022] PUT /identity/v3/projects/84faeadb3ec44c1b849b186d7a280aa4/users/97d95deee25b4f16a823867d865300ca/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:47.554250 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 891/1802] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:46 2022] DELETE /identity/v3/projects/d7794d477fda461fb174e42a75a56d93 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:56:47.556732 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d36af-3b1e-4c58-bfd0-52db71ff4e24 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:47.557322 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d36af-3b1e-4c58-bfd0-52db71ff4e24 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:47.557814 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d36af-3b1e-4c58-bfd0-52db71ff4e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:47.564455 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7355a-828a-4700-a0da-a306b2827809 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:47.565136 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7355a-828a-4700-a0da-a306b2827809 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:47.566199 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7355a-828a-4700-a0da-a306b2827809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:47.621775 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a61d36af-3b1e-4c58-bfd0-52db71ff4e24 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:47.623874 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a61d36af-3b1e-4c58-bfd0-52db71ff4e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:47.660283 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-67c7355a-828a-4700-a0da-a306b2827809 None None] MFA Rules not processed for user `97d95deee25b4f16a823867d865300ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:47.663348 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-67c7355a-828a-4700-a0da-a306b2827809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:47.861400 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 912/1803] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:47.863485 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e869fa0-1440-4989-a76b-29d1bb557846 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:47.864200 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e869fa0-1440-4989-a76b-29d1bb557846 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:47.864865 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e869fa0-1440-4989-a76b-29d1bb557846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:47.897321 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 892/1804] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:47.898327 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7355a-828a-4700-a0da-a306b2827809 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:47.903251 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-67c7355a-828a-4700-a0da-a306b2827809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:47.921568 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6e869fa0-1440-4989-a76b-29d1bb557846 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:47.924699 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6e869fa0-1440-4989-a76b-29d1bb557846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:47.938890 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7355a-828a-4700-a0da-a306b2827809 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:47.957593 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433c29c-d365-4ed5-8391-d42f32d260c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:47.957593 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433c29c-d365-4ed5-8391-d42f32d260c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:47.957593 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433c29c-d365-4ed5-8391-d42f32d260c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:47.957593 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433c29c-d365-4ed5-8391-d42f32d260c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:47.958248 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433c29c-d365-4ed5-8391-d42f32d260c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:47.959745 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 913/1805] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:47.962828 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433c29c-d365-4ed5-8391-d42f32d260c8 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:47.964681 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e869fa0-1440-4989-a76b-29d1bb557846 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:47.981634 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e869fa0-1440-4989-a76b-29d1bb557846 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:47.991170 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e5967-2819-47f6-b940-42b5a2c9b186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:47.994736 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e5967-2819-47f6-b940-42b5a2c9b186 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:47.996625 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e5967-2819-47f6-b940-42b5a2c9b186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:47.997667 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e5967-2819-47f6-b940-42b5a2c9b186 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:48.017677 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e5967-2819-47f6-b940-42b5a2c9b186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:48.022801 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e5967-2819-47f6-b940-42b5a2c9b186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:48.040094 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e5967-2819-47f6-b940-42b5a2c9b186 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:48.041044 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 893/1806] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:47 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:48.043619 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433c29c-d365-4ed5-8391-d42f32d260c8 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:48.152551 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 914/1807] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:56:48.156565 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e5967-2819-47f6-b940-42b5a2c9b186 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:48.202024 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e5967-2819-47f6-b940-42b5a2c9b186 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:48.265968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433c29c-d365-4ed5-8391-d42f32d260c8 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:48.285471 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c9f5b-57da-4583-9d95-4428fddc3129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:48.286123 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c9f5b-57da-4583-9d95-4428fddc3129 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:48.286403 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c9f5b-57da-4583-9d95-4428fddc3129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:48.286736 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c9f5b-57da-4583-9d95-4428fddc3129 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:48.287398 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c9f5b-57da-4583-9d95-4428fddc3129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:48.289646 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c9f5b-57da-4583-9d95-4428fddc3129 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:48.336744 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 894/1808] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:48 2022] POST /identity/v3/users => generated 296 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:48.341379 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c9f5b-57da-4583-9d95-4428fddc3129 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:48.363013 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c9f5b-57da-4583-9d95-4428fddc3129 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:48.381678 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa95160-d84e-4069-a07d-c634ef487557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:48.382421 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa95160-d84e-4069-a07d-c634ef487557 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:48.383042 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa95160-d84e-4069-a07d-c634ef487557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:48.383439 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa95160-d84e-4069-a07d-c634ef487557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:48.384972 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa95160-d84e-4069-a07d-c634ef487557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:48.387532 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa95160-d84e-4069-a07d-c634ef487557 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:48.400768 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:48.421283 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 895/1809] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 00:56:48.429031 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa95160-d84e-4069-a07d-c634ef487557 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:48.455298 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa95160-d84e-4069-a07d-c634ef487557 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:48.483208 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca58c50-2324-4ae3-b552-d47219e73667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:48.483208 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca58c50-2324-4ae3-b552-d47219e73667 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:48.483208 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca58c50-2324-4ae3-b552-d47219e73667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:48.483208 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca58c50-2324-4ae3-b552-d47219e73667 admin admin] PATH_INFO: `/v3/projects/cf907518affd421ba11203039c82b070/users/9b12ab9c0399479690f82ffd9185a0b4/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:48.486783 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:48.505717 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fa502-be35-4625-9a57-fcdf04cc481f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:48.506674 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fa502-be35-4625-9a57-fcdf04cc481f admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:48.507025 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fa502-be35-4625-9a57-fcdf04cc481f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:48.507301 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fa502-be35-4625-9a57-fcdf04cc481f admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:48.511620 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fa502-be35-4625-9a57-fcdf04cc481f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:48.520036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fa502-be35-4625-9a57-fcdf04cc481f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:48.558129 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca58c50-2324-4ae3-b552-d47219e73667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf907518affd421ba11203039c82b070, user_id=9b12ab9c0399479690f82ffd9185a0b4, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:48.562961 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca58c50-2324-4ae3-b552-d47219e73667 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:48.594282 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 896/1810] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:48 2022] PUT /identity/v3/projects/cf907518affd421ba11203039c82b070/users/9b12ab9c0399479690f82ffd9185a0b4/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:48.598398 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca58c50-2324-4ae3-b552-d47219e73667 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:48.599219 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 915/1811] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:48 2022] POST /identity/v3/projects => generated 369 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:48.605119 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fa502-be35-4625-9a57-fcdf04cc481f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:48.767067 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca58c50-2324-4ae3-b552-d47219e73667 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:48.834928 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fa502-be35-4625-9a57-fcdf04cc481f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:48.853997 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90588cd1-f249-47c8-90f8-be90ad503683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:48.854656 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90588cd1-f249-47c8-90f8-be90ad503683 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:48.854942 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90588cd1-f249-47c8-90f8-be90ad503683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:48.855216 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90588cd1-f249-47c8-90f8-be90ad503683 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:48.855874 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90588cd1-f249-47c8-90f8-be90ad503683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:48.866916 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90588cd1-f249-47c8-90f8-be90ad503683 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:48.915265 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 916/1812] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:48.917427 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90588cd1-f249-47c8-90f8-be90ad503683 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:48.942225 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90588cd1-f249-47c8-90f8-be90ad503683 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:48.955637 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee499b-6041-47b5-bb39-ea5f4c0889d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:48.956451 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee499b-6041-47b5-bb39-ea5f4c0889d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:48.956734 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee499b-6041-47b5-bb39-ea5f4c0889d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:48.957034 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee499b-6041-47b5-bb39-ea5f4c0889d3 admin admin] PATH_INFO: `/v3/projects/cf907518affd421ba11203039c82b070/users/9b12ab9c0399479690f82ffd9185a0b4/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:48.964906 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee499b-6041-47b5-bb39-ea5f4c0889d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf907518affd421ba11203039c82b070, user_id=9b12ab9c0399479690f82ffd9185a0b4, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:48.967691 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee499b-6041-47b5-bb39-ea5f4c0889d3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:48.995281 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 917/1813] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:48 2022] PUT /identity/v3/projects/cf907518affd421ba11203039c82b070/users/9b12ab9c0399479690f82ffd9185a0b4/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:49.007281 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7d565-4a44-4fec-97cc-dd8ebcaf4a32 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:49.007532 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7d565-4a44-4fec-97cc-dd8ebcaf4a32 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:49.008652 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7d565-4a44-4fec-97cc-dd8ebcaf4a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:49.102821 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-17d7d565-4a44-4fec-97cc-dd8ebcaf4a32 None None] MFA Rules not processed for user `9b12ab9c0399479690f82ffd9185a0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:49.104486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-17d7d565-4a44-4fec-97cc-dd8ebcaf4a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:49.138810 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6e272-1f67-41cd-ac8b-ace06797eb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:49.141593 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6e272-1f67-41cd-ac8b-ace06797eb72 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:49.144378 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6e272-1f67-41cd-ac8b-ace06797eb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:49.144698 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6e272-1f67-41cd-ac8b-ace06797eb72 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:49.145421 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6e272-1f67-41cd-ac8b-ace06797eb72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:49.154471 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6e272-1f67-41cd-ac8b-ace06797eb72 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:49.230419 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 897/1814] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:48 2022] POST /identity/v3/users => generated 285 bytes in 629 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:49.231035 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6e272-1f67-41cd-ac8b-ace06797eb72 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:49.239543 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5ee6e272-1f67-41cd-ac8b-ace06797eb72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:49.273073 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6e272-1f67-41cd-ac8b-ace06797eb72 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:49.402162 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 918/1815] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:56:49.403200 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7d565-4a44-4fec-97cc-dd8ebcaf4a32 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:49.442301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db90dbe-fc37-4abf-bc81-532aaa640a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:49.442994 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db90dbe-fc37-4abf-bc81-532aaa640a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:49.443273 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db90dbe-fc37-4abf-bc81-532aaa640a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:49.443548 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db90dbe-fc37-4abf-bc81-532aaa640a68 admin admin] PATH_INFO: `/v3/users/461f08913b1e439c9c2bc3d7011e9d8f` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:49.445836 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db90dbe-fc37-4abf-bc81-532aaa640a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=461f08913b1e439c9c2bc3d7011e9d8f)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:49.448250 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db90dbe-fc37-4abf-bc81-532aaa640a68 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:49.504280 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:49.611378 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0db90dbe-fc37-4abf-bc81-532aaa640a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '461f08913b1e439c9c2bc3d7011e9d8f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:49.612378 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0db90dbe-fc37-4abf-bc81-532aaa640a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '461f08913b1e439c9c2bc3d7011e9d8f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:49.640177 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0db90dbe-fc37-4abf-bc81-532aaa640a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '461f08913b1e439c9c2bc3d7011e9d8f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:49.642920 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0db90dbe-fc37-4abf-bc81-532aaa640a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '461f08913b1e439c9c2bc3d7011e9d8f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:49.661983 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:49.692719 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7d565-4a44-4fec-97cc-dd8ebcaf4a32 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:49.696034 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0db90dbe-fc37-4abf-bc81-532aaa640a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '461f08913b1e439c9c2bc3d7011e9d8f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:49.709720 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad60d90-f182-4b27-abfa-74c6fb84e97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:49.710349 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad60d90-f182-4b27-abfa-74c6fb84e97f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:49.710702 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad60d90-f182-4b27-abfa-74c6fb84e97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:49.710977 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad60d90-f182-4b27-abfa-74c6fb84e97f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:49.711641 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad60d90-f182-4b27-abfa-74c6fb84e97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:49.717770 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad60d90-f182-4b27-abfa-74c6fb84e97f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:49.750958 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 919/1816] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:49.751924 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad60d90-f182-4b27-abfa-74c6fb84e97f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:49.776461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cad60d90-f182-4b27-abfa-74c6fb84e97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:49.807176 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 898/1817] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:49 2022] DELETE /identity/v3/users/461f08913b1e439c9c2bc3d7011e9d8f => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:49.808315 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db90dbe-fc37-4abf-bc81-532aaa640a68 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:49.814870 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0db90dbe-fc37-4abf-bc81-532aaa640a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:50.002289 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad60d90-f182-4b27-abfa-74c6fb84e97f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:50.095620 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd165b4-0bed-4879-84dc-7991cc89c5f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:50.097267 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd165b4-0bed-4879-84dc-7991cc89c5f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:50.098007 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd165b4-0bed-4879-84dc-7991cc89c5f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:50.098341 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd165b4-0bed-4879-84dc-7991cc89c5f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:50.100246 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1cd165b4-0bed-4879-84dc-7991cc89c5f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:50.126992 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db90dbe-fc37-4abf-bc81-532aaa640a68 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:50.144649 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf866a98-e6f1-407d-bef7-4b4840024245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:50.147364 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf866a98-e6f1-407d-bef7-4b4840024245 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:50.148633 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf866a98-e6f1-407d-bef7-4b4840024245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:50.149678 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf866a98-e6f1-407d-bef7-4b4840024245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:50.150533 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf866a98-e6f1-407d-bef7-4b4840024245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:50.155345 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf866a98-e6f1-407d-bef7-4b4840024245 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:50.197785 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 899/1818] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:50.200917 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d87f5a-529b-4140-af0a-69eb3663521f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:50.201713 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d87f5a-529b-4140-af0a-69eb3663521f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:50.202166 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d87f5a-529b-4140-af0a-69eb3663521f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:50.231091 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd165b4-0bed-4879-84dc-7991cc89c5f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:50.232635 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd165b4-0bed-4879-84dc-7991cc89c5f5 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:50.264190 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-16d87f5a-529b-4140-af0a-69eb3663521f None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:50.265768 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-16d87f5a-529b-4140-af0a-69eb3663521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:50.267672 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 920/1819] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:50.268920 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd165b4-0bed-4879-84dc-7991cc89c5f5 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:50.299287 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd165b4-0bed-4879-84dc-7991cc89c5f5 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:50.305420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec95e5c-4219-4a19-8454-871d1e805851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:50.306448 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec95e5c-4219-4a19-8454-871d1e805851 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:50.306715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec95e5c-4219-4a19-8454-871d1e805851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:50.307164 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec95e5c-4219-4a19-8454-871d1e805851 admin admin] PATH_INFO: `/v3/projects/d2dacfd0721a4671a3a907282798009a/users/1f0cba41c94f4a2ab4885997167d6679/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:50.312328 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 900/1820] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:50.335946 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec95e5c-4219-4a19-8454-871d1e805851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2dacfd0721a4671a3a907282798009a, user_id=1f0cba41c94f4a2ab4885997167d6679, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:50.343653 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec95e5c-4219-4a19-8454-871d1e805851 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:50.381930 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 921/1821] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:50 2022] PUT /identity/v3/projects/d2dacfd0721a4671a3a907282798009a/users/1f0cba41c94f4a2ab4885997167d6679/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:50.396267 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7db845-3d59-4c3b-b9c8-88efd15000f9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:50.396615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7db845-3d59-4c3b-b9c8-88efd15000f9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:50.397277 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7db845-3d59-4c3b-b9c8-88efd15000f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:50.421910 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec95e5c-4219-4a19-8454-871d1e805851 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:50.424553 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7ec95e5c-4219-4a19-8454-871d1e805851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:50.510305 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3e7db845-3d59-4c3b-b9c8-88efd15000f9 None None] MFA Rules not processed for user `1f0cba41c94f4a2ab4885997167d6679`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:50.515720 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3e7db845-3d59-4c3b-b9c8-88efd15000f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:50.598963 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:50.696536 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec95e5c-4219-4a19-8454-871d1e805851 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:50.729452 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609114a1-2a70-4ff6-a803-53c56f5d21ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:50.730349 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609114a1-2a70-4ff6-a803-53c56f5d21ec service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:50.731377 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609114a1-2a70-4ff6-a803-53c56f5d21ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:50.731853 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609114a1-2a70-4ff6-a803-53c56f5d21ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:50.741320 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 901/1822] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:50.743286 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567d621-4c06-499d-b6fa-85743a72ccf7 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:50.748718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567d621-4c06-499d-b6fa-85743a72ccf7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:50.749202 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567d621-4c06-499d-b6fa-85743a72ccf7 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:50.751259 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 902/1823] 10.222.0.26 () {54 vars in 921 bytes} [Sun Oct 2 00:56:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:56:50.755866 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567d621-4c06-499d-b6fa-85743a72ccf7 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:50.790786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:50.961082 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567d621-4c06-499d-b6fa-85743a72ccf7 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:50.979156 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e0c0f-1b54-487d-b999-08acebbbf6a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:50.979901 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e0c0f-1b54-487d-b999-08acebbbf6a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:50.984341 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e0c0f-1b54-487d-b999-08acebbbf6a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:50.989301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e0c0f-1b54-487d-b999-08acebbbf6a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:50.995735 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609114a1-2a70-4ff6-a803-53c56f5d21ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:50.998121 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609114a1-2a70-4ff6-a803-53c56f5d21ec service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:51.014188 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 922/1824] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:51.015081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609114a1-2a70-4ff6-a803-53c56f5d21ec service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:51.016122 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a03e0c0f-1b54-487d-b999-08acebbbf6a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:51.035067 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609114a1-2a70-4ff6-a803-53c56f5d21ec service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:51.056547 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b49f4-9045-4844-b4b4-ada913ce6b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:51.057819 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b49f4-9045-4844-b4b4-ada913ce6b81 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:51.058215 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b49f4-9045-4844-b4b4-ada913ce6b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:51.058328 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b49f4-9045-4844-b4b4-ada913ce6b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:51.061455 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b49f4-9045-4844-b4b4-ada913ce6b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:51.065562 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b49f4-9045-4844-b4b4-ada913ce6b81 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:51.154490 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 923/1825] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:51 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:51.158369 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093ca00-4eac-4df1-8624-baa15f3a75a6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:51.158716 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093ca00-4eac-4df1-8624-baa15f3a75a6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:51.162166 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093ca00-4eac-4df1-8624-baa15f3a75a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:51.198515 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c093ca00-4eac-4df1-8624-baa15f3a75a6 None None] MFA Rules not processed for user `81e0396b7ba341ce8d02b1a149786d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:51.201151 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c093ca00-4eac-4df1-8624-baa15f3a75a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:51.208185 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e0c0f-1b54-487d-b999-08acebbbf6a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:51.210662 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e0c0f-1b54-487d-b999-08acebbbf6a7 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:51.246867 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 903/1826] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:51.248675 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e0c0f-1b54-487d-b999-08acebbbf6a7 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:51.279784 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e0c0f-1b54-487d-b999-08acebbbf6a7 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:51.391451 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 924/1827] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Oct 2 00:56:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:51.458832 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db4406-9701-4072-a890-f528cb453ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:51.459596 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db4406-9701-4072-a890-f528cb453ede admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:51.459832 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db4406-9701-4072-a890-f528cb453ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:51.460116 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db4406-9701-4072-a890-f528cb453ede admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:51.460778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db4406-9701-4072-a890-f528cb453ede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:51.470317 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db4406-9701-4072-a890-f528cb453ede admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:51.524993 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 904/1828] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:51 2022] POST /identity/v3/users => generated 291 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:51.526639 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093ca00-4eac-4df1-8624-baa15f3a75a6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:51.545747 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093ca00-4eac-4df1-8624-baa15f3a75a6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:51.556457 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea968d4-c7dd-4f43-a032-fce855d21dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:51.557113 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea968d4-c7dd-4f43-a032-fce855d21dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:51.557397 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea968d4-c7dd-4f43-a032-fce855d21dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:51.557670 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea968d4-c7dd-4f43-a032-fce855d21dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:51.558328 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea968d4-c7dd-4f43-a032-fce855d21dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:51.562690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea968d4-c7dd-4f43-a032-fce855d21dc3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:51.602928 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 925/1829] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:51.607709 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db4406-9701-4072-a890-f528cb453ede admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:51.624874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db4406-9701-4072-a890-f528cb453ede admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:51.634385 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bff1eb-df87-4984-ab24-71a05081531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:51.635348 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bff1eb-df87-4984-ab24-71a05081531a admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:51.635592 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bff1eb-df87-4984-ab24-71a05081531a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:51.635967 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bff1eb-df87-4984-ab24-71a05081531a admin admin] PATH_INFO: `/v3/projects/0f2d31c71a0e4d25946abdeeac0b36b6/users/57dab5fd1987404c9d1324f6b870f084/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:51.667901 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bff1eb-df87-4984-ab24-71a05081531a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f2d31c71a0e4d25946abdeeac0b36b6, user_id=57dab5fd1987404c9d1324f6b870f084, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:51.671528 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bff1eb-df87-4984-ab24-71a05081531a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:51.701363 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 905/1830] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:51 2022] PUT /identity/v3/projects/0f2d31c71a0e4d25946abdeeac0b36b6/users/57dab5fd1987404c9d1324f6b870f084/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:56:51.705312 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea968d4-c7dd-4f43-a032-fce855d21dc3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:51.744469 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea968d4-c7dd-4f43-a032-fce855d21dc3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:51.775845 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bff1eb-df87-4984-ab24-71a05081531a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:51.777719 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-81bff1eb-df87-4984-ab24-71a05081531a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:51.810989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:51.851878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e85cb-9e7f-42c7-81fd-d75660982f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:51.852502 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e85cb-9e7f-42c7-81fd-d75660982f0a admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:51.852774 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e85cb-9e7f-42c7-81fd-d75660982f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:51.853146 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e85cb-9e7f-42c7-81fd-d75660982f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:51.853795 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e85cb-9e7f-42c7-81fd-d75660982f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:51.855892 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e85cb-9e7f-42c7-81fd-d75660982f0a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:51.861635 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:51.871811 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 926/1831] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:51.875962 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e85cb-9e7f-42c7-81fd-d75660982f0a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:51.889575 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e85cb-9e7f-42c7-81fd-d75660982f0a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:51.896617 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c548449-3e0e-4fc2-89d6-0133e9de22b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:51.897348 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c548449-3e0e-4fc2-89d6-0133e9de22b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:51.897633 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c548449-3e0e-4fc2-89d6-0133e9de22b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:51.897896 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c548449-3e0e-4fc2-89d6-0133e9de22b8 admin admin] PATH_INFO: `/v3/projects/0f2d31c71a0e4d25946abdeeac0b36b6/users/57dab5fd1987404c9d1324f6b870f084/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:51.901206 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c548449-3e0e-4fc2-89d6-0133e9de22b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f2d31c71a0e4d25946abdeeac0b36b6, user_id=57dab5fd1987404c9d1324f6b870f084, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:51.903956 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c548449-3e0e-4fc2-89d6-0133e9de22b8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:51.914200 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bff1eb-df87-4984-ab24-71a05081531a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:51.919768 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 927/1832] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:51 2022] PUT /identity/v3/projects/0f2d31c71a0e4d25946abdeeac0b36b6/users/57dab5fd1987404c9d1324f6b870f084/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:56:51.930671 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a43220-4d64-4aa5-af7f-130d0a2c84e4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:51.931142 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a43220-4d64-4aa5-af7f-130d0a2c84e4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:51.931421 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a43220-4d64-4aa5-af7f-130d0a2c84e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:51.993497 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-03a43220-4d64-4aa5-af7f-130d0a2c84e4 None None] MFA Rules not processed for user `57dab5fd1987404c9d1324f6b870f084`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:51.996599 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-03a43220-4d64-4aa5-af7f-130d0a2c84e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:52.017232 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d983e5-7e24-4093-a436-dcf86c52647d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:52.018199 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d983e5-7e24-4093-a436-dcf86c52647d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:52.019122 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d983e5-7e24-4093-a436-dcf86c52647d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:52.019637 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d983e5-7e24-4093-a436-dcf86c52647d admin admin] PATH_INFO: `/v3/users/97d95deee25b4f16a823867d865300ca` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:52.021086 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d983e5-7e24-4093-a436-dcf86c52647d admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d95deee25b4f16a823867d865300ca)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:52.023146 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d983e5-7e24-4093-a436-dcf86c52647d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:52.121758 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 928/1833] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:52.122558 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a43220-4d64-4aa5-af7f-130d0a2c84e4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:52.124731 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-03a43220-4d64-4aa5-af7f-130d0a2c84e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:52.138094 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e6d983e5-7e24-4093-a436-dcf86c52647d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d95deee25b4f16a823867d865300ca'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:52.139543 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e6d983e5-7e24-4093-a436-dcf86c52647d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d95deee25b4f16a823867d865300ca'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:52.151416 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e6d983e5-7e24-4093-a436-dcf86c52647d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d95deee25b4f16a823867d865300ca'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:52.152313 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e6d983e5-7e24-4093-a436-dcf86c52647d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d95deee25b4f16a823867d865300ca'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:52.164334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e6d983e5-7e24-4093-a436-dcf86c52647d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d95deee25b4f16a823867d865300ca'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:52.189046 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 906/1834] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:51 2022] DELETE /identity/v3/users/97d95deee25b4f16a823867d865300ca => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:52.190350 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d983e5-7e24-4093-a436-dcf86c52647d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:52.192929 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e6d983e5-7e24-4093-a436-dcf86c52647d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:52.285833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d983e5-7e24-4093-a436-dcf86c52647d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:52.291031 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb77f66-58d0-43a0-9dfb-790c89c96b42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:52.291821 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb77f66-58d0-43a0-9dfb-790c89c96b42 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:52.292171 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb77f66-58d0-43a0-9dfb-790c89c96b42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:52.292521 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb77f66-58d0-43a0-9dfb-790c89c96b42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:52.295043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7bb77f66-58d0-43a0-9dfb-790c89c96b42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:52.328008 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:52.351483 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a43220-4d64-4aa5-af7f-130d0a2c84e4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:52.434487 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:52.464149 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb77f66-58d0-43a0-9dfb-790c89c96b42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:52.469820 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb77f66-58d0-43a0-9dfb-790c89c96b42 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:52.478974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71138719-6ea9-4af0-bbc9-1ef700e4c27a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:52.481507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71138719-6ea9-4af0-bbc9-1ef700e4c27a service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:52.481913 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71138719-6ea9-4af0-bbc9-1ef700e4c27a service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:52.482268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71138719-6ea9-4af0-bbc9-1ef700e4c27a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:52.486366 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-71138719-6ea9-4af0-bbc9-1ef700e4c27a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:52.504398 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 907/1835] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:52.507159 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d8af3-b9ea-4efa-83f6-4186c26ee010 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:52.507457 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d8af3-b9ea-4efa-83f6-4186c26ee010 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:52.507739 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d8af3-b9ea-4efa-83f6-4186c26ee010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:52.508553 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71138719-6ea9-4af0-bbc9-1ef700e4c27a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:52.511268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71138719-6ea9-4af0-bbc9-1ef700e4c27a service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:52.548290 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 929/1836] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:52.558205 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-cc2d8af3-b9ea-4efa-83f6-4186c26ee010 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:52.562324 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cc2d8af3-b9ea-4efa-83f6-4186c26ee010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:52.590319 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71138719-6ea9-4af0-bbc9-1ef700e4c27a service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:52.610514 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71138719-6ea9-4af0-bbc9-1ef700e4c27a service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:52.619045 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7baca-1f27-42e8-abef-ada4651eb637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:52.620017 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7baca-1f27-42e8-abef-ada4651eb637 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:52.620566 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7baca-1f27-42e8-abef-ada4651eb637 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:52.621104 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7baca-1f27-42e8-abef-ada4651eb637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:52.627048 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bbe7baca-1f27-42e8-abef-ada4651eb637 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:52.684198 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 908/1837] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:52.685130 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d8af3-b9ea-4efa-83f6-4186c26ee010 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:52.689498 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cc2d8af3-b9ea-4efa-83f6-4186c26ee010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:52.704421 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d8af3-b9ea-4efa-83f6-4186c26ee010 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:52.711658 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625652d-36a6-4efd-a8f6-ad052a356bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:52.712608 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625652d-36a6-4efd-a8f6-ad052a356bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:52.713703 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625652d-36a6-4efd-a8f6-ad052a356bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:52.714071 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625652d-36a6-4efd-a8f6-ad052a356bce admin admin] PATH_INFO: `/v3/users/63ec654e2e884caf8d881e0448087bb5` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:52.715305 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625652d-36a6-4efd-a8f6-ad052a356bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ec654e2e884caf8d881e0448087bb5)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:52.717329 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625652d-36a6-4efd-a8f6-ad052a356bce admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:52.730107 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe7baca-1f27-42e8-abef-ada4651eb637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:52.731743 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe7baca-1f27-42e8-abef-ada4651eb637 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:52.744153 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 930/1838] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:52.745147 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7baca-1f27-42e8-abef-ada4651eb637 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:52.746720 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bbe7baca-1f27-42e8-abef-ada4651eb637 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:52.767756 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7baca-1f27-42e8-abef-ada4651eb637 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:52.774998 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d26892-4cfe-49d6-a150-e64359a907ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:52.775679 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d26892-4cfe-49d6-a150-e64359a907ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:52.775968 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d26892-4cfe-49d6-a150-e64359a907ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:52.776444 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d26892-4cfe-49d6-a150-e64359a907ad admin admin] PATH_INFO: `/v3/projects/e8cde1b3095e428f9ecf45d111ef2566` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:52.777763 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d26892-4cfe-49d6-a150-e64359a907ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8cde1b3095e428f9ecf45d111ef2566)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:52.779626 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d26892-4cfe-49d6-a150-e64359a907ad admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:52.811468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5625652d-36a6-4efd-a8f6-ad052a356bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ec654e2e884caf8d881e0448087bb5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:52.812865 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5625652d-36a6-4efd-a8f6-ad052a356bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ec654e2e884caf8d881e0448087bb5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:52.825438 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5625652d-36a6-4efd-a8f6-ad052a356bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ec654e2e884caf8d881e0448087bb5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:52.826591 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5625652d-36a6-4efd-a8f6-ad052a356bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ec654e2e884caf8d881e0448087bb5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:52.838916 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5625652d-36a6-4efd-a8f6-ad052a356bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ec654e2e884caf8d881e0448087bb5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:52.866289 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 909/1839] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:52 2022] DELETE /identity/v3/users/63ec654e2e884caf8d881e0448087bb5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:52.866289 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625652d-36a6-4efd-a8f6-ad052a356bce admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:52.868002 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5625652d-36a6-4efd-a8f6-ad052a356bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:52.891056 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b1d26892-4cfe-49d6-a150-e64359a907ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8cde1b3095e428f9ecf45d111ef2566', 'request_id': 'req-b1d26892-4cfe-49d6-a150-e64359a907ad'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:52.901365 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b1d26892-4cfe-49d6-a150-e64359a907ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8cde1b3095e428f9ecf45d111ef2566', 'request_id': 'req-b1d26892-4cfe-49d6-a150-e64359a907ad'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:52.902549 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:52.911908 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b1d26892-4cfe-49d6-a150-e64359a907ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8cde1b3095e428f9ecf45d111ef2566', 'request_id': 'req-b1d26892-4cfe-49d6-a150-e64359a907ad'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:52.963915 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b1d26892-4cfe-49d6-a150-e64359a907ad admin admin] The token cache is being invalidate because project e8cde1b3095e428f9ecf45d111ef2566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:56:52.963915 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b1d26892-4cfe-49d6-a150-e64359a907ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:52.964454 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b1d26892-4cfe-49d6-a150-e64359a907ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:52.972763 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 931/1840] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:52 2022] DELETE /identity/v3/projects/e8cde1b3095e428f9ecf45d111ef2566 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:52.976507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c3450-7512-4f86-bfc1-cd05c64a70e2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:52.978359 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c3450-7512-4f86-bfc1-cd05c64a70e2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:52.978642 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c3450-7512-4f86-bfc1-cd05c64a70e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:53.010219 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625652d-36a6-4efd-a8f6-ad052a356bce admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:53.014699 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a66847-1837-47fd-8541-0ff4f9bb0a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:53.015417 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a66847-1837-47fd-8541-0ff4f9bb0a84 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:53.015691 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a66847-1837-47fd-8541-0ff4f9bb0a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:53.015975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a66847-1837-47fd-8541-0ff4f9bb0a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:53.019936 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e5a66847-1837-47fd-8541-0ff4f9bb0a84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:53.029962 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f78c3450-7512-4f86-bfc1-cd05c64a70e2 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:53.035603 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f78c3450-7512-4f86-bfc1-cd05c64a70e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:53.156190 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a66847-1837-47fd-8541-0ff4f9bb0a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:53.159093 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a66847-1837-47fd-8541-0ff4f9bb0a84 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:53.166635 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:53.182630 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 910/1841] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:53.184299 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a66847-1837-47fd-8541-0ff4f9bb0a84 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:53.189763 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e5a66847-1837-47fd-8541-0ff4f9bb0a84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:53.203604 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 932/1842] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:53.213217 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a66847-1837-47fd-8541-0ff4f9bb0a84 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:53.218532 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303815e3-83fe-4962-b5e6-c2b8d2767813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:53.219301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303815e3-83fe-4962-b5e6-c2b8d2767813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:53.220245 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303815e3-83fe-4962-b5e6-c2b8d2767813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:53.220578 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303815e3-83fe-4962-b5e6-c2b8d2767813 admin admin] PATH_INFO: `/v3/users/1f8fa15b46ab460985c78ad0afbe0f8e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:53.221933 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303815e3-83fe-4962-b5e6-c2b8d2767813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8fa15b46ab460985c78ad0afbe0f8e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:53.224091 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303815e3-83fe-4962-b5e6-c2b8d2767813 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:53.230600 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c3450-7512-4f86-bfc1-cd05c64a70e2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:53.232044 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f78c3450-7512-4f86-bfc1-cd05c64a70e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:53.250675 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c3450-7512-4f86-bfc1-cd05c64a70e2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:53.259066 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd68bd-94a2-45e2-b81b-60670eb97b7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:53.259694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd68bd-94a2-45e2-b81b-60670eb97b7a service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:53.259976 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd68bd-94a2-45e2-b81b-60670eb97b7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:53.260248 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd68bd-94a2-45e2-b81b-60670eb97b7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:53.293171 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd68bd-94a2-45e2-b81b-60670eb97b7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:53.293171 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd68bd-94a2-45e2-b81b-60670eb97b7a service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:53.324049 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 933/1843] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:56:53.335003 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-303815e3-83fe-4962-b5e6-c2b8d2767813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8fa15b46ab460985c78ad0afbe0f8e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:53.335895 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-303815e3-83fe-4962-b5e6-c2b8d2767813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8fa15b46ab460985c78ad0afbe0f8e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:53.350013 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-303815e3-83fe-4962-b5e6-c2b8d2767813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8fa15b46ab460985c78ad0afbe0f8e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:53.354281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-303815e3-83fe-4962-b5e6-c2b8d2767813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8fa15b46ab460985c78ad0afbe0f8e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:53.370154 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-303815e3-83fe-4962-b5e6-c2b8d2767813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8fa15b46ab460985c78ad0afbe0f8e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:53.416397 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 911/1844] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:53 2022] DELETE /identity/v3/users/1f8fa15b46ab460985c78ad0afbe0f8e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:53.858324 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd68bd-94a2-45e2-b81b-60670eb97b7a service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:53.860215 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-24dd68bd-94a2-45e2-b81b-60670eb97b7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:53.884558 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303815e3-83fe-4962-b5e6-c2b8d2767813 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:53.886362 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-303815e3-83fe-4962-b5e6-c2b8d2767813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:53.895007 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd68bd-94a2-45e2-b81b-60670eb97b7a service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:53.977144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:54.002129 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88304c-a83f-44a1-a553-af012554c0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:54.002818 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88304c-a83f-44a1-a553-af012554c0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:54.003135 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88304c-a83f-44a1-a553-af012554c0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:54.003479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88304c-a83f-44a1-a553-af012554c0d4 admin admin] PATH_INFO: `/v3/projects/b85afdda40a046c6a04d3e4d47de1915` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:54.005594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88304c-a83f-44a1-a553-af012554c0d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85afdda40a046c6a04d3e4d47de1915)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:54.007945 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88304c-a83f-44a1-a553-af012554c0d4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:54.008133 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303815e3-83fe-4962-b5e6-c2b8d2767813 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:54.013932 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b125e0c-711a-4145-8da5-31907e4e31e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:54.014401 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b125e0c-711a-4145-8da5-31907e4e31e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:54.015406 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b125e0c-711a-4145-8da5-31907e4e31e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:54.015709 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b125e0c-711a-4145-8da5-31907e4e31e1 admin admin] PATH_INFO: `/v3/projects/84faeadb3ec44c1b849b186d7a280aa4` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:54.017394 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b125e0c-711a-4145-8da5-31907e4e31e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84faeadb3ec44c1b849b186d7a280aa4)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:54.020615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b125e0c-711a-4145-8da5-31907e4e31e1 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:54.068767 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4b88304c-a83f-44a1-a553-af012554c0d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85afdda40a046c6a04d3e4d47de1915', 'request_id': 'req-4b88304c-a83f-44a1-a553-af012554c0d4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.075660 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4b88304c-a83f-44a1-a553-af012554c0d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85afdda40a046c6a04d3e4d47de1915', 'request_id': 'req-4b88304c-a83f-44a1-a553-af012554c0d4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.083232 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4b88304c-a83f-44a1-a553-af012554c0d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85afdda40a046c6a04d3e4d47de1915', 'request_id': 'req-4b88304c-a83f-44a1-a553-af012554c0d4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.087873 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8b125e0c-711a-4145-8da5-31907e4e31e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84faeadb3ec44c1b849b186d7a280aa4', 'request_id': 'req-8b125e0c-711a-4145-8da5-31907e4e31e1'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.095499 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8b125e0c-711a-4145-8da5-31907e4e31e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84faeadb3ec44c1b849b186d7a280aa4', 'request_id': 'req-8b125e0c-711a-4145-8da5-31907e4e31e1'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.097215 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4b88304c-a83f-44a1-a553-af012554c0d4 admin admin] The token cache is being invalidate because project b85afdda40a046c6a04d3e4d47de1915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:56:54.097530 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4b88304c-a83f-44a1-a553-af012554c0d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.098374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4b88304c-a83f-44a1-a553-af012554c0d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.104862 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 934/1845] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:53 2022] DELETE /identity/v3/projects/b85afdda40a046c6a04d3e4d47de1915 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:54.106559 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88304c-a83f-44a1-a553-af012554c0d4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:54.108838 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4b88304c-a83f-44a1-a553-af012554c0d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:54.110775 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8b125e0c-711a-4145-8da5-31907e4e31e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84faeadb3ec44c1b849b186d7a280aa4', 'request_id': 'req-8b125e0c-711a-4145-8da5-31907e4e31e1'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.127276 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8b125e0c-711a-4145-8da5-31907e4e31e1 admin admin] The token cache is being invalidate because project 84faeadb3ec44c1b849b186d7a280aa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:56:54.129203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8b125e0c-711a-4145-8da5-31907e4e31e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.130176 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8b125e0c-711a-4145-8da5-31907e4e31e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.132480 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 912/1846] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:53 2022] DELETE /identity/v3/projects/84faeadb3ec44c1b849b186d7a280aa4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:54.133725 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b125e0c-711a-4145-8da5-31907e4e31e1 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:54.136340 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8b125e0c-711a-4145-8da5-31907e4e31e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:54.202285 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88304c-a83f-44a1-a553-af012554c0d4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:54.242634 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:54.250087 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b125e0c-711a-4145-8da5-31907e4e31e1 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:54.261343 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5107373-a7eb-4cfa-bc9f-72e0c7d71486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:54.262459 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5107373-a7eb-4cfa-bc9f-72e0c7d71486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:54.262750 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5107373-a7eb-4cfa-bc9f-72e0c7d71486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:54.263029 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5107373-a7eb-4cfa-bc9f-72e0c7d71486 admin admin] PATH_INFO: `/v3/users/edc85b92fd444d31a87f79e4dc8c2066` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:54.265631 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5107373-a7eb-4cfa-bc9f-72e0c7d71486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edc85b92fd444d31a87f79e4dc8c2066)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:54.270425 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5107373-a7eb-4cfa-bc9f-72e0c7d71486 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:54.339580 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e412d-86d9-4992-be9b-c4ba0d93b09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:54.340901 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e412d-86d9-4992-be9b-c4ba0d93b09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:54.341558 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e412d-86d9-4992-be9b-c4ba0d93b09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:54.341847 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e412d-86d9-4992-be9b-c4ba0d93b09e admin admin] PATH_INFO: `/v3/projects/bf73fb99315e454e9d00e0c2c9dc5a30` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:54.344398 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e412d-86d9-4992-be9b-c4ba0d93b09e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf73fb99315e454e9d00e0c2c9dc5a30)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:54.348014 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e412d-86d9-4992-be9b-c4ba0d93b09e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:54.354585 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f5107373-a7eb-4cfa-bc9f-72e0c7d71486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edc85b92fd444d31a87f79e4dc8c2066'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.355972 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f5107373-a7eb-4cfa-bc9f-72e0c7d71486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edc85b92fd444d31a87f79e4dc8c2066'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.368384 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f5107373-a7eb-4cfa-bc9f-72e0c7d71486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edc85b92fd444d31a87f79e4dc8c2066'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.369063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f5107373-a7eb-4cfa-bc9f-72e0c7d71486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edc85b92fd444d31a87f79e4dc8c2066'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.397253 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f5107373-a7eb-4cfa-bc9f-72e0c7d71486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edc85b92fd444d31a87f79e4dc8c2066'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.419213 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:54.433350 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 913/1847] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:54 2022] DELETE /identity/v3/users/edc85b92fd444d31a87f79e4dc8c2066 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:54.434281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5107373-a7eb-4cfa-bc9f-72e0c7d71486 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:54.437496 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f5107373-a7eb-4cfa-bc9f-72e0c7d71486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:54.478734 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0f7e412d-86d9-4992-be9b-c4ba0d93b09e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf73fb99315e454e9d00e0c2c9dc5a30', 'request_id': 'req-0f7e412d-86d9-4992-be9b-c4ba0d93b09e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.492288 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0f7e412d-86d9-4992-be9b-c4ba0d93b09e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf73fb99315e454e9d00e0c2c9dc5a30', 'request_id': 'req-0f7e412d-86d9-4992-be9b-c4ba0d93b09e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.503005 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0f7e412d-86d9-4992-be9b-c4ba0d93b09e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf73fb99315e454e9d00e0c2c9dc5a30', 'request_id': 'req-0f7e412d-86d9-4992-be9b-c4ba0d93b09e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.520234 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0f7e412d-86d9-4992-be9b-c4ba0d93b09e admin admin] The token cache is being invalidate because project bf73fb99315e454e9d00e0c2c9dc5a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:56:54.520712 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0f7e412d-86d9-4992-be9b-c4ba0d93b09e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.522146 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0f7e412d-86d9-4992-be9b-c4ba0d93b09e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.524028 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 935/1848] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:54 2022] DELETE /identity/v3/projects/bf73fb99315e454e9d00e0c2c9dc5a30 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:54.528849 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcb694-3d83-4bb0-8d65-0ddc659879d6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:54.529352 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcb694-3d83-4bb0-8d65-0ddc659879d6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:54.529817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcb694-3d83-4bb0-8d65-0ddc659879d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:54.541212 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5107373-a7eb-4cfa-bc9f-72e0c7d71486 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:54.553036 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003d835-eedf-401b-8855-51bfa91dc5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:54.553666 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003d835-eedf-401b-8855-51bfa91dc5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:54.553944 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003d835-eedf-401b-8855-51bfa91dc5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:54.554212 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003d835-eedf-401b-8855-51bfa91dc5aa admin admin] PATH_INFO: `/v3/users/9b12ab9c0399479690f82ffd9185a0b4` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:54.558789 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003d835-eedf-401b-8855-51bfa91dc5aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b12ab9c0399479690f82ffd9185a0b4)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:54.564746 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003d835-eedf-401b-8855-51bfa91dc5aa admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:54.568674 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c3fcb694-3d83-4bb0-8d65-0ddc659879d6 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:54.570034 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c3fcb694-3d83-4bb0-8d65-0ddc659879d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:54.584997 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 936/1849] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:56:54.590468 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd321b-a61a-4e1a-8c9c-759d3db0b27e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:54.591248 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd321b-a61a-4e1a-8c9c-759d3db0b27e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:54.591755 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd321b-a61a-4e1a-8c9c-759d3db0b27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:54.619452 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-12dd321b-a61a-4e1a-8c9c-759d3db0b27e None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:54.620586 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-12dd321b-a61a-4e1a-8c9c-759d3db0b27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:54.633502 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 937/1850] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:56:54.637224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd321b-a61a-4e1a-8c9c-759d3db0b27e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:54.653183 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd321b-a61a-4e1a-8c9c-759d3db0b27e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:54.660393 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c379551-e453-4d68-9664-1b690fe093b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:54.662529 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c379551-e453-4d68-9664-1b690fe093b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:54.662918 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c379551-e453-4d68-9664-1b690fe093b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:54.663297 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c379551-e453-4d68-9664-1b690fe093b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:54.664044 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c379551-e453-4d68-9664-1b690fe093b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:54.664257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7003d835-eedf-401b-8855-51bfa91dc5aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b12ab9c0399479690f82ffd9185a0b4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.664469 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c379551-e453-4d68-9664-1b690fe093b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:54.664930 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7003d835-eedf-401b-8855-51bfa91dc5aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b12ab9c0399479690f82ffd9185a0b4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.666636 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c379551-e453-4d68-9664-1b690fe093b6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:54.675740 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7003d835-eedf-401b-8855-51bfa91dc5aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b12ab9c0399479690f82ffd9185a0b4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.676737 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7003d835-eedf-401b-8855-51bfa91dc5aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b12ab9c0399479690f82ffd9185a0b4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.688186 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 938/1851] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:56:54.694344 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c379551-e453-4d68-9664-1b690fe093b6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:54.697584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4c379551-e453-4d68-9664-1b690fe093b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:54.701705 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7003d835-eedf-401b-8855-51bfa91dc5aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b12ab9c0399479690f82ffd9185a0b4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:54.720683 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c379551-e453-4d68-9664-1b690fe093b6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:54.730364 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e8f29-07b0-4541-9eed-15e4726742be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:54.731238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e8f29-07b0-4541-9eed-15e4726742be admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:54.731585 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e8f29-07b0-4541-9eed-15e4726742be admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:54.731976 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e8f29-07b0-4541-9eed-15e4726742be admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:54.732068 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 914/1852] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:54 2022] DELETE /identity/v3/users/9b12ab9c0399479690f82ffd9185a0b4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:54.733075 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e8f29-07b0-4541-9eed-15e4726742be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:54.735416 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e8f29-07b0-4541-9eed-15e4726742be admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:54.784605 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 939/1853] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:54 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:54.789547 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003d835-eedf-401b-8855-51bfa91dc5aa admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:54.913578 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003d835-eedf-401b-8855-51bfa91dc5aa admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:54.952779 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:55.090538 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633d807-61af-4dc4-be12-20f674a03e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:55.091725 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633d807-61af-4dc4-be12-20f674a03e7a admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:55.092266 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633d807-61af-4dc4-be12-20f674a03e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:55.092739 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633d807-61af-4dc4-be12-20f674a03e7a admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:55.093739 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633d807-61af-4dc4-be12-20f674a03e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:55.096752 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633d807-61af-4dc4-be12-20f674a03e7a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:55.127151 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 915/1854] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:54 2022] POST /identity/v3/users => generated 287 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:55.132931 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e8f29-07b0-4541-9eed-15e4726742be admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:55.156873 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e8f29-07b0-4541-9eed-15e4726742be admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:55.175502 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47225b16-24d1-4d6d-ab1a-87631b104dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:55.176205 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47225b16-24d1-4d6d-ab1a-87631b104dca admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:55.176700 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47225b16-24d1-4d6d-ab1a-87631b104dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:55.177058 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47225b16-24d1-4d6d-ab1a-87631b104dca admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:55.178139 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47225b16-24d1-4d6d-ab1a-87631b104dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:55.183545 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47225b16-24d1-4d6d-ab1a-87631b104dca admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:55.200397 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 940/1855] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:55.205814 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633d807-61af-4dc4-be12-20f674a03e7a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:55.218489 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633d807-61af-4dc4-be12-20f674a03e7a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:55.225814 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8fe21-925c-4242-9dad-6c8858026e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:55.227472 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8fe21-925c-4242-9dad-6c8858026e10 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:55.228542 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8fe21-925c-4242-9dad-6c8858026e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:55.228712 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8fe21-925c-4242-9dad-6c8858026e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:55.229670 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8fe21-925c-4242-9dad-6c8858026e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:55.233170 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8fe21-925c-4242-9dad-6c8858026e10 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:55.250889 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 916/1856] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:55.255746 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47225b16-24d1-4d6d-ab1a-87631b104dca admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:55.273307 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47225b16-24d1-4d6d-ab1a-87631b104dca admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:55.290388 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0041b4-f846-4183-91ad-e9920d70f7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:55.291490 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0041b4-f846-4183-91ad-e9920d70f7a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:55.291929 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0041b4-f846-4183-91ad-e9920d70f7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:55.292556 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0041b4-f846-4183-91ad-e9920d70f7a0 admin admin] PATH_INFO: `/v3/projects/4fb040a844e04cf8badb3735a3b0c384/users/6a6b95e33f154f3aa696a2fc21d04285/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:55.321697 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0041b4-f846-4183-91ad-e9920d70f7a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fb040a844e04cf8badb3735a3b0c384, user_id=6a6b95e33f154f3aa696a2fc21d04285, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:55.329932 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0041b4-f846-4183-91ad-e9920d70f7a0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:55.357000 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 941/1857] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:55 2022] PUT /identity/v3/projects/4fb040a844e04cf8badb3735a3b0c384/users/6a6b95e33f154f3aa696a2fc21d04285/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:55.369076 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dbe35-bd55-4e85-9afc-aa453b2691f4 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:55.369756 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dbe35-bd55-4e85-9afc-aa453b2691f4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:55.369756 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dbe35-bd55-4e85-9afc-aa453b2691f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:55.413806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-fd8dbe35-bd55-4e85-9afc-aa453b2691f4 None None] MFA Rules not processed for user `6a6b95e33f154f3aa696a2fc21d04285`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:55.416189 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fd8dbe35-bd55-4e85-9afc-aa453b2691f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:55.557465 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 917/1858] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:55.590174 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0041b4-f846-4183-91ad-e9920d70f7a0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:55.605680 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9d0041b4-f846-4183-91ad-e9920d70f7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:55.683419 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:55.730554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0041b4-f846-4183-91ad-e9920d70f7a0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:55.736164 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09564b-7c9e-4abc-96bf-b802a4770d9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:55.737081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09564b-7c9e-4abc-96bf-b802a4770d9d service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:55.738170 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09564b-7c9e-4abc-96bf-b802a4770d9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:55.738470 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09564b-7c9e-4abc-96bf-b802a4770d9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:55.748742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09564b-7c9e-4abc-96bf-b802a4770d9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:55.750343 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09564b-7c9e-4abc-96bf-b802a4770d9d service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:55.767660 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 942/1859] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:56:55.821097 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dbe35-bd55-4e85-9afc-aa453b2691f4 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:55.950021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dbe35-bd55-4e85-9afc-aa453b2691f4 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:55.957660 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c08f8-e50c-4247-842f-8e364a4e5ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:55.958338 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c08f8-e50c-4247-842f-8e364a4e5ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:55.958629 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c08f8-e50c-4247-842f-8e364a4e5ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:55.959005 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c08f8-e50c-4247-842f-8e364a4e5ce1 admin admin] PATH_INFO: `/v3/users/6a6b95e33f154f3aa696a2fc21d04285` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:55.961294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c08f8-e50c-4247-842f-8e364a4e5ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6b95e33f154f3aa696a2fc21d04285)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:55.963351 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c08f8-e50c-4247-842f-8e364a4e5ce1 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:56.046075 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:56.084150 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-146c08f8-e50c-4247-842f-8e364a4e5ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6b95e33f154f3aa696a2fc21d04285'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:56.085021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-146c08f8-e50c-4247-842f-8e364a4e5ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6b95e33f154f3aa696a2fc21d04285'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:56.095177 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-146c08f8-e50c-4247-842f-8e364a4e5ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6b95e33f154f3aa696a2fc21d04285'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:56.097128 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-146c08f8-e50c-4247-842f-8e364a4e5ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6b95e33f154f3aa696a2fc21d04285'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:56.112099 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-146c08f8-e50c-4247-842f-8e364a4e5ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6b95e33f154f3aa696a2fc21d04285'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:56.133965 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09564b-7c9e-4abc-96bf-b802a4770d9d service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:56.136479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3f09564b-7c9e-4abc-96bf-b802a4770d9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:56.164798 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 918/1860] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:55 2022] DELETE /identity/v3/users/6a6b95e33f154f3aa696a2fc21d04285 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:56.169692 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25582032-ce8d-420b-8a09-b13e2cdf1ec2 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:56.169977 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25582032-ce8d-420b-8a09-b13e2cdf1ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:56.170587 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25582032-ce8d-420b-8a09-b13e2cdf1ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:56.190514 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09564b-7c9e-4abc-96bf-b802a4770d9d service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:56.256916 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-25582032-ce8d-420b-8a09-b13e2cdf1ec2 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:56.260694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-25582032-ce8d-420b-8a09-b13e2cdf1ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:56.444313 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57eded-1f00-4b5f-9240-b8be3c0b841b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:56.447494 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57eded-1f00-4b5f-9240-b8be3c0b841b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:56.447844 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57eded-1f00-4b5f-9240-b8be3c0b841b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:56.448120 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57eded-1f00-4b5f-9240-b8be3c0b841b admin admin] PATH_INFO: `/v3/projects/9f3e2bc8eb0642e2b0be1b3e10473b36` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:56.453782 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57eded-1f00-4b5f-9240-b8be3c0b841b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3e2bc8eb0642e2b0be1b3e10473b36)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:56.469982 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57eded-1f00-4b5f-9240-b8be3c0b841b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:56.480756 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 919/1861] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:56.486480 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25582032-ce8d-420b-8a09-b13e2cdf1ec2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:56.488226 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-25582032-ce8d-420b-8a09-b13e2cdf1ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:56.590248 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7c57eded-1f00-4b5f-9240-b8be3c0b841b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3e2bc8eb0642e2b0be1b3e10473b36', 'request_id': 'req-7c57eded-1f00-4b5f-9240-b8be3c0b841b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:56.603713 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7c57eded-1f00-4b5f-9240-b8be3c0b841b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3e2bc8eb0642e2b0be1b3e10473b36', 'request_id': 'req-7c57eded-1f00-4b5f-9240-b8be3c0b841b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:56.621457 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7c57eded-1f00-4b5f-9240-b8be3c0b841b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3e2bc8eb0642e2b0be1b3e10473b36', 'request_id': 'req-7c57eded-1f00-4b5f-9240-b8be3c0b841b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:56.654555 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25582032-ce8d-420b-8a09-b13e2cdf1ec2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:56.655974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7c57eded-1f00-4b5f-9240-b8be3c0b841b admin admin] The token cache is being invalidate because project 9f3e2bc8eb0642e2b0be1b3e10473b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:56:56.656274 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7c57eded-1f00-4b5f-9240-b8be3c0b841b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:56.657068 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7c57eded-1f00-4b5f-9240-b8be3c0b841b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:56.665663 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 943/1862] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:56 2022] DELETE /identity/v3/projects/9f3e2bc8eb0642e2b0be1b3e10473b36 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:56.665663 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57eded-1f00-4b5f-9240-b8be3c0b841b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:56.665663 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7c57eded-1f00-4b5f-9240-b8be3c0b841b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:56.756794 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:56.763226 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57eded-1f00-4b5f-9240-b8be3c0b841b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:56.777200 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83caa4-6e0e-413d-9bc0-eb1ff336569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:56.778281 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83caa4-6e0e-413d-9bc0-eb1ff336569a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:56.778566 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83caa4-6e0e-413d-9bc0-eb1ff336569a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:56.778842 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83caa4-6e0e-413d-9bc0-eb1ff336569a admin admin] PATH_INFO: `/v3/projects/cf907518affd421ba11203039c82b070` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:56.780829 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83caa4-6e0e-413d-9bc0-eb1ff336569a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf907518affd421ba11203039c82b070)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:56.786760 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83caa4-6e0e-413d-9bc0-eb1ff336569a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:56.793358 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c4d53-34d8-4b81-8c7b-d9c14bbd0ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:56.794230 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c4d53-34d8-4b81-8c7b-d9c14bbd0ded service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:56.794686 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c4d53-34d8-4b81-8c7b-d9c14bbd0ded service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:56.795167 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c4d53-34d8-4b81-8c7b-d9c14bbd0ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:56.797766 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e45c4d53-34d8-4b81-8c7b-d9c14bbd0ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:56.820497 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c4d53-34d8-4b81-8c7b-d9c14bbd0ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:56.822215 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c4d53-34d8-4b81-8c7b-d9c14bbd0ded service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:56.835025 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 920/1863] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:56:56.836496 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebe240-7275-4415-ab9e-e274e58f489f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:56.836790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebe240-7275-4415-ab9e-e274e58f489f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:56.837149 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebe240-7275-4415-ab9e-e274e58f489f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:56.848136 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:56.873898 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-f9ebe240-7275-4415-ab9e-e274e58f489f None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:56.875172 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f9ebe240-7275-4415-ab9e-e274e58f489f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:56.915629 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 921/1864] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:56.918527 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c69e7a-4131-4704-b29e-d075729f42a8 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:56.918727 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c69e7a-4131-4704-b29e-d075729f42a8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:56.919062 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c69e7a-4131-4704-b29e-d075729f42a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:56.951405 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fd83caa4-6e0e-413d-9bc0-eb1ff336569a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf907518affd421ba11203039c82b070', 'request_id': 'req-fd83caa4-6e0e-413d-9bc0-eb1ff336569a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:56.967912 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fd83caa4-6e0e-413d-9bc0-eb1ff336569a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf907518affd421ba11203039c82b070', 'request_id': 'req-fd83caa4-6e0e-413d-9bc0-eb1ff336569a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:56.986417 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fd83caa4-6e0e-413d-9bc0-eb1ff336569a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf907518affd421ba11203039c82b070', 'request_id': 'req-fd83caa4-6e0e-413d-9bc0-eb1ff336569a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:57.007069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-84c69e7a-4131-4704-b29e-d075729f42a8 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:57.010430 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fd83caa4-6e0e-413d-9bc0-eb1ff336569a admin admin] The token cache is being invalidate because project cf907518affd421ba11203039c82b070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:56:57.011115 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-84c69e7a-4131-4704-b29e-d075729f42a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:57.013412 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fd83caa4-6e0e-413d-9bc0-eb1ff336569a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:57.014678 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fd83caa4-6e0e-413d-9bc0-eb1ff336569a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:57.028624 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 944/1865] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:56 2022] DELETE /identity/v3/projects/cf907518affd421ba11203039c82b070 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:57.034748 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa1f28-5fa8-463e-a9f9-47ce9613f2dd None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:57.035466 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa1f28-5fa8-463e-a9f9-47ce9613f2dd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:57.036886 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa1f28-5fa8-463e-a9f9-47ce9613f2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:57.089763 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-92aa1f28-5fa8-463e-a9f9-47ce9613f2dd None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:57.091015 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-92aa1f28-5fa8-463e-a9f9-47ce9613f2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:57.102069 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 922/1866] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:57.106945 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c69e7a-4131-4704-b29e-d075729f42a8 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:57.112532 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 945/1867] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:57.121623 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad3345-2c21-479d-89d5-882a24e4643f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:57.121902 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad3345-2c21-479d-89d5-882a24e4643f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:57.122182 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad3345-2c21-479d-89d5-882a24e4643f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:57.126792 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c69e7a-4131-4704-b29e-d075729f42a8 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:57.141452 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62a019-53f9-47cf-8ac4-45b3683cd2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:57.145257 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62a019-53f9-47cf-8ac4-45b3683cd2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:57.145650 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62a019-53f9-47cf-8ac4-45b3683cd2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:57.146039 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62a019-53f9-47cf-8ac4-45b3683cd2e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:57.147534 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62a019-53f9-47cf-8ac4-45b3683cd2e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:57.148008 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62a019-53f9-47cf-8ac4-45b3683cd2e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:57.153178 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62a019-53f9-47cf-8ac4-45b3683cd2e5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:57.155035 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5cad3345-2c21-479d-89d5-882a24e4643f None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:57.156842 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5cad3345-2c21-479d-89d5-882a24e4643f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:57.171308 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 946/1868] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:57.172311 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad3345-2c21-479d-89d5-882a24e4643f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:57.184913 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad3345-2c21-479d-89d5-882a24e4643f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:57.189265 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 923/1869] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:56:57.191671 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62a019-53f9-47cf-8ac4-45b3683cd2e5 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:57.206789 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac736b63-0ed2-4d61-803a-e18b593f4da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:57.215926 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac736b63-0ed2-4d61-803a-e18b593f4da8 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:57.220930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac736b63-0ed2-4d61-803a-e18b593f4da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:57.221816 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac736b63-0ed2-4d61-803a-e18b593f4da8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:57.226920 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62a019-53f9-47cf-8ac4-45b3683cd2e5 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:57.228428 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac736b63-0ed2-4d61-803a-e18b593f4da8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:57.228603 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac736b63-0ed2-4d61-803a-e18b593f4da8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:57.230261 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac736b63-0ed2-4d61-803a-e18b593f4da8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:57.239531 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae9a9a-dafc-44c5-8e0c-d790687def39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:57.243024 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae9a9a-dafc-44c5-8e0c-d790687def39 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:57.243427 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae9a9a-dafc-44c5-8e0c-d790687def39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:57.244271 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae9a9a-dafc-44c5-8e0c-d790687def39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:57.245264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae9a9a-dafc-44c5-8e0c-d790687def39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:57.247243 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae9a9a-dafc-44c5-8e0c-d790687def39 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:57.276344 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 947/1870] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:56:57.281287 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac736b63-0ed2-4d61-803a-e18b593f4da8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:57.297672 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac736b63-0ed2-4d61-803a-e18b593f4da8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:57.298918 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 924/1871] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:57 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:56:57.305483 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae9a9a-dafc-44c5-8e0c-d790687def39 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:57.473237 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e3a3f-c996-46b8-934f-f5e77a843e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:57.473961 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e3a3f-c996-46b8-934f-f5e77a843e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:57.474317 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e3a3f-c996-46b8-934f-f5e77a843e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:57.474595 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e3a3f-c996-46b8-934f-f5e77a843e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:57.475249 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e3a3f-c996-46b8-934f-f5e77a843e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:57.477246 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e3a3f-c996-46b8-934f-f5e77a843e47 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:57.530248 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae9a9a-dafc-44c5-8e0c-d790687def39 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:57.552710 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 948/1872] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:57 2022] POST /identity/v3/projects => generated 373 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:56:57.556275 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008f50d-46c1-4182-9e16-60c9518eae79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:57.556745 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e3a3f-c996-46b8-934f-f5e77a843e47 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:57.557810 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008f50d-46c1-4182-9e16-60c9518eae79 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:57.558101 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008f50d-46c1-4182-9e16-60c9518eae79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:57.558382 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008f50d-46c1-4182-9e16-60c9518eae79 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:57.565633 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008f50d-46c1-4182-9e16-60c9518eae79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:57.568991 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008f50d-46c1-4182-9e16-60c9518eae79 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:57.632836 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 925/1873] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:57 2022] POST /identity/v3/users => generated 294 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:57.637951 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008f50d-46c1-4182-9e16-60c9518eae79 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:57.688861 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008f50d-46c1-4182-9e16-60c9518eae79 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:57.720162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:57.769755 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e3a3f-c996-46b8-934f-f5e77a843e47 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:57.780803 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2dcb7-23e0-4957-8bb5-c6800ef92e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:57.781475 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2dcb7-23e0-4957-8bb5-c6800ef92e7d admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:57.781857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2dcb7-23e0-4957-8bb5-c6800ef92e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:57.782129 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2dcb7-23e0-4957-8bb5-c6800ef92e7d admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:57.782772 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2dcb7-23e0-4957-8bb5-c6800ef92e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:57.786228 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2dcb7-23e0-4957-8bb5-c6800ef92e7d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:57.818297 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:57.823999 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 949/1874] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:57 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:56:57.828429 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2dcb7-23e0-4957-8bb5-c6800ef92e7d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:57.830414 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a9b2dcb7-23e0-4957-8bb5-c6800ef92e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:57.830599 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ee8ae-43e9-4ba4-97c3-968d8ad85ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:57.831294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ee8ae-43e9-4ba4-97c3-968d8ad85ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:57.831582 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ee8ae-43e9-4ba4-97c3-968d8ad85ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:57.831861 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ee8ae-43e9-4ba4-97c3-968d8ad85ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:57.832800 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ee8ae-43e9-4ba4-97c3-968d8ad85ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:57.834344 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ee8ae-43e9-4ba4-97c3-968d8ad85ef7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:57.848662 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2dcb7-23e0-4957-8bb5-c6800ef92e7d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:57.854198 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af17a4-ee14-4a17-88f9-ba58f0f0fa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:57.855129 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af17a4-ee14-4a17-88f9-ba58f0f0fa64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:57.855257 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 926/1875] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:57.855352 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af17a4-ee14-4a17-88f9-ba58f0f0fa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:57.855725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af17a4-ee14-4a17-88f9-ba58f0f0fa64 admin admin] PATH_INFO: `/v3/users/1f0cba41c94f4a2ab4885997167d6679` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:57.856982 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af17a4-ee14-4a17-88f9-ba58f0f0fa64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f0cba41c94f4a2ab4885997167d6679)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:57.859680 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af17a4-ee14-4a17-88f9-ba58f0f0fa64 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:57.865504 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ee8ae-43e9-4ba4-97c3-968d8ad85ef7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:57.903657 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ee8ae-43e9-4ba4-97c3-968d8ad85ef7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:57.921738 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a69a18-1eff-4dd2-961f-c348e6626599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:57.922772 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a69a18-1eff-4dd2-961f-c348e6626599 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:57.923302 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a69a18-1eff-4dd2-961f-c348e6626599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:57.923790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a69a18-1eff-4dd2-961f-c348e6626599 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:57.925648 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a69a18-1eff-4dd2-961f-c348e6626599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:57.928818 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a69a18-1eff-4dd2-961f-c348e6626599 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:57.935966 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-09af17a4-ee14-4a17-88f9-ba58f0f0fa64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f0cba41c94f4a2ab4885997167d6679'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:57.936822 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-09af17a4-ee14-4a17-88f9-ba58f0f0fa64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f0cba41c94f4a2ab4885997167d6679'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:57.949863 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 927/1876] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:57.951573 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a69a18-1eff-4dd2-961f-c348e6626599 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:57.955761 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-09af17a4-ee14-4a17-88f9-ba58f0f0fa64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f0cba41c94f4a2ab4885997167d6679'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:57.956215 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f5a69a18-1eff-4dd2-961f-c348e6626599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:57.971737 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-09af17a4-ee14-4a17-88f9-ba58f0f0fa64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f0cba41c94f4a2ab4885997167d6679'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:57.973162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-09af17a4-ee14-4a17-88f9-ba58f0f0fa64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f0cba41c94f4a2ab4885997167d6679'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:57.988231 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a69a18-1eff-4dd2-961f-c348e6626599 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:57.997367 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 950/1877] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:56:57 2022] DELETE /identity/v3/users/1f0cba41c94f4a2ab4885997167d6679 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:57.999224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af17a4-ee14-4a17-88f9-ba58f0f0fa64 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:58.001421 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-09af17a4-ee14-4a17-88f9-ba58f0f0fa64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:58.005188 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57c36f-a252-4e9e-aad5-2f1d04168b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:58.006242 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57c36f-a252-4e9e-aad5-2f1d04168b1e admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:58.006805 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57c36f-a252-4e9e-aad5-2f1d04168b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:58.007312 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57c36f-a252-4e9e-aad5-2f1d04168b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:58.008599 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57c36f-a252-4e9e-aad5-2f1d04168b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:58.012079 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57c36f-a252-4e9e-aad5-2f1d04168b1e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:58.040984 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 928/1878] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:58.043480 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec00eef-0bba-4b1a-9d01-43a80b29baee None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:58.043983 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec00eef-0bba-4b1a-9d01-43a80b29baee None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:58.044721 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec00eef-0bba-4b1a-9d01-43a80b29baee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:58.104634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6ec00eef-0bba-4b1a-9d01-43a80b29baee None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:58.107923 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6ec00eef-0bba-4b1a-9d01-43a80b29baee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:58.174782 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af17a4-ee14-4a17-88f9-ba58f0f0fa64 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:58.193954 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558d72f-62a2-4604-af34-3d4425f75857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:58.194629 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558d72f-62a2-4604-af34-3d4425f75857 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:58.194921 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558d72f-62a2-4604-af34-3d4425f75857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:58.195180 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558d72f-62a2-4604-af34-3d4425f75857 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:58.195844 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558d72f-62a2-4604-af34-3d4425f75857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:58.197809 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558d72f-62a2-4604-af34-3d4425f75857 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:58.227086 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 951/1879] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:58.227086 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558d72f-62a2-4604-af34-3d4425f75857 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:58.239807 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558d72f-62a2-4604-af34-3d4425f75857 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:58.244800 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a7e4b-809d-4615-ab9f-7dbc0f44811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:58.245517 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a7e4b-809d-4615-ab9f-7dbc0f44811b admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:58.245975 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a7e4b-809d-4615-ab9f-7dbc0f44811b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:58.246278 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a7e4b-809d-4615-ab9f-7dbc0f44811b admin admin] PATH_INFO: `/v3/projects/9864e8c6a1ba46378721f4117f193e70/users/e0650deb4a004bcd91cafe1512f25278/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:58.255335 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 929/1880] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:58.256395 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec00eef-0bba-4b1a-9d01-43a80b29baee None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:58.267314 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec00eef-0bba-4b1a-9d01-43a80b29baee None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:58.273078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96c05b-7be3-421d-8ca3-42be83a318a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:58.273772 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96c05b-7be3-421d-8ca3-42be83a318a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:58.274059 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96c05b-7be3-421d-8ca3-42be83a318a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:58.274339 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96c05b-7be3-421d-8ca3-42be83a318a3 admin admin] PATH_INFO: `/v3/projects/1aff223229af423dabb6cf1589554a1c/users/7b9806fefa0042a380af7ac1175c53d7/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:58.276768 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a7e4b-809d-4615-ab9f-7dbc0f44811b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9864e8c6a1ba46378721f4117f193e70, user_id=e0650deb4a004bcd91cafe1512f25278, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:58.285328 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a7e4b-809d-4615-ab9f-7dbc0f44811b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:58.296408 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96c05b-7be3-421d-8ca3-42be83a318a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aff223229af423dabb6cf1589554a1c, user_id=7b9806fefa0042a380af7ac1175c53d7, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:58.300393 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96c05b-7be3-421d-8ca3-42be83a318a3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:58.318628 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 952/1881] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:58 2022] PUT /identity/v3/projects/9864e8c6a1ba46378721f4117f193e70/users/e0650deb4a004bcd91cafe1512f25278/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:58.319510 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 930/1882] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:58 2022] PUT /identity/v3/projects/1aff223229af423dabb6cf1589554a1c/users/7b9806fefa0042a380af7ac1175c53d7/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:58.324907 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2baaa-4634-4e28-8824-8d1d5ff76ecc None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:58.325223 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2baaa-4634-4e28-8824-8d1d5ff76ecc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:58.325496 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2baaa-4634-4e28-8824-8d1d5ff76ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:58.350499 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177faa8f-838b-4674-8f39-b17b626e6812 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:58.350775 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177faa8f-838b-4674-8f39-b17b626e6812 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:58.351060 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177faa8f-838b-4674-8f39-b17b626e6812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:58.369496 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c1a2baaa-4634-4e28-8824-8d1d5ff76ecc None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:58.370743 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c1a2baaa-4634-4e28-8824-8d1d5ff76ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:58.403708 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:58.422227 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-177faa8f-838b-4674-8f39-b17b626e6812 None None] MFA Rules not processed for user `e0650deb4a004bcd91cafe1512f25278`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:58.423973 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-177faa8f-838b-4674-8f39-b17b626e6812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:58.522661 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 953/1883] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:58.524277 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2baaa-4634-4e28-8824-8d1d5ff76ecc None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:58.526700 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c1a2baaa-4634-4e28-8824-8d1d5ff76ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:58.572837 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 931/1884] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:58.575782 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177faa8f-838b-4674-8f39-b17b626e6812 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:58.583279 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-177faa8f-838b-4674-8f39-b17b626e6812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:58.619950 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177faa8f-838b-4674-8f39-b17b626e6812 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:58.634951 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b83d5b-042d-430d-aaae-1d7f630d5ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:58.636880 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b83d5b-042d-430d-aaae-1d7f630d5ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:58.637442 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b83d5b-042d-430d-aaae-1d7f630d5ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:58.638009 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b83d5b-042d-430d-aaae-1d7f630d5ac9 admin admin] PATH_INFO: `/v3/projects/4fb040a844e04cf8badb3735a3b0c384` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:58.640125 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b83d5b-042d-430d-aaae-1d7f630d5ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fb040a844e04cf8badb3735a3b0c384)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:58.648315 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b83d5b-042d-430d-aaae-1d7f630d5ac9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:58.664669 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2baaa-4634-4e28-8824-8d1d5ff76ecc None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:58.672467 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e45703-ad3c-4db0-a2a8-00bbce0b2def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:58.673139 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e45703-ad3c-4db0-a2a8-00bbce0b2def service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:58.673421 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e45703-ad3c-4db0-a2a8-00bbce0b2def service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:58.673766 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e45703-ad3c-4db0-a2a8-00bbce0b2def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:58.697823 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e45703-ad3c-4db0-a2a8-00bbce0b2def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:58.702386 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e45703-ad3c-4db0-a2a8-00bbce0b2def service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:58.743097 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 954/1885] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:58.751456 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e45703-ad3c-4db0-a2a8-00bbce0b2def service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:58.763959 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:58.812789 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e45703-ad3c-4db0-a2a8-00bbce0b2def service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:58.831331 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f9b83d5b-042d-430d-aaae-1d7f630d5ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fb040a844e04cf8badb3735a3b0c384', 'request_id': 'req-f9b83d5b-042d-430d-aaae-1d7f630d5ac9'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:58.848380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f9b83d5b-042d-430d-aaae-1d7f630d5ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fb040a844e04cf8badb3735a3b0c384', 'request_id': 'req-f9b83d5b-042d-430d-aaae-1d7f630d5ac9'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:58.866396 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f9b83d5b-042d-430d-aaae-1d7f630d5ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fb040a844e04cf8badb3735a3b0c384', 'request_id': 'req-f9b83d5b-042d-430d-aaae-1d7f630d5ac9'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:58.890243 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f9b83d5b-042d-430d-aaae-1d7f630d5ac9 admin admin] The token cache is being invalidate because project 4fb040a844e04cf8badb3735a3b0c384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:56:58.893961 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f9b83d5b-042d-430d-aaae-1d7f630d5ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:58.895986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f9b83d5b-042d-430d-aaae-1d7f630d5ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:58.899404 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 932/1886] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:58 2022] DELETE /identity/v3/projects/4fb040a844e04cf8badb3735a3b0c384 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:58.900641 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b83d5b-042d-430d-aaae-1d7f630d5ac9 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:58.904159 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f9b83d5b-042d-430d-aaae-1d7f630d5ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:58.958454 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd803b-81a4-4154-9c13-417c2fc763b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:58.959147 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd803b-81a4-4154-9c13-417c2fc763b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:58.965386 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd803b-81a4-4154-9c13-417c2fc763b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:58.965812 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd803b-81a4-4154-9c13-417c2fc763b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:58.966374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd803b-81a4-4154-9c13-417c2fc763b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:58.968458 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd803b-81a4-4154-9c13-417c2fc763b8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:59.016634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b83d5b-042d-430d-aaae-1d7f630d5ac9 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:59.030549 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef914521-0e7f-4c96-92d3-b3681514622a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:59.033385 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef914521-0e7f-4c96-92d3-b3681514622a service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:59.034234 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef914521-0e7f-4c96-92d3-b3681514622a service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:59.034718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef914521-0e7f-4c96-92d3-b3681514622a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:59.035097 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 955/1887] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:58 2022] POST /identity/v3/projects => generated 385 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:59.038436 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028afc73-501d-4d0d-b97e-cdeeb2537d2b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:59.039030 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028afc73-501d-4d0d-b97e-cdeeb2537d2b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:59.039615 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028afc73-501d-4d0d-b97e-cdeeb2537d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:59.042332 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ef914521-0e7f-4c96-92d3-b3681514622a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:59.077080 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef914521-0e7f-4c96-92d3-b3681514622a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:59.081700 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef914521-0e7f-4c96-92d3-b3681514622a service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:59.081898 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-028afc73-501d-4d0d-b97e-cdeeb2537d2b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:59.083447 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-028afc73-501d-4d0d-b97e-cdeeb2537d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:59.106226 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 933/1888] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:56:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:56:59.107235 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef914521-0e7f-4c96-92d3-b3681514622a service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:59.109034 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ef914521-0e7f-4c96-92d3-b3681514622a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:59.122211 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef914521-0e7f-4c96-92d3-b3681514622a service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:59.170681 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:59.206992 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 956/1889] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:59.220617 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448b3bf-0e3d-44a1-8dad-43b35cc9a23b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:59.221862 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448b3bf-0e3d-44a1-8dad-43b35cc9a23b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:59.222374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448b3bf-0e3d-44a1-8dad-43b35cc9a23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:59.256895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0448b3bf-0e3d-44a1-8dad-43b35cc9a23b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:56:59.258192 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0448b3bf-0e3d-44a1-8dad-43b35cc9a23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:59.262570 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175e7c6-4718-4b99-a806-b2840a123c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:59.264264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175e7c6-4718-4b99-a806-b2840a123c9e admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:59.264850 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175e7c6-4718-4b99-a806-b2840a123c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:59.266895 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175e7c6-4718-4b99-a806-b2840a123c9e admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:59.268863 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175e7c6-4718-4b99-a806-b2840a123c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:59.271947 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 957/1890] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:56:59.276295 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175e7c6-4718-4b99-a806-b2840a123c9e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:59.277906 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448b3bf-0e3d-44a1-8dad-43b35cc9a23b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:59.292696 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448b3bf-0e3d-44a1-8dad-43b35cc9a23b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:59.304731 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607f624-07f2-4c62-ba49-4aa254cb5c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:59.305734 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607f624-07f2-4c62-ba49-4aa254cb5c6d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:59.306092 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607f624-07f2-4c62-ba49-4aa254cb5c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:59.307265 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607f624-07f2-4c62-ba49-4aa254cb5c6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:59.308569 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607f624-07f2-4c62-ba49-4aa254cb5c6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:56:59.308872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607f624-07f2-4c62-ba49-4aa254cb5c6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:59.312122 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607f624-07f2-4c62-ba49-4aa254cb5c6d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:59.351670 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 934/1891] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:59 2022] POST /identity/v3/users => generated 299 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:59.351900 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 958/1892] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:56:59.354736 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175e7c6-4718-4b99-a806-b2840a123c9e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:59.369051 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607f624-07f2-4c62-ba49-4aa254cb5c6d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:59.420007 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607f624-07f2-4c62-ba49-4aa254cb5c6d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:59.420794 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175e7c6-4718-4b99-a806-b2840a123c9e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:59.445343 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcca322-f765-4cf0-8c1d-33bd3ba44569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:59.447577 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcca322-f765-4cf0-8c1d-33bd3ba44569 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:59.450089 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcca322-f765-4cf0-8c1d-33bd3ba44569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:59.450320 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fa40b-1ee7-435e-b72b-5302790f6513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:59.450476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcca322-f765-4cf0-8c1d-33bd3ba44569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:59.451065 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcca322-f765-4cf0-8c1d-33bd3ba44569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:59.451204 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fa40b-1ee7-435e-b72b-5302790f6513 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:59.452528 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fa40b-1ee7-435e-b72b-5302790f6513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:59.458850 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcca322-f765-4cf0-8c1d-33bd3ba44569 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:59.459311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fa40b-1ee7-435e-b72b-5302790f6513 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:59.460352 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fa40b-1ee7-435e-b72b-5302790f6513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:59.463999 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fa40b-1ee7-435e-b72b-5302790f6513 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:59.488905 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 959/1893] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:59.493168 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcca322-f765-4cf0-8c1d-33bd3ba44569 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:59.520077 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcca322-f765-4cf0-8c1d-33bd3ba44569 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:59.529026 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58e678-add4-424d-8c1b-85de9e7de81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:59.530466 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58e678-add4-424d-8c1b-85de9e7de81e admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:59.531087 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58e678-add4-424d-8c1b-85de9e7de81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:59.531657 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58e678-add4-424d-8c1b-85de9e7de81e admin admin] PATH_INFO: `/v3/projects/68a626b3d73f4b0aaad2423cace11f2f/users/e95c1de0ad814cddad5dbfa843395acd/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:59.542662 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 935/1894] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:56:59 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:59.546724 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fa40b-1ee7-435e-b72b-5302790f6513 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:59.561194 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58e678-add4-424d-8c1b-85de9e7de81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a626b3d73f4b0aaad2423cace11f2f, user_id=e95c1de0ad814cddad5dbfa843395acd, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:59.564207 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58e678-add4-424d-8c1b-85de9e7de81e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:59.584167 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 960/1895] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:59 2022] PUT /identity/v3/projects/68a626b3d73f4b0aaad2423cace11f2f/users/e95c1de0ad814cddad5dbfa843395acd/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:59.589981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58e678-add4-424d-8c1b-85de9e7de81e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:59.602017 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:59.664920 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fa40b-1ee7-435e-b72b-5302790f6513 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:59.730854 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58e678-add4-424d-8c1b-85de9e7de81e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:59.737649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48381053-b8f5-4c92-8847-1f778efea0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:59.738498 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48381053-b8f5-4c92-8847-1f778efea0fe admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:59.738882 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48381053-b8f5-4c92-8847-1f778efea0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:59.739450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48381053-b8f5-4c92-8847-1f778efea0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:59.740409 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48381053-b8f5-4c92-8847-1f778efea0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:59.742204 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48381053-b8f5-4c92-8847-1f778efea0fe admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:59.761172 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 961/1896] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:56:59.761172 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48381053-b8f5-4c92-8847-1f778efea0fe admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:59.763690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-48381053-b8f5-4c92-8847-1f778efea0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:56:59.779934 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48381053-b8f5-4c92-8847-1f778efea0fe admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:59.783818 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004732d-bdff-4144-acaf-a1a7edb4f254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:59.784762 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004732d-bdff-4144-acaf-a1a7edb4f254 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:59.785102 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004732d-bdff-4144-acaf-a1a7edb4f254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:59.786151 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004732d-bdff-4144-acaf-a1a7edb4f254 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:59.787991 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ae714-d496-4fd5-bd1b-ced0775174ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:59.789053 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ae714-d496-4fd5-bd1b-ced0775174ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:59.789555 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ae714-d496-4fd5-bd1b-ced0775174ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:59.790595 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004732d-bdff-4144-acaf-a1a7edb4f254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:59.792893 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ae714-d496-4fd5-bd1b-ced0775174ad admin admin] PATH_INFO: `/v3/projects/d2dacfd0721a4671a3a907282798009a` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:59.795610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ae714-d496-4fd5-bd1b-ced0775174ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2dacfd0721a4671a3a907282798009a)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:59.795784 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004732d-bdff-4144-acaf-a1a7edb4f254 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:59.813785 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ae714-d496-4fd5-bd1b-ced0775174ad admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:59.859914 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 936/1897] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:56:59 2022] POST /identity/v3/users => generated 289 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:56:59.859914 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004732d-bdff-4144-acaf-a1a7edb4f254 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:59.900828 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004732d-bdff-4144-acaf-a1a7edb4f254 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:56:59.914166 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165e976-07e8-4ec7-9f34-fb56e3cae4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:56:59.914920 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165e976-07e8-4ec7-9f34-fb56e3cae4f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:56:59.915217 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165e976-07e8-4ec7-9f34-fb56e3cae4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:56:59.915495 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165e976-07e8-4ec7-9f34-fb56e3cae4f9 admin admin] PATH_INFO: `/v3/projects/68a626b3d73f4b0aaad2423cace11f2f/users/e95c1de0ad814cddad5dbfa843395acd/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:56:59.917735 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165e976-07e8-4ec7-9f34-fb56e3cae4f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a626b3d73f4b0aaad2423cace11f2f, user_id=e95c1de0ad814cddad5dbfa843395acd, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:56:59.920573 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165e976-07e8-4ec7-9f34-fb56e3cae4f9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:56:59.948634 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-151ae714-d496-4fd5-bd1b-ced0775174ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2dacfd0721a4671a3a907282798009a', 'request_id': 'req-151ae714-d496-4fd5-bd1b-ced0775174ad'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:59.949282 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 937/1898] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:56:59 2022] PUT /identity/v3/projects/68a626b3d73f4b0aaad2423cace11f2f/users/e95c1de0ad814cddad5dbfa843395acd/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:56:59.950398 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165e976-07e8-4ec7-9f34-fb56e3cae4f9 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:56:59.962674 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-151ae714-d496-4fd5-bd1b-ced0775174ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2dacfd0721a4671a3a907282798009a', 'request_id': 'req-151ae714-d496-4fd5-bd1b-ced0775174ad'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:56:59.977752 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-151ae714-d496-4fd5-bd1b-ced0775174ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2dacfd0721a4671a3a907282798009a', 'request_id': 'req-151ae714-d496-4fd5-bd1b-ced0775174ad'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:00.000248 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-151ae714-d496-4fd5-bd1b-ced0775174ad admin admin] The token cache is being invalidate because project d2dacfd0721a4671a3a907282798009a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:00.000585 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-151ae714-d496-4fd5-bd1b-ced0775174ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:00.001330 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-151ae714-d496-4fd5-bd1b-ced0775174ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:00.007022 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 962/1899] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:56:59 2022] DELETE /identity/v3/projects/d2dacfd0721a4671a3a907282798009a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:00.009425 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27338f-87bc-49d2-97a7-2deea81a0381 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:00.009814 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27338f-87bc-49d2-97a7-2deea81a0381 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:00.010161 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27338f-87bc-49d2-97a7-2deea81a0381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:00.041211 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:00.052293 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-fb27338f-87bc-49d2-97a7-2deea81a0381 None None] MFA Rules not processed for user `e95c1de0ad814cddad5dbfa843395acd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:00.053697 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fb27338f-87bc-49d2-97a7-2deea81a0381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:00.132762 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165e976-07e8-4ec7-9f34-fb56e3cae4f9 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:00.148012 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc121f59-a892-4fd0-8270-ec96a15eb957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:00.148384 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc121f59-a892-4fd0-8270-ec96a15eb957 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:00.148673 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc121f59-a892-4fd0-8270-ec96a15eb957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:00.149034 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc121f59-a892-4fd0-8270-ec96a15eb957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:00.150267 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc121f59-a892-4fd0-8270-ec96a15eb957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:00.151958 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc121f59-a892-4fd0-8270-ec96a15eb957 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:00.164615 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 938/1900] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:00.165717 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc121f59-a892-4fd0-8270-ec96a15eb957 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:00.169966 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fc121f59-a892-4fd0-8270-ec96a15eb957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:00.186477 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc121f59-a892-4fd0-8270-ec96a15eb957 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:00.193668 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2692510-2bc3-44a8-9b16-e86aa4889752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:00.194330 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2692510-2bc3-44a8-9b16-e86aa4889752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:00.194615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2692510-2bc3-44a8-9b16-e86aa4889752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:00.194894 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2692510-2bc3-44a8-9b16-e86aa4889752 admin admin] PATH_INFO: `/v3/users/57dab5fd1987404c9d1324f6b870f084` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:00.196297 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2692510-2bc3-44a8-9b16-e86aa4889752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57dab5fd1987404c9d1324f6b870f084)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:00.198307 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2692510-2bc3-44a8-9b16-e86aa4889752 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:00.216664 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 963/1901] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:00.219314 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27338f-87bc-49d2-97a7-2deea81a0381 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:00.228522 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fb27338f-87bc-49d2-97a7-2deea81a0381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:00.257557 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27338f-87bc-49d2-97a7-2deea81a0381 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:00.266429 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d680f4-d39a-42f7-8443-32060ac66869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:00.267429 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d680f4-d39a-42f7-8443-32060ac66869 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:00.267828 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d680f4-d39a-42f7-8443-32060ac66869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:00.268846 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d680f4-d39a-42f7-8443-32060ac66869 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:00.269903 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d680f4-d39a-42f7-8443-32060ac66869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:00.272745 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d680f4-d39a-42f7-8443-32060ac66869 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:00.282986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:00.294825 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a2692510-2bc3-44a8-9b16-e86aa4889752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57dab5fd1987404c9d1324f6b870f084'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:00.296689 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a2692510-2bc3-44a8-9b16-e86aa4889752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57dab5fd1987404c9d1324f6b870f084'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:00.302336 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 964/1902] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:00.303439 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d680f4-d39a-42f7-8443-32060ac66869 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:00.306611 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-26d680f4-d39a-42f7-8443-32060ac66869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:00.318873 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a2692510-2bc3-44a8-9b16-e86aa4889752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57dab5fd1987404c9d1324f6b870f084'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:00.320240 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a2692510-2bc3-44a8-9b16-e86aa4889752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57dab5fd1987404c9d1324f6b870f084'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:00.336963 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a2692510-2bc3-44a8-9b16-e86aa4889752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57dab5fd1987404c9d1324f6b870f084'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:00.373781 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 939/1903] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:00 2022] DELETE /identity/v3/users/57dab5fd1987404c9d1324f6b870f084 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:00.373781 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2692510-2bc3-44a8-9b16-e86aa4889752 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:00.389865 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a2692510-2bc3-44a8-9b16-e86aa4889752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:00.419061 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d680f4-d39a-42f7-8443-32060ac66869 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:00.508487 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c379f5-c56d-4a06-9ed6-d69353d04664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:00.509312 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c379f5-c56d-4a06-9ed6-d69353d04664 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:00.509634 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c379f5-c56d-4a06-9ed6-d69353d04664 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:00.509943 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c379f5-c56d-4a06-9ed6-d69353d04664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:00.512530 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b0c379f5-c56d-4a06-9ed6-d69353d04664 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:00.594395 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2692510-2bc3-44a8-9b16-e86aa4889752 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:00.603255 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be691b3f-3662-4c46-8ae5-4d93f47942dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:00.604022 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be691b3f-3662-4c46-8ae5-4d93f47942dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:00.605264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be691b3f-3662-4c46-8ae5-4d93f47942dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:00.607816 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be691b3f-3662-4c46-8ae5-4d93f47942dc admin admin] PATH_INFO: `/v3/projects/7be9a82f8cb1434cb67bbfafbea88101/users/4062097df37c4e079b8d0cd4412e5b57/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:00.641886 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be691b3f-3662-4c46-8ae5-4d93f47942dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be9a82f8cb1434cb67bbfafbea88101, user_id=4062097df37c4e079b8d0cd4412e5b57, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:00.646417 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be691b3f-3662-4c46-8ae5-4d93f47942dc admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:00.648236 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:00.679555 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 940/1904] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:00 2022] PUT /identity/v3/projects/7be9a82f8cb1434cb67bbfafbea88101/users/4062097df37c4e079b8d0cd4412e5b57/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:00.690852 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c379f5-c56d-4a06-9ed6-d69353d04664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:00.690852 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c379f5-c56d-4a06-9ed6-d69353d04664 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:00.695242 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b3808-6e3a-4ffc-a452-2a13de19641d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:00.695916 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b3808-6e3a-4ffc-a452-2a13de19641d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:00.696438 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b3808-6e3a-4ffc-a452-2a13de19641d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:00.711448 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 965/1905] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:00.713261 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5f905-a8f8-4b88-be0a-f0e369a686b3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:00.713673 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5f905-a8f8-4b88-be0a-f0e369a686b3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:00.714249 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5f905-a8f8-4b88-be0a-f0e369a686b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:00.771500 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-600b3808-6e3a-4ffc-a452-2a13de19641d None None] MFA Rules not processed for user `4062097df37c4e079b8d0cd4412e5b57`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:00.772777 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-600b3808-6e3a-4ffc-a452-2a13de19641d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:00.790184 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-85c5f905-a8f8-4b88-be0a-f0e369a686b3 None None] MFA Rules not processed for user `7b9806fefa0042a380af7ac1175c53d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:00.791606 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-85c5f905-a8f8-4b88-be0a-f0e369a686b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:00.956809 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 966/1906] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:00.958383 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5f905-a8f8-4b88-be0a-f0e369a686b3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:00.960054 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-85c5f905-a8f8-4b88-be0a-f0e369a686b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:00.969050 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 941/1907] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:00.975419 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b3808-6e3a-4ffc-a452-2a13de19641d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:00.976973 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-600b3808-6e3a-4ffc-a452-2a13de19641d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:01.095491 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:01.135524 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5f905-a8f8-4b88-be0a-f0e369a686b3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:01.145403 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ddc86-8ee0-4d81-a029-539eea362f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:01.145403 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ddc86-8ee0-4d81-a029-539eea362f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:01.145403 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ddc86-8ee0-4d81-a029-539eea362f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:01.145403 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ddc86-8ee0-4d81-a029-539eea362f20 admin admin] PATH_INFO: `/v3/users/e0650deb4a004bcd91cafe1512f25278` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:01.146481 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ddc86-8ee0-4d81-a029-539eea362f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0650deb4a004bcd91cafe1512f25278)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:01.149863 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ddc86-8ee0-4d81-a029-539eea362f20 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:01.162313 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b3808-6e3a-4ffc-a452-2a13de19641d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:01.169384 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4eb27-2e27-4840-82f0-6b236c4de7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:01.170051 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4eb27-2e27-4840-82f0-6b236c4de7ed admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:01.170354 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4eb27-2e27-4840-82f0-6b236c4de7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:01.170558 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4eb27-2e27-4840-82f0-6b236c4de7ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:01.171332 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4eb27-2e27-4840-82f0-6b236c4de7ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:01.174603 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4eb27-2e27-4840-82f0-6b236c4de7ed admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:01.218578 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 942/1908] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:00 2022] POST /identity/v3/projects => generated 371 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:57:01.219713 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4eb27-2e27-4840-82f0-6b236c4de7ed admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:01.229714 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f19ddc86-8ee0-4d81-a029-539eea362f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0650deb4a004bcd91cafe1512f25278'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:01.231647 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f19ddc86-8ee0-4d81-a029-539eea362f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0650deb4a004bcd91cafe1512f25278'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:01.249405 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f19ddc86-8ee0-4d81-a029-539eea362f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0650deb4a004bcd91cafe1512f25278'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:01.263288 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f19ddc86-8ee0-4d81-a029-539eea362f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0650deb4a004bcd91cafe1512f25278'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:01.264768 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f19ddc86-8ee0-4d81-a029-539eea362f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0650deb4a004bcd91cafe1512f25278'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:01.285327 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:01.300308 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 967/1909] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:00 2022] DELETE /identity/v3/users/e0650deb4a004bcd91cafe1512f25278 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:01.300308 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ddc86-8ee0-4d81-a029-539eea362f20 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:01.302191 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f19ddc86-8ee0-4d81-a029-539eea362f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:01.363808 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4eb27-2e27-4840-82f0-6b236c4de7ed admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:01.436695 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ddc86-8ee0-4d81-a029-539eea362f20 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:01.445014 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b187f-6ca6-47d6-9be0-83480e3d4204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:01.446685 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b187f-6ca6-47d6-9be0-83480e3d4204 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:01.446685 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b187f-6ca6-47d6-9be0-83480e3d4204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:01.446930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b187f-6ca6-47d6-9be0-83480e3d4204 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:01.448252 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b187f-6ca6-47d6-9be0-83480e3d4204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:01.452779 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b187f-6ca6-47d6-9be0-83480e3d4204 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:01.494692 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 968/1910] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:01 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:01.505831 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153528d-471a-4268-83af-a3029de90be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:01.506944 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153528d-471a-4268-83af-a3029de90be7 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:01.507207 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879f32a-7f85-4962-88b1-dfadadce85e6 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:01.507588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879f32a-7f85-4962-88b1-dfadadce85e6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:01.507777 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153528d-471a-4268-83af-a3029de90be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:01.507882 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879f32a-7f85-4962-88b1-dfadadce85e6 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:01.509501 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 969/1911] 10.222.0.26 () {54 vars in 921 bytes} [Sun Oct 2 00:57:01 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:57:01.510068 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153528d-471a-4268-83af-a3029de90be7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:01.510527 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe5c2c-a608-402b-9546-0ad8efa18afb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:01.510805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe5c2c-a608-402b-9546-0ad8efa18afb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:01.511082 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe5c2c-a608-402b-9546-0ad8efa18afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:01.511922 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153528d-471a-4268-83af-a3029de90be7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:01.515213 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153528d-471a-4268-83af-a3029de90be7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:01.574259 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3efe5c2c-a608-402b-9546-0ad8efa18afb None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:01.579258 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3efe5c2c-a608-402b-9546-0ad8efa18afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:01.618949 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 943/1912] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:01 2022] POST /identity/v3/projects => generated 377 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:01.625919 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153528d-471a-4268-83af-a3029de90be7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:01.630154 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 970/1913] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:01.631819 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b0027-fda8-420e-a839-8837197b70dd None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:01.632115 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b0027-fda8-420e-a839-8837197b70dd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:01.634702 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b0027-fda8-420e-a839-8837197b70dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:01.682130 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-409b0027-fda8-420e-a839-8837197b70dd None None] MFA Rules not processed for user `81e0396b7ba341ce8d02b1a149786d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:01.683414 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-409b0027-fda8-420e-a839-8837197b70dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:01.730076 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:01.764890 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153528d-471a-4268-83af-a3029de90be7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:01.778368 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80156b-a2bd-4ed5-88a1-74378efaae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:01.781275 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80156b-a2bd-4ed5-88a1-74378efaae07 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:01.781886 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80156b-a2bd-4ed5-88a1-74378efaae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:01.782404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80156b-a2bd-4ed5-88a1-74378efaae07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:01.783686 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80156b-a2bd-4ed5-88a1-74378efaae07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:01.786112 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80156b-a2bd-4ed5-88a1-74378efaae07 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:01.802985 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 944/1914] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:01.804250 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80156b-a2bd-4ed5-88a1-74378efaae07 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:01.807832 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9b80156b-a2bd-4ed5-88a1-74378efaae07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:01.822770 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 971/1915] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Oct 2 00:57:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:01.824848 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80156b-a2bd-4ed5-88a1-74378efaae07 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:01.825198 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b0027-fda8-420e-a839-8837197b70dd None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:01.828863 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-409b0027-fda8-420e-a839-8837197b70dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:01.833690 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632f5ff-ae4c-4b33-8e0c-12bf7d747d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:01.835395 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632f5ff-ae4c-4b33-8e0c-12bf7d747d63 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:01.835712 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632f5ff-ae4c-4b33-8e0c-12bf7d747d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:01.835994 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632f5ff-ae4c-4b33-8e0c-12bf7d747d63 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:01.836780 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632f5ff-ae4c-4b33-8e0c-12bf7d747d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:01.839518 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632f5ff-ae4c-4b33-8e0c-12bf7d747d63 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:01.864172 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b0027-fda8-420e-a839-8837197b70dd None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:01.873690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a20c46-63f1-4a5f-a2b3-b2325ba16a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:01.874364 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a20c46-63f1-4a5f-a2b3-b2325ba16a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:01.874649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a20c46-63f1-4a5f-a2b3-b2325ba16a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:01.874921 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a20c46-63f1-4a5f-a2b3-b2325ba16a93 admin admin] PATH_INFO: `/v3/projects/0f2d31c71a0e4d25946abdeeac0b36b6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:01.876239 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 945/1916] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:01 2022] POST /identity/v3/users => generated 289 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:01.876385 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a20c46-63f1-4a5f-a2b3-b2325ba16a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f2d31c71a0e4d25946abdeeac0b36b6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:01.878838 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a20c46-63f1-4a5f-a2b3-b2325ba16a93 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:01.882288 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632f5ff-ae4c-4b33-8e0c-12bf7d747d63 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:01.884634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3632f5ff-ae4c-4b33-8e0c-12bf7d747d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:01.945548 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-08a20c46-63f1-4a5f-a2b3-b2325ba16a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f2d31c71a0e4d25946abdeeac0b36b6', 'request_id': 'req-08a20c46-63f1-4a5f-a2b3-b2325ba16a93'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:01.956825 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-08a20c46-63f1-4a5f-a2b3-b2325ba16a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f2d31c71a0e4d25946abdeeac0b36b6', 'request_id': 'req-08a20c46-63f1-4a5f-a2b3-b2325ba16a93'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:01.972622 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-08a20c46-63f1-4a5f-a2b3-b2325ba16a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f2d31c71a0e4d25946abdeeac0b36b6', 'request_id': 'req-08a20c46-63f1-4a5f-a2b3-b2325ba16a93'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:01.984652 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:01.993493 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-08a20c46-63f1-4a5f-a2b3-b2325ba16a93 admin admin] The token cache is being invalidate because project 0f2d31c71a0e4d25946abdeeac0b36b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:01.993906 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-08a20c46-63f1-4a5f-a2b3-b2325ba16a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:01.995025 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-08a20c46-63f1-4a5f-a2b3-b2325ba16a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:02.001079 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 972/1917] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:01 2022] DELETE /identity/v3/projects/0f2d31c71a0e4d25946abdeeac0b36b6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:02.001386 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632f5ff-ae4c-4b33-8e0c-12bf7d747d63 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:02.007841 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a20c46-63f1-4a5f-a2b3-b2325ba16a93 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:02.015120 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-08a20c46-63f1-4a5f-a2b3-b2325ba16a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:02.084191 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25ab0d-b481-46d5-93e9-b2f8846e9b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:02.086600 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25ab0d-b481-46d5-93e9-b2f8846e9b1c service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:02.087487 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25ab0d-b481-46d5-93e9-b2f8846e9b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:02.088181 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25ab0d-b481-46d5-93e9-b2f8846e9b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:02.093352 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4c25ab0d-b481-46d5-93e9-b2f8846e9b1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:02.165294 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a20c46-63f1-4a5f-a2b3-b2325ba16a93 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:02.174850 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460d696-fd9b-4c50-a8da-2bae751128e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:02.177067 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460d696-fd9b-4c50-a8da-2bae751128e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:02.177067 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460d696-fd9b-4c50-a8da-2bae751128e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:02.177067 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460d696-fd9b-4c50-a8da-2bae751128e8 admin admin] PATH_INFO: `/v3/projects/4ead470e64214a4dbc518c60f2c192cf/users/43cc9c07797a4524b00b11e7eedc78ce/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:02.201465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460d696-fd9b-4c50-a8da-2bae751128e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ead470e64214a4dbc518c60f2c192cf, user_id=43cc9c07797a4524b00b11e7eedc78ce, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:02.204533 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460d696-fd9b-4c50-a8da-2bae751128e8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:02.228809 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 973/1918] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:02 2022] PUT /identity/v3/projects/4ead470e64214a4dbc518c60f2c192cf/users/43cc9c07797a4524b00b11e7eedc78ce/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:02.230019 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460d696-fd9b-4c50-a8da-2bae751128e8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:02.232311 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0460d696-fd9b-4c50-a8da-2bae751128e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:02.267482 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25ab0d-b481-46d5-93e9-b2f8846e9b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:02.270187 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25ab0d-b481-46d5-93e9-b2f8846e9b1c service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:02.282316 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 946/1919] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:02.283580 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25ab0d-b481-46d5-93e9-b2f8846e9b1c service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:02.285358 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4c25ab0d-b481-46d5-93e9-b2f8846e9b1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:02.367995 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:02.422788 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460d696-fd9b-4c50-a8da-2bae751128e8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:02.429292 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705652f-1367-4c72-881f-80ddf2bbf21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:02.430030 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705652f-1367-4c72-881f-80ddf2bbf21a admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:02.434304 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705652f-1367-4c72-881f-80ddf2bbf21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:02.434304 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705652f-1367-4c72-881f-80ddf2bbf21a admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:02.434304 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705652f-1367-4c72-881f-80ddf2bbf21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:02.434304 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705652f-1367-4c72-881f-80ddf2bbf21a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:02.449854 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 974/1920] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:02.450705 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af9746-deda-4b80-af88-939e86664119 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:02.451064 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af9746-deda-4b80-af88-939e86664119 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:02.451332 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af9746-deda-4b80-af88-939e86664119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:02.471547 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25ab0d-b481-46d5-93e9-b2f8846e9b1c service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:02.498134 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-97af9746-deda-4b80-af88-939e86664119 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:02.516896 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-97af9746-deda-4b80-af88-939e86664119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:02.557124 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 975/1921] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:02.558496 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af9746-deda-4b80-af88-939e86664119 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:02.586094 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af9746-deda-4b80-af88-939e86664119 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:02.600967 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7565eb-2291-4848-b865-92898b819f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:02.600967 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7565eb-2291-4848-b865-92898b819f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:02.600967 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7565eb-2291-4848-b865-92898b819f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:02.601498 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7565eb-2291-4848-b865-92898b819f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:02.603406 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3cc88-ce3d-4205-bd73-1a378da9575c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:02.604044 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3cc88-ce3d-4205-bd73-1a378da9575c service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:02.604327 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3cc88-ce3d-4205-bd73-1a378da9575c service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:02.604479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7565eb-2291-4848-b865-92898b819f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:02.604614 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3cc88-ce3d-4205-bd73-1a378da9575c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:02.607260 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6bc3cc88-ce3d-4205-bd73-1a378da9575c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:02.607492 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7565eb-2291-4848-b865-92898b819f6f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:02.638923 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 976/1922] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:02.641994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7565eb-2291-4848-b865-92898b819f6f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:02.643421 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3cc88-ce3d-4205-bd73-1a378da9575c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:02.648845 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3cc88-ce3d-4205-bd73-1a378da9575c service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:02.669300 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7565eb-2291-4848-b865-92898b819f6f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:02.670628 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 947/1923] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:02.684353 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25d387-58a9-4bcb-b9bb-e500ddffde0e None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:02.684672 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25d387-58a9-4bcb-b9bb-e500ddffde0e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:02.685281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25d387-58a9-4bcb-b9bb-e500ddffde0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:02.695040 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6dbdf1-397d-4381-8386-db8d11c7d06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:02.702952 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dbdf1-397d-4381-8386-db8d11c7d06f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:02.703746 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dbdf1-397d-4381-8386-db8d11c7d06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:02.706896 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dbdf1-397d-4381-8386-db8d11c7d06f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:02.711813 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6dbdf1-397d-4381-8386-db8d11c7d06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:02.716894 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6dbdf1-397d-4381-8386-db8d11c7d06f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:02.748663 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 977/1924] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:02.751387 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6e25d387-58a9-4bcb-b9bb-e500ddffde0e None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:02.753546 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6e25d387-58a9-4bcb-b9bb-e500ddffde0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:02.754915 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6dbdf1-397d-4381-8386-db8d11c7d06f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:02.765797 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 948/1925] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:02.769505 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25d387-58a9-4bcb-b9bb-e500ddffde0e None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:02.792445 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6dbdf1-397d-4381-8386-db8d11c7d06f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:02.800996 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25d387-58a9-4bcb-b9bb-e500ddffde0e None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:02.815430 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ecf4b-17be-4ee6-bc13-abd4310c7f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:02.818678 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ecf4b-17be-4ee6-bc13-abd4310c7f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:02.818678 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ecf4b-17be-4ee6-bc13-abd4310c7f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:02.818678 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ecf4b-17be-4ee6-bc13-abd4310c7f5b admin admin] PATH_INFO: `/v3/projects/4ead470e64214a4dbc518c60f2c192cf/users/43cc9c07797a4524b00b11e7eedc78ce/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:02.819238 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53563d2-7fa8-4efa-864b-f57bc4ab682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:02.819727 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53563d2-7fa8-4efa-864b-f57bc4ab682d admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:02.820210 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53563d2-7fa8-4efa-864b-f57bc4ab682d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:02.824100 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ecf4b-17be-4ee6-bc13-abd4310c7f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ead470e64214a4dbc518c60f2c192cf, user_id=43cc9c07797a4524b00b11e7eedc78ce, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:02.824783 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53563d2-7fa8-4efa-864b-f57bc4ab682d admin admin] PATH_INFO: `/v3/projects/2b48d4ce33f641c096d078a2c5740fe0/users/539e2b9ae7ed4cfa952a5376aed9a6b6/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:02.828540 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ecf4b-17be-4ee6-bc13-abd4310c7f5b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:02.859484 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 978/1926] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:02 2022] PUT /identity/v3/projects/4ead470e64214a4dbc518c60f2c192cf/users/43cc9c07797a4524b00b11e7eedc78ce/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:02.862084 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ecf4b-17be-4ee6-bc13-abd4310c7f5b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:02.872266 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53563d2-7fa8-4efa-864b-f57bc4ab682d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b48d4ce33f641c096d078a2c5740fe0, user_id=539e2b9ae7ed4cfa952a5376aed9a6b6, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:02.878639 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53563d2-7fa8-4efa-864b-f57bc4ab682d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:02.947896 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 949/1927] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:02 2022] PUT /identity/v3/projects/2b48d4ce33f641c096d078a2c5740fe0/users/539e2b9ae7ed4cfa952a5376aed9a6b6/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:02.949666 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a536e6-52aa-43fc-8fd5-737a0ac657d6 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:02.958040 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a536e6-52aa-43fc-8fd5-737a0ac657d6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:02.961140 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a536e6-52aa-43fc-8fd5-737a0ac657d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:03.030200 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:03.055559 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e0a536e6-52aa-43fc-8fd5-737a0ac657d6 None None] MFA Rules not processed for user `539e2b9ae7ed4cfa952a5376aed9a6b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:03.063324 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e0a536e6-52aa-43fc-8fd5-737a0ac657d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:03.108903 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ecf4b-17be-4ee6-bc13-abd4310c7f5b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:03.181865 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 950/1928] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:03.182811 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a536e6-52aa-43fc-8fd5-737a0ac657d6 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:03.184113 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e0a536e6-52aa-43fc-8fd5-737a0ac657d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:03.193654 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bd5cf-07ec-4f08-88f5-b56290ef9882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:03.194371 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bd5cf-07ec-4f08-88f5-b56290ef9882 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:03.194841 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bd5cf-07ec-4f08-88f5-b56290ef9882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:03.195118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bd5cf-07ec-4f08-88f5-b56290ef9882 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:03.196302 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bd5cf-07ec-4f08-88f5-b56290ef9882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:57:03.196669 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bd5cf-07ec-4f08-88f5-b56290ef9882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:03.198875 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bd5cf-07ec-4f08-88f5-b56290ef9882 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:03.206244 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:03.218926 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 979/1929] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:57:03.219860 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bd5cf-07ec-4f08-88f5-b56290ef9882 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:03.247023 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bd5cf-07ec-4f08-88f5-b56290ef9882 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:03.253890 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dc7be-e7e4-437a-a97f-efa2fb927121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:03.254518 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dc7be-e7e4-437a-a97f-efa2fb927121 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:03.254796 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dc7be-e7e4-437a-a97f-efa2fb927121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:03.255083 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dc7be-e7e4-437a-a97f-efa2fb927121 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:03.255697 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dc7be-e7e4-437a-a97f-efa2fb927121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:03.257763 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dc7be-e7e4-437a-a97f-efa2fb927121 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:03.292463 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a536e6-52aa-43fc-8fd5-737a0ac657d6 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:03.298367 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cf060-89a3-4b34-bed5-c2f3e86296c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:03.299227 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cf060-89a3-4b34-bed5-c2f3e86296c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:03.299509 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cf060-89a3-4b34-bed5-c2f3e86296c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:03.299783 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cf060-89a3-4b34-bed5-c2f3e86296c8 admin admin] PATH_INFO: `/v3/projects/9864e8c6a1ba46378721f4117f193e70` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:03.300985 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cf060-89a3-4b34-bed5-c2f3e86296c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9864e8c6a1ba46378721f4117f193e70)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:03.303029 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cf060-89a3-4b34-bed5-c2f3e86296c8 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:03.304466 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 980/1930] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:03 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:03.305835 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dc7be-e7e4-437a-a97f-efa2fb927121 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:03.375078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-505cf060-89a3-4b34-bed5-c2f3e86296c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9864e8c6a1ba46378721f4117f193e70', 'request_id': 'req-505cf060-89a3-4b34-bed5-c2f3e86296c8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:03.382218 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-505cf060-89a3-4b34-bed5-c2f3e86296c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9864e8c6a1ba46378721f4117f193e70', 'request_id': 'req-505cf060-89a3-4b34-bed5-c2f3e86296c8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:03.391447 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-505cf060-89a3-4b34-bed5-c2f3e86296c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9864e8c6a1ba46378721f4117f193e70', 'request_id': 'req-505cf060-89a3-4b34-bed5-c2f3e86296c8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:03.403337 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dc7be-e7e4-437a-a97f-efa2fb927121 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:03.411343 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-505cf060-89a3-4b34-bed5-c2f3e86296c8 admin admin] The token cache is being invalidate because project 9864e8c6a1ba46378721f4117f193e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:03.411699 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-505cf060-89a3-4b34-bed5-c2f3e86296c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:03.412717 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-505cf060-89a3-4b34-bed5-c2f3e86296c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:03.420069 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 951/1931] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:03 2022] DELETE /identity/v3/projects/9864e8c6a1ba46378721f4117f193e70 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:03.421369 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cf060-89a3-4b34-bed5-c2f3e86296c8 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:03.425128 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-505cf060-89a3-4b34-bed5-c2f3e86296c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:03.514562 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bcedd-008b-4866-9ff8-a695acfe82f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:03.515236 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bcedd-008b-4866-9ff8-a695acfe82f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:03.515525 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bcedd-008b-4866-9ff8-a695acfe82f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:03.515847 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bcedd-008b-4866-9ff8-a695acfe82f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:03.517158 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bcedd-008b-4866-9ff8-a695acfe82f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:03.521897 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bcedd-008b-4866-9ff8-a695acfe82f6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:03.527707 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cf060-89a3-4b34-bed5-c2f3e86296c8 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:03.530249 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:03.535320 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7a7fb-8c53-46cf-97e5-d591b5b441ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:03.543566 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7a7fb-8c53-46cf-97e5-d591b5b441ff admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:03.544004 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7a7fb-8c53-46cf-97e5-d591b5b441ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:03.544532 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7a7fb-8c53-46cf-97e5-d591b5b441ff admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:03.545359 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7a7fb-8c53-46cf-97e5-d591b5b441ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:03.547448 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7a7fb-8c53-46cf-97e5-d591b5b441ff admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:03.565040 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 981/1932] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:03 2022] POST /identity/v3/projects => generated 377 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:03.566171 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bcedd-008b-4866-9ff8-a695acfe82f6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:03.571247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-776bcedd-008b-4866-9ff8-a695acfe82f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:03.583385 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 952/1933] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:03 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:03.583957 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7a7fb-8c53-46cf-97e5-d591b5b441ff admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:03.586018 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-bcf7a7fb-8c53-46cf-97e5-d591b5b441ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:03.603304 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7a7fb-8c53-46cf-97e5-d591b5b441ff admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:03.674412 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bcedd-008b-4866-9ff8-a695acfe82f6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:03.675759 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:03.681477 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2fe6-4c6d-4bf8-bdd0-5aaeb0f0ae29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:03.682254 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2fe6-4c6d-4bf8-bdd0-5aaeb0f0ae29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:03.682573 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2fe6-4c6d-4bf8-bdd0-5aaeb0f0ae29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:03.682850 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2fe6-4c6d-4bf8-bdd0-5aaeb0f0ae29 admin admin] PATH_INFO: `/v3/users/e95c1de0ad814cddad5dbfa843395acd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:03.684099 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b2fe6-4c6d-4bf8-bdd0-5aaeb0f0ae29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e95c1de0ad814cddad5dbfa843395acd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:03.687001 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b2fe6-4c6d-4bf8-bdd0-5aaeb0f0ae29 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:03.739316 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec76e0-0986-42df-b1ec-dc1e61d7814a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:03.741264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec76e0-0986-42df-b1ec-dc1e61d7814a admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:03.741677 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec76e0-0986-42df-b1ec-dc1e61d7814a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:03.743099 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec76e0-0986-42df-b1ec-dc1e61d7814a admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:03.743251 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec76e0-0986-42df-b1ec-dc1e61d7814a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:03.746406 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec76e0-0986-42df-b1ec-dc1e61d7814a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:03.774518 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9b7b2fe6-4c6d-4bf8-bdd0-5aaeb0f0ae29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95c1de0ad814cddad5dbfa843395acd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:03.775614 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9b7b2fe6-4c6d-4bf8-bdd0-5aaeb0f0ae29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95c1de0ad814cddad5dbfa843395acd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:03.786521 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 953/1934] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:03 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:03.795313 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec76e0-0986-42df-b1ec-dc1e61d7814a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:03.795783 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9b7b2fe6-4c6d-4bf8-bdd0-5aaeb0f0ae29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95c1de0ad814cddad5dbfa843395acd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:03.799155 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-bfec76e0-0986-42df-b1ec-dc1e61d7814a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:03.810774 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9b7b2fe6-4c6d-4bf8-bdd0-5aaeb0f0ae29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95c1de0ad814cddad5dbfa843395acd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:03.812082 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9b7b2fe6-4c6d-4bf8-bdd0-5aaeb0f0ae29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95c1de0ad814cddad5dbfa843395acd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:03.816511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec76e0-0986-42df-b1ec-dc1e61d7814a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:03.823877 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca270ae-efe9-4a5d-af08-b67efed32046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:03.824496 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca270ae-efe9-4a5d-af08-b67efed32046 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:03.824774 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca270ae-efe9-4a5d-af08-b67efed32046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:03.825178 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca270ae-efe9-4a5d-af08-b67efed32046 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:03.825931 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca270ae-efe9-4a5d-af08-b67efed32046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:03.827534 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca270ae-efe9-4a5d-af08-b67efed32046 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:03.830600 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 982/1935] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:03 2022] DELETE /identity/v3/users/e95c1de0ad814cddad5dbfa843395acd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:03.831398 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2fe6-4c6d-4bf8-bdd0-5aaeb0f0ae29 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:03.832740 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9b7b2fe6-4c6d-4bf8-bdd0-5aaeb0f0ae29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:03.844174 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 954/1936] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:03.845004 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca270ae-efe9-4a5d-af08-b67efed32046 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:03.859435 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca270ae-efe9-4a5d-af08-b67efed32046 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:03.923029 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2fe6-4c6d-4bf8-bdd0-5aaeb0f0ae29 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:03.932116 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0343d-1e1e-4275-8982-eb9a45656ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:03.933561 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0343d-1e1e-4275-8982-eb9a45656ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:03.933925 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0343d-1e1e-4275-8982-eb9a45656ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:03.934279 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0343d-1e1e-4275-8982-eb9a45656ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:03.935059 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0343d-1e1e-4275-8982-eb9a45656ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:03.937187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0343d-1e1e-4275-8982-eb9a45656ed1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:03.941106 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1c607-c76b-4fa6-83eb-71f5e234ddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:03.941829 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1c607-c76b-4fa6-83eb-71f5e234ddc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:03.942291 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1c607-c76b-4fa6-83eb-71f5e234ddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:03.942567 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1c607-c76b-4fa6-83eb-71f5e234ddc8 admin admin] PATH_INFO: `/v3/projects/bea5d5d2c8444e72ab4f62df2d2aada5/users/f2c9973dd68b4e27b139355f30c98098/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:03.957442 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 983/1937] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:03.958563 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0343d-1e1e-4275-8982-eb9a45656ed1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:03.964246 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1c607-c76b-4fa6-83eb-71f5e234ddc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea5d5d2c8444e72ab4f62df2d2aada5, user_id=f2c9973dd68b4e27b139355f30c98098, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:03.965641 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:03.969125 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1c607-c76b-4fa6-83eb-71f5e234ddc8 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:03.975423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0343d-1e1e-4275-8982-eb9a45656ed1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:03.984653 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493daa01-f714-4bc1-95f0-88eb4187595b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:03.985375 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493daa01-f714-4bc1-95f0-88eb4187595b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:03.985666 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493daa01-f714-4bc1-95f0-88eb4187595b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:03.985944 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493daa01-f714-4bc1-95f0-88eb4187595b admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:03.987241 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493daa01-f714-4bc1-95f0-88eb4187595b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:03.989760 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493daa01-f714-4bc1-95f0-88eb4187595b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:03.992400 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 955/1938] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:03 2022] PUT /identity/v3/projects/bea5d5d2c8444e72ab4f62df2d2aada5/users/f2c9973dd68b4e27b139355f30c98098/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:03.993568 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1c607-c76b-4fa6-83eb-71f5e234ddc8 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:04.008106 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 984/1939] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:04.009368 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493daa01-f714-4bc1-95f0-88eb4187595b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:04.023077 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493daa01-f714-4bc1-95f0-88eb4187595b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:04.084711 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1c607-c76b-4fa6-83eb-71f5e234ddc8 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:04.104578 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d24223-8893-47fb-ae1d-c0b6e2ed275d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:04.106220 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d24223-8893-47fb-ae1d-c0b6e2ed275d admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:04.106507 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d24223-8893-47fb-ae1d-c0b6e2ed275d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:04.106783 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d24223-8893-47fb-ae1d-c0b6e2ed275d admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:04.107434 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d24223-8893-47fb-ae1d-c0b6e2ed275d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:04.114818 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acf9d9-2a45-4d3b-a6b4-e0278b5a244e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:04.114818 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acf9d9-2a45-4d3b-a6b4-e0278b5a244e admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:04.115527 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d24223-8893-47fb-ae1d-c0b6e2ed275d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:04.115640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acf9d9-2a45-4d3b-a6b4-e0278b5a244e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:04.115988 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acf9d9-2a45-4d3b-a6b4-e0278b5a244e admin admin] PATH_INFO: `/v3/projects/c4edc3555dda40888408fe99b1db5cee/users/af056787509040ad9ad1d08bda92100e/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:04.146775 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 956/1940] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:04.157365 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d24223-8893-47fb-ae1d-c0b6e2ed275d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:04.162344 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acf9d9-2a45-4d3b-a6b4-e0278b5a244e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4edc3555dda40888408fe99b1db5cee, user_id=af056787509040ad9ad1d08bda92100e, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:04.167355 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acf9d9-2a45-4d3b-a6b4-e0278b5a244e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:04.186541 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d24223-8893-47fb-ae1d-c0b6e2ed275d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:04.208599 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 985/1941] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:04 2022] PUT /identity/v3/projects/c4edc3555dda40888408fe99b1db5cee/users/af056787509040ad9ad1d08bda92100e/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:04.211609 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62017ef-ecac-4be4-b01c-242593063de4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:04.212228 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62017ef-ecac-4be4-b01c-242593063de4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:04.212794 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62017ef-ecac-4be4-b01c-242593063de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:04.249822 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:04.266753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c62017ef-ecac-4be4-b01c-242593063de4 None None] MFA Rules not processed for user `af056787509040ad9ad1d08bda92100e`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:04.271305 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c62017ef-ecac-4be4-b01c-242593063de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:04.310885 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebce71d-c68a-4bdb-9163-9b613cbca716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:04.311566 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebce71d-c68a-4bdb-9163-9b613cbca716 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:04.311842 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebce71d-c68a-4bdb-9163-9b613cbca716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:04.312110 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebce71d-c68a-4bdb-9163-9b613cbca716 admin admin] PATH_INFO: `/v3/projects/bea5d5d2c8444e72ab4f62df2d2aada5/users/f2c9973dd68b4e27b139355f30c98098/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:04.316401 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebce71d-c68a-4bdb-9163-9b613cbca716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea5d5d2c8444e72ab4f62df2d2aada5, user_id=f2c9973dd68b4e27b139355f30c98098, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:04.324211 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebce71d-c68a-4bdb-9163-9b613cbca716 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:04.350135 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 957/1942] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:04 2022] PUT /identity/v3/projects/bea5d5d2c8444e72ab4f62df2d2aada5/users/f2c9973dd68b4e27b139355f30c98098/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:04.361052 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea3631-3a72-4171-b9b6-e692a26e0bad None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:04.362513 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea3631-3a72-4171-b9b6-e692a26e0bad None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:04.363204 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea3631-3a72-4171-b9b6-e692a26e0bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:04.386617 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 986/1943] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:04.398864 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62017ef-ecac-4be4-b01c-242593063de4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:04.405418 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c62017ef-ecac-4be4-b01c-242593063de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:04.436801 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b2ea3631-3a72-4171-b9b6-e692a26e0bad None None] MFA Rules not processed for user `f2c9973dd68b4e27b139355f30c98098`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:04.438144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b2ea3631-3a72-4171-b9b6-e692a26e0bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:04.530473 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:04.545009 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62017ef-ecac-4be4-b01c-242593063de4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:04.564474 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 958/1944] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:04.566900 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84146091-ee31-4caa-bc43-4f72e93441bd None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:04.567385 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84146091-ee31-4caa-bc43-4f72e93441bd None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:04.567840 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84146091-ee31-4caa-bc43-4f72e93441bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:04.613511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-84146091-ee31-4caa-bc43-4f72e93441bd None None] MFA Rules not processed for user `43cc9c07797a4524b00b11e7eedc78ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:04.615884 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-84146091-ee31-4caa-bc43-4f72e93441bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:04.623621 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04461a24-27e4-46c4-bc16-0ea767e67920 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2920ad41c61b401299ca5ae1714b4031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:04.624312 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04461a24-27e4-46c4-bc16-0ea767e67920 service glance] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:04.624704 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04461a24-27e4-46c4-bc16-0ea767e67920 service glance] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:04.625729 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04461a24-27e4-46c4-bc16-0ea767e67920 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:04.731020 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 959/1945] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:04.732643 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84146091-ee31-4caa-bc43-4f72e93441bd None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:04.735408 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-84146091-ee31-4caa-bc43-4f72e93441bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:04.776261 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04461a24-27e4-46c4-bc16-0ea767e67920 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:04.778549 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04461a24-27e4-46c4-bc16-0ea767e67920 service glance] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:04.797186 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 987/1946] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:04.798064 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04461a24-27e4-46c4-bc16-0ea767e67920 service glance] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:04.799578 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-04461a24-27e4-46c4-bc16-0ea767e67920 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:04.810573 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:04.876009 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84146091-ee31-4caa-bc43-4f72e93441bd None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:04.887315 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e296b-54f6-41bf-bf6f-7f3412144b7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:04.888107 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e296b-54f6-41bf-bf6f-7f3412144b7e service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:04.888230 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e296b-54f6-41bf-bf6f-7f3412144b7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:04.888506 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e296b-54f6-41bf-bf6f-7f3412144b7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:04.901447 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ce6e296b-54f6-41bf-bf6f-7f3412144b7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:04.925103 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04461a24-27e4-46c4-bc16-0ea767e67920 service glance] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:04.930775 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a3c18-07b0-48d9-978e-aa7989f6df30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:04.931520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a3c18-07b0-48d9-978e-aa7989f6df30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:04.931804 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a3c18-07b0-48d9-978e-aa7989f6df30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:04.932180 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a3c18-07b0-48d9-978e-aa7989f6df30 admin admin] PATH_INFO: `/v3/projects/68a626b3d73f4b0aaad2423cace11f2f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:04.933740 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a3c18-07b0-48d9-978e-aa7989f6df30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68a626b3d73f4b0aaad2423cace11f2f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:04.935800 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a3c18-07b0-48d9-978e-aa7989f6df30 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:05.007331 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-953a3c18-07b0-48d9-978e-aa7989f6df30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68a626b3d73f4b0aaad2423cace11f2f', 'request_id': 'req-953a3c18-07b0-48d9-978e-aa7989f6df30'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:05.016882 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-953a3c18-07b0-48d9-978e-aa7989f6df30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68a626b3d73f4b0aaad2423cace11f2f', 'request_id': 'req-953a3c18-07b0-48d9-978e-aa7989f6df30'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:05.035453 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:05.049860 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-953a3c18-07b0-48d9-978e-aa7989f6df30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68a626b3d73f4b0aaad2423cace11f2f', 'request_id': 'req-953a3c18-07b0-48d9-978e-aa7989f6df30'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:05.057010 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e296b-54f6-41bf-bf6f-7f3412144b7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:05.059171 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e296b-54f6-41bf-bf6f-7f3412144b7e service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:05.085789 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 960/1947] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:05.087338 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b1d76-8e2c-435e-9f06-f6f07d6449b5 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:05.087630 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b1d76-8e2c-435e-9f06-f6f07d6449b5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:05.089102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-953a3c18-07b0-48d9-978e-aa7989f6df30 admin admin] The token cache is being invalidate because project 68a626b3d73f4b0aaad2423cace11f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:05.089403 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-953a3c18-07b0-48d9-978e-aa7989f6df30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:05.089906 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b1d76-8e2c-435e-9f06-f6f07d6449b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:05.090831 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-953a3c18-07b0-48d9-978e-aa7989f6df30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:05.093699 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 988/1948] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:04 2022] DELETE /identity/v3/projects/68a626b3d73f4b0aaad2423cace11f2f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:05.099713 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c77f-00bc-40d0-9e4e-798194ae9a29 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:05.100006 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c77f-00bc-40d0-9e4e-798194ae9a29 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:05.100524 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c77f-00bc-40d0-9e4e-798194ae9a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:05.126348 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c954c77f-00bc-40d0-9e4e-798194ae9a29 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:05.127651 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c954c77f-00bc-40d0-9e4e-798194ae9a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:05.185126 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-cf2b1d76-8e2c-435e-9f06-f6f07d6449b5 None None] MFA Rules not processed for user `7b9806fefa0042a380af7ac1175c53d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:05.187434 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cf2b1d76-8e2c-435e-9f06-f6f07d6449b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:05.308537 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 989/1949] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:57:05.309686 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db955a0-9552-470a-9c7b-69d1bbfc564d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:05.309985 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db955a0-9552-470a-9c7b-69d1bbfc564d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:05.313320 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db955a0-9552-470a-9c7b-69d1bbfc564d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:05.338113 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 961/1950] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:05.350051 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b1d76-8e2c-435e-9f06-f6f07d6449b5 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:05.352376 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cf2b1d76-8e2c-435e-9f06-f6f07d6449b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:05.374028 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5db955a0-9552-470a-9c7b-69d1bbfc564d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:05.375978 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5db955a0-9552-470a-9c7b-69d1bbfc564d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:05.398740 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 990/1951] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:05.403044 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db955a0-9552-470a-9c7b-69d1bbfc564d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:05.422259 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db955a0-9552-470a-9c7b-69d1bbfc564d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:05.432118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07b000-ed9a-4d1a-b58c-332e9ed61b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:05.433423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07b000-ed9a-4d1a-b58c-332e9ed61b02 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:05.433707 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07b000-ed9a-4d1a-b58c-332e9ed61b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:05.433980 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07b000-ed9a-4d1a-b58c-332e9ed61b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:05.435142 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07b000-ed9a-4d1a-b58c-332e9ed61b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:57:05.435506 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07b000-ed9a-4d1a-b58c-332e9ed61b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:05.438364 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07b000-ed9a-4d1a-b58c-332e9ed61b02 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:05.457289 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 991/1952] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:57:05.462290 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07b000-ed9a-4d1a-b58c-332e9ed61b02 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:05.485335 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07b000-ed9a-4d1a-b58c-332e9ed61b02 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:05.500365 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624ddbb-1ef5-4091-a593-962002fbf936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:05.501049 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624ddbb-1ef5-4091-a593-962002fbf936 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:05.501568 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624ddbb-1ef5-4091-a593-962002fbf936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:05.502120 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624ddbb-1ef5-4091-a593-962002fbf936 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:05.503359 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624ddbb-1ef5-4091-a593-962002fbf936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:05.506485 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624ddbb-1ef5-4091-a593-962002fbf936 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:05.519746 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b1d76-8e2c-435e-9f06-f6f07d6449b5 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:05.529453 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd3cbc-3115-4a6c-b0de-cfad48c4cfa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:05.530082 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd3cbc-3115-4a6c-b0de-cfad48c4cfa0 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:05.530367 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd3cbc-3115-4a6c-b0de-cfad48c4cfa0 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:05.530679 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd3cbc-3115-4a6c-b0de-cfad48c4cfa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:05.534948 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e0cd3cbc-3115-4a6c-b0de-cfad48c4cfa0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:05.551430 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 992/1953] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:05 2022] POST /identity/v3/projects => generated 391 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:57:05.553011 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624ddbb-1ef5-4091-a593-962002fbf936 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:05.563517 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd3cbc-3115-4a6c-b0de-cfad48c4cfa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:05.565786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd3cbc-3115-4a6c-b0de-cfad48c4cfa0 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:05.578102 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 962/1954] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:05.658128 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624ddbb-1ef5-4091-a593-962002fbf936 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:05.664005 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37fe43-8a8d-44fa-b9f9-8bcd8500f4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:05.664731 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37fe43-8a8d-44fa-b9f9-8bcd8500f4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:05.665162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37fe43-8a8d-44fa-b9f9-8bcd8500f4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:05.665535 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37fe43-8a8d-44fa-b9f9-8bcd8500f4b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:05.666583 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37fe43-8a8d-44fa-b9f9-8bcd8500f4b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:05.669620 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37fe43-8a8d-44fa-b9f9-8bcd8500f4b6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:05.735305 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 993/1955] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:05 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:57:05.735883 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd3cbc-3115-4a6c-b0de-cfad48c4cfa0 service nova] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:05.751494 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd3cbc-3115-4a6c-b0de-cfad48c4cfa0 service nova] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:05.766301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b27460-bcc2-483a-ae4b-5c52684b5219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:05.768216 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b27460-bcc2-483a-ae4b-5c52684b5219 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:05.768721 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b27460-bcc2-483a-ae4b-5c52684b5219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:05.769182 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b27460-bcc2-483a-ae4b-5c52684b5219 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:05.769973 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b27460-bcc2-483a-ae4b-5c52684b5219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:05.771748 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b27460-bcc2-483a-ae4b-5c52684b5219 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:05.791091 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 963/1956] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 00:57:05.792404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37fe43-8a8d-44fa-b9f9-8bcd8500f4b6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:05.809762 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37fe43-8a8d-44fa-b9f9-8bcd8500f4b6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:05.816994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ef697-c8d6-44b8-819d-d31c3cc1c78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:05.817953 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ef697-c8d6-44b8-819d-d31c3cc1c78d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:05.819083 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ef697-c8d6-44b8-819d-d31c3cc1c78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:05.819507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ef697-c8d6-44b8-819d-d31c3cc1c78d admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:05.821012 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ef697-c8d6-44b8-819d-d31c3cc1c78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:05.836141 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ef697-c8d6-44b8-819d-d31c3cc1c78d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:05.869162 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 994/1957] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:05.873412 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b27460-bcc2-483a-ae4b-5c52684b5219 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:05.889075 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b27460-bcc2-483a-ae4b-5c52684b5219 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:05.902209 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0372af-5220-4206-b0a0-d82b793dcc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:05.903144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0372af-5220-4206-b0a0-d82b793dcc9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:05.903544 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0372af-5220-4206-b0a0-d82b793dcc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:05.904065 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0372af-5220-4206-b0a0-d82b793dcc9d admin admin] PATH_INFO: `/v3/projects/1c03165ee71448199ac24c0c5587e9fa/users/c71c26dcec8c4c408fbac22cc2092b22/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:05.916649 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:05.929575 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0372af-5220-4206-b0a0-d82b793dcc9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c03165ee71448199ac24c0c5587e9fa, user_id=c71c26dcec8c4c408fbac22cc2092b22, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:05.933103 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0372af-5220-4206-b0a0-d82b793dcc9d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:05.965036 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 964/1958] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:05 2022] PUT /identity/v3/projects/1c03165ee71448199ac24c0c5587e9fa/users/c71c26dcec8c4c408fbac22cc2092b22/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:05.969380 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8796d7-0c36-4a2e-b90d-ae447647c749 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:05.969994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8796d7-0c36-4a2e-b90d-ae447647c749 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:05.971424 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8796d7-0c36-4a2e-b90d-ae447647c749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:06.014423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8f8796d7-0c36-4a2e-b90d-ae447647c749 None None] MFA Rules not processed for user `c71c26dcec8c4c408fbac22cc2092b22`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:06.015899 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8f8796d7-0c36-4a2e-b90d-ae447647c749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:06.029741 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:06.112001 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 995/1959] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:06.116972 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0372af-5220-4206-b0a0-d82b793dcc9d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:06.206598 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0372af-5220-4206-b0a0-d82b793dcc9d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:06.212454 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d0165-5bec-4636-9f2a-921f440c2845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:06.214053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d0165-5bec-4636-9f2a-921f440c2845 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:06.214442 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d0165-5bec-4636-9f2a-921f440c2845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:06.214814 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d0165-5bec-4636-9f2a-921f440c2845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:06.215662 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d0165-5bec-4636-9f2a-921f440c2845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:06.218356 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d0165-5bec-4636-9f2a-921f440c2845 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:06.260397 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 965/1960] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:06 2022] POST /identity/v3/projects => generated 393 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:06.261694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8796d7-0c36-4a2e-b90d-ae447647c749 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:06.274266 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8796d7-0c36-4a2e-b90d-ae447647c749 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:06.336551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ee139-19fa-4842-ae47-cf534452de07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:06.337253 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ee139-19fa-4842-ae47-cf534452de07 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:06.337465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ee139-19fa-4842-ae47-cf534452de07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:06.337672 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ee139-19fa-4842-ae47-cf534452de07 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:06.338280 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ee139-19fa-4842-ae47-cf534452de07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:06.340629 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ee139-19fa-4842-ae47-cf534452de07 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:06.392264 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 996/1961] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:06 2022] POST /identity/v3/users => generated 303 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:06.393511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d0165-5bec-4636-9f2a-921f440c2845 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:06.423020 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d0165-5bec-4636-9f2a-921f440c2845 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:06.432953 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a3a41-0324-4c6e-bf6b-7261e6243518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:06.433800 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a3a41-0324-4c6e-bf6b-7261e6243518 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:06.434028 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a3a41-0324-4c6e-bf6b-7261e6243518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:06.434335 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a3a41-0324-4c6e-bf6b-7261e6243518 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:06.435112 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a3a41-0324-4c6e-bf6b-7261e6243518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:06.436893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a3a41-0324-4c6e-bf6b-7261e6243518 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:06.459134 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 966/1962] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:06.463348 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ee139-19fa-4842-ae47-cf534452de07 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:06.474430 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ee139-19fa-4842-ae47-cf534452de07 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:06.479640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7f564-3a13-4859-ba37-db53d7bef5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:06.480460 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7f564-3a13-4859-ba37-db53d7bef5e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:06.480747 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7f564-3a13-4859-ba37-db53d7bef5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:06.481051 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7f564-3a13-4859-ba37-db53d7bef5e0 admin admin] PATH_INFO: `/v3/projects/021d5f7a531d484abb227eca9c757d86/users/6c561007dc224ec9a7b735c500539f14/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:06.507452 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7f564-3a13-4859-ba37-db53d7bef5e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=021d5f7a531d484abb227eca9c757d86, user_id=6c561007dc224ec9a7b735c500539f14, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:06.510441 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7f564-3a13-4859-ba37-db53d7bef5e0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:06.535950 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 997/1963] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:06 2022] PUT /identity/v3/projects/021d5f7a531d484abb227eca9c757d86/users/6c561007dc224ec9a7b735c500539f14/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:06.543024 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a3a41-0324-4c6e-bf6b-7261e6243518 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:06.557053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a3a41-0324-4c6e-bf6b-7261e6243518 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:06.632319 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea19a52-0fd1-42dc-92c9-cc65c0a399e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:06.633112 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea19a52-0fd1-42dc-92c9-cc65c0a399e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:06.633465 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea19a52-0fd1-42dc-92c9-cc65c0a399e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:06.633811 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea19a52-0fd1-42dc-92c9-cc65c0a399e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:06.634540 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea19a52-0fd1-42dc-92c9-cc65c0a399e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:06.636280 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea19a52-0fd1-42dc-92c9-cc65c0a399e7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:06.648993 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 967/1964] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:06.653144 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7f564-3a13-4859-ba37-db53d7bef5e0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:06.741725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7f564-3a13-4859-ba37-db53d7bef5e0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:06.764644 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344cb13-4794-4e8d-b273-5e49c46595a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:06.765466 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344cb13-4794-4e8d-b273-5e49c46595a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:06.765815 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344cb13-4794-4e8d-b273-5e49c46595a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:06.769940 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344cb13-4794-4e8d-b273-5e49c46595a8 admin admin] PATH_INFO: `/v3/projects/021d5f7a531d484abb227eca9c757d86/users/6c561007dc224ec9a7b735c500539f14/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:06.774764 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344cb13-4794-4e8d-b273-5e49c46595a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=021d5f7a531d484abb227eca9c757d86, user_id=6c561007dc224ec9a7b735c500539f14, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:06.777476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344cb13-4794-4e8d-b273-5e49c46595a8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:06.804791 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 998/1965] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:06 2022] PUT /identity/v3/projects/021d5f7a531d484abb227eca9c757d86/users/6c561007dc224ec9a7b735c500539f14/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:06.824350 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c91d-9839-4992-aff1-0a2fcfa5cb4f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:06.824875 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c91d-9839-4992-aff1-0a2fcfa5cb4f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:06.825086 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c91d-9839-4992-aff1-0a2fcfa5cb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:06.872070 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ed67c91d-9839-4992-aff1-0a2fcfa5cb4f None None] MFA Rules not processed for user `6c561007dc224ec9a7b735c500539f14`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:06.873836 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ed67c91d-9839-4992-aff1-0a2fcfa5cb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:06.934975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:06.989693 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 968/1966] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:06 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:07.009775 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344cb13-4794-4e8d-b273-5e49c46595a8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:07.016365 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b344cb13-4794-4e8d-b273-5e49c46595a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:07.119459 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67c91d-9839-4992-aff1-0a2fcfa5cb4f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:07.120912 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ed67c91d-9839-4992-aff1-0a2fcfa5cb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:07.181592 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344cb13-4794-4e8d-b273-5e49c46595a8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:07.186103 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fe03e-d175-4aba-add1-9ac2ac86b69f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:07.186733 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fe03e-d175-4aba-add1-9ac2ac86b69f service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:07.187007 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fe03e-d175-4aba-add1-9ac2ac86b69f service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:07.187279 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fe03e-d175-4aba-add1-9ac2ac86b69f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:07.211335 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fe03e-d175-4aba-add1-9ac2ac86b69f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:07.213679 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fe03e-d175-4aba-add1-9ac2ac86b69f service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:07.227475 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 999/1967] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:07 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:07.268322 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67c91d-9839-4992-aff1-0a2fcfa5cb4f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:07.272961 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85dbf6-50c3-4a32-b795-f1c6d3a9298a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:07.273647 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85dbf6-50c3-4a32-b795-f1c6d3a9298a service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:07.273935 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85dbf6-50c3-4a32-b795-f1c6d3a9298a service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:07.274205 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85dbf6-50c3-4a32-b795-f1c6d3a9298a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:07.276070 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6b85dbf6-50c3-4a32-b795-f1c6d3a9298a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:07.300498 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fe03e-d175-4aba-add1-9ac2ac86b69f service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:07.314773 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fe03e-d175-4aba-add1-9ac2ac86b69f service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:07.338719 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194eb93c-2d92-4f17-9502-60c37d688fcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:07.339558 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194eb93c-2d92-4f17-9502-60c37d688fcb service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:07.339770 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194eb93c-2d92-4f17-9502-60c37d688fcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:07.340040 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194eb93c-2d92-4f17-9502-60c37d688fcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:07.351928 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:07.385087 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85dbf6-50c3-4a32-b795-f1c6d3a9298a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:07.386711 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85dbf6-50c3-4a32-b795-f1c6d3a9298a service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:07.403020 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 969/1968] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:07.430339 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194eb93c-2d92-4f17-9502-60c37d688fcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:07.433772 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194eb93c-2d92-4f17-9502-60c37d688fcb service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:07.447739 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1000/1969] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:07 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:57:08.170586 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85dbf6-50c3-4a32-b795-f1c6d3a9298a service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:08.182281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85dbf6-50c3-4a32-b795-f1c6d3a9298a service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:08.187123 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c1f9b-56f8-4102-acc1-6d7161e57d82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:08.187855 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c1f9b-56f8-4102-acc1-6d7161e57d82 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:08.188239 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c1f9b-56f8-4102-acc1-6d7161e57d82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:08.188661 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c1f9b-56f8-4102-acc1-6d7161e57d82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:08.191425 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4a3c1f9b-56f8-4102-acc1-6d7161e57d82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:08.314023 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c1f9b-56f8-4102-acc1-6d7161e57d82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:08.318666 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c1f9b-56f8-4102-acc1-6d7161e57d82 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:08.333099 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 970/1970] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:11.683882 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194eb93c-2d92-4f17-9502-60c37d688fcb service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:11.774868 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194eb93c-2d92-4f17-9502-60c37d688fcb service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:11.782011 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c737a43-6c29-48dc-b137-c8d6a79fe459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:11.782434 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c737a43-6c29-48dc-b137-c8d6a79fe459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:11.782838 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c737a43-6c29-48dc-b137-c8d6a79fe459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:11.783944 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c737a43-6c29-48dc-b137-c8d6a79fe459 admin admin] PATH_INFO: `/v3/users/c71c26dcec8c4c408fbac22cc2092b22` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:11.785401 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c737a43-6c29-48dc-b137-c8d6a79fe459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71c26dcec8c4c408fbac22cc2092b22)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:11.787544 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c737a43-6c29-48dc-b137-c8d6a79fe459 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:11.847663 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8c737a43-6c29-48dc-b137-c8d6a79fe459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71c26dcec8c4c408fbac22cc2092b22'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:11.849332 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8c737a43-6c29-48dc-b137-c8d6a79fe459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71c26dcec8c4c408fbac22cc2092b22'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:11.868642 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8c737a43-6c29-48dc-b137-c8d6a79fe459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71c26dcec8c4c408fbac22cc2092b22'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:11.882780 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8c737a43-6c29-48dc-b137-c8d6a79fe459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71c26dcec8c4c408fbac22cc2092b22'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:11.883760 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8c737a43-6c29-48dc-b137-c8d6a79fe459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71c26dcec8c4c408fbac22cc2092b22'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:11.910544 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1001/1971] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:11 2022] DELETE /identity/v3/users/c71c26dcec8c4c408fbac22cc2092b22 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:11.915344 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f73fd4-2268-4fcb-901e-29aa4e07d946 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:11.916223 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f73fd4-2268-4fcb-901e-29aa4e07d946 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:11.916223 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f73fd4-2268-4fcb-901e-29aa4e07d946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:11.941300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-31f73fd4-2268-4fcb-901e-29aa4e07d946 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:11.943292 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-31f73fd4-2268-4fcb-901e-29aa4e07d946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:11.996701 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:12.060522 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 971/1972] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:12.073197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c737a43-6c29-48dc-b137-c8d6a79fe459 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:12.075729 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8c737a43-6c29-48dc-b137-c8d6a79fe459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:12.140735 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:12.214200 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c737a43-6c29-48dc-b137-c8d6a79fe459 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:12.217850 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651bb64-2e90-4c2b-97d5-7f74d6b720d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:12.218460 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651bb64-2e90-4c2b-97d5-7f74d6b720d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:12.218738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651bb64-2e90-4c2b-97d5-7f74d6b720d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:12.219004 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651bb64-2e90-4c2b-97d5-7f74d6b720d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:12.230764 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651bb64-2e90-4c2b-97d5-7f74d6b720d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:12.232312 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651bb64-2e90-4c2b-97d5-7f74d6b720d5 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:12.246308 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1002/1973] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:12.537193 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f73fd4-2268-4fcb-901e-29aa4e07d946 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:12.538702 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-31f73fd4-2268-4fcb-901e-29aa4e07d946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:12.553263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f73fd4-2268-4fcb-901e-29aa4e07d946 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:12.558389 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5e250-be3a-47f0-9fc7-f461a9b72679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:12.559099 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5e250-be3a-47f0-9fc7-f461a9b72679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:12.559408 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5e250-be3a-47f0-9fc7-f461a9b72679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:12.559657 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5e250-be3a-47f0-9fc7-f461a9b72679 admin admin] PATH_INFO: `/v3/projects/1c03165ee71448199ac24c0c5587e9fa` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:12.561844 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5e250-be3a-47f0-9fc7-f461a9b72679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c03165ee71448199ac24c0c5587e9fa)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:12.564011 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5e250-be3a-47f0-9fc7-f461a9b72679 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:12.620598 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9ea5e250-be3a-47f0-9fc7-f461a9b72679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c03165ee71448199ac24c0c5587e9fa', 'request_id': 'req-9ea5e250-be3a-47f0-9fc7-f461a9b72679'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:12.630193 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9ea5e250-be3a-47f0-9fc7-f461a9b72679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c03165ee71448199ac24c0c5587e9fa', 'request_id': 'req-9ea5e250-be3a-47f0-9fc7-f461a9b72679'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:12.638520 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9ea5e250-be3a-47f0-9fc7-f461a9b72679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c03165ee71448199ac24c0c5587e9fa', 'request_id': 'req-9ea5e250-be3a-47f0-9fc7-f461a9b72679'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:12.652442 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9ea5e250-be3a-47f0-9fc7-f461a9b72679 admin admin] The token cache is being invalidate because project 1c03165ee71448199ac24c0c5587e9fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:12.652876 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9ea5e250-be3a-47f0-9fc7-f461a9b72679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:12.653792 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9ea5e250-be3a-47f0-9fc7-f461a9b72679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:12.657127 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 972/1974] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:12 2022] DELETE /identity/v3/projects/1c03165ee71448199ac24c0c5587e9fa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:12.659609 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651bb64-2e90-4c2b-97d5-7f74d6b720d5 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:12.670440 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651bb64-2e90-4c2b-97d5-7f74d6b720d5 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:12.686437 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5e250-be3a-47f0-9fc7-f461a9b72679 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:12.688247 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9ea5e250-be3a-47f0-9fc7-f461a9b72679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:12.771460 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda33c9a-3849-48e0-84d4-b14818dfe3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:12.772112 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda33c9a-3849-48e0-84d4-b14818dfe3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:12.772621 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda33c9a-3849-48e0-84d4-b14818dfe3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:12.772897 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda33c9a-3849-48e0-84d4-b14818dfe3b1 admin admin] PATH_INFO: `/v3/users/6c561007dc224ec9a7b735c500539f14` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:12.774178 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda33c9a-3849-48e0-84d4-b14818dfe3b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c561007dc224ec9a7b735c500539f14)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:12.776678 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda33c9a-3849-48e0-84d4-b14818dfe3b1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:12.811192 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5e250-be3a-47f0-9fc7-f461a9b72679 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:12.822862 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ab90a-c53a-448a-b8fe-da70f06dd1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:12.823782 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ab90a-c53a-448a-b8fe-da70f06dd1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:12.824178 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ab90a-c53a-448a-b8fe-da70f06dd1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:12.825089 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ab90a-c53a-448a-b8fe-da70f06dd1c9 admin admin] PATH_INFO: `/v3/users/4062097df37c4e079b8d0cd4412e5b57` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:12.826172 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ab90a-c53a-448a-b8fe-da70f06dd1c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4062097df37c4e079b8d0cd4412e5b57)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:12.829235 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ab90a-c53a-448a-b8fe-da70f06dd1c9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:12.851425 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cda33c9a-3849-48e0-84d4-b14818dfe3b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c561007dc224ec9a7b735c500539f14'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:12.852247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cda33c9a-3849-48e0-84d4-b14818dfe3b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c561007dc224ec9a7b735c500539f14'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:12.896506 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cda33c9a-3849-48e0-84d4-b14818dfe3b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c561007dc224ec9a7b735c500539f14'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:12.914718 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cda33c9a-3849-48e0-84d4-b14818dfe3b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c561007dc224ec9a7b735c500539f14'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:12.915631 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cda33c9a-3849-48e0-84d4-b14818dfe3b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c561007dc224ec9a7b735c500539f14'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:12.930276 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-790ab90a-c53a-448a-b8fe-da70f06dd1c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4062097df37c4e079b8d0cd4412e5b57'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:12.930994 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-790ab90a-c53a-448a-b8fe-da70f06dd1c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4062097df37c4e079b8d0cd4412e5b57'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:12.936782 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1003/1975] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:12 2022] DELETE /identity/v3/users/6c561007dc224ec9a7b735c500539f14 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:12.941946 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-790ab90a-c53a-448a-b8fe-da70f06dd1c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4062097df37c4e079b8d0cd4412e5b57'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:12.942584 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-790ab90a-c53a-448a-b8fe-da70f06dd1c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4062097df37c4e079b8d0cd4412e5b57'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:12.945063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:12.951942 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-790ab90a-c53a-448a-b8fe-da70f06dd1c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4062097df37c4e079b8d0cd4412e5b57'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:12.981658 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 973/1976] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:12 2022] DELETE /identity/v3/users/4062097df37c4e079b8d0cd4412e5b57 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:12.982512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cfe82-5561-4e5f-81f9-666e114a44ab None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:12.982822 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cfe82-5561-4e5f-81f9-666e114a44ab None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:12.983100 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cfe82-5561-4e5f-81f9-666e114a44ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:13.010228 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d07cfe82-5561-4e5f-81f9-666e114a44ab None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:13.011629 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d07cfe82-5561-4e5f-81f9-666e114a44ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:13.073173 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:13.108658 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1004/1977] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:57:13.125267 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ab90a-c53a-448a-b8fe-da70f06dd1c9 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:13.127806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-790ab90a-c53a-448a-b8fe-da70f06dd1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:13.250831 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ab90a-c53a-448a-b8fe-da70f06dd1c9 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:13.254872 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df89341-032d-4405-a6cd-74fcdf6d9c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:13.255505 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df89341-032d-4405-a6cd-74fcdf6d9c1a service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:13.255782 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df89341-032d-4405-a6cd-74fcdf6d9c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:13.256075 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df89341-032d-4405-a6cd-74fcdf6d9c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:13.278183 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df89341-032d-4405-a6cd-74fcdf6d9c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:13.283738 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df89341-032d-4405-a6cd-74fcdf6d9c1a service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:13.314183 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 974/1978] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:13.648874 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cfe82-5561-4e5f-81f9-666e114a44ab None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:13.651919 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d07cfe82-5561-4e5f-81f9-666e114a44ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:13.673188 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cfe82-5561-4e5f-81f9-666e114a44ab None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:13.680375 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47af225-c51f-4866-b83f-8461a3d599f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:13.682603 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47af225-c51f-4866-b83f-8461a3d599f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:13.683234 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47af225-c51f-4866-b83f-8461a3d599f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:13.684263 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47af225-c51f-4866-b83f-8461a3d599f4 admin admin] PATH_INFO: `/v3/projects/021d5f7a531d484abb227eca9c757d86` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:13.685712 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47af225-c51f-4866-b83f-8461a3d599f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=021d5f7a531d484abb227eca9c757d86)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:13.687760 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47af225-c51f-4866-b83f-8461a3d599f4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:13.811555 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d47af225-c51f-4866-b83f-8461a3d599f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '021d5f7a531d484abb227eca9c757d86', 'request_id': 'req-d47af225-c51f-4866-b83f-8461a3d599f4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:13.831549 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d47af225-c51f-4866-b83f-8461a3d599f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '021d5f7a531d484abb227eca9c757d86', 'request_id': 'req-d47af225-c51f-4866-b83f-8461a3d599f4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:13.854645 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d47af225-c51f-4866-b83f-8461a3d599f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '021d5f7a531d484abb227eca9c757d86', 'request_id': 'req-d47af225-c51f-4866-b83f-8461a3d599f4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:13.876031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d47af225-c51f-4866-b83f-8461a3d599f4 admin admin] The token cache is being invalidate because project 021d5f7a531d484abb227eca9c757d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:13.876880 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d47af225-c51f-4866-b83f-8461a3d599f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:13.878076 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d47af225-c51f-4866-b83f-8461a3d599f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:13.880403 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1005/1979] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:13 2022] DELETE /identity/v3/projects/021d5f7a531d484abb227eca9c757d86 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:13.885720 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40356618-6548-45c2-a1d0-612e4cc82052 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:13.886015 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40356618-6548-45c2-a1d0-612e4cc82052 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:13.886309 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40356618-6548-45c2-a1d0-612e4cc82052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:13.917420 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-40356618-6548-45c2-a1d0-612e4cc82052 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:13.918753 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-40356618-6548-45c2-a1d0-612e4cc82052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:14.015868 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 975/1980] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:14.018237 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39f8d5-70a5-4bb4-953e-2b94a5229ded None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:14.018608 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39f8d5-70a5-4bb4-953e-2b94a5229ded None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:14.018894 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39f8d5-70a5-4bb4-953e-2b94a5229ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:14.046623 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-eb39f8d5-70a5-4bb4-953e-2b94a5229ded None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:14.049127 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-eb39f8d5-70a5-4bb4-953e-2b94a5229ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:14.065611 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1006/1981] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:14.066702 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40356618-6548-45c2-a1d0-612e4cc82052 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:14.078060 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40356618-6548-45c2-a1d0-612e4cc82052 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:14.097055 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bab15a-f05d-45af-8763-f54819ac2e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:14.097887 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bab15a-f05d-45af-8763-f54819ac2e20 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:14.098178 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bab15a-f05d-45af-8763-f54819ac2e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:14.098457 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bab15a-f05d-45af-8763-f54819ac2e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:14.114907 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bab15a-f05d-45af-8763-f54819ac2e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:57:14.115375 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bab15a-f05d-45af-8763-f54819ac2e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:14.124305 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bab15a-f05d-45af-8763-f54819ac2e20 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:14.157223 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 976/1982] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:57:14.157889 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39f8d5-70a5-4bb4-953e-2b94a5229ded None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:14.170452 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39f8d5-70a5-4bb4-953e-2b94a5229ded None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:14.177343 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39751204-fdc7-4416-8c45-9257ba1429cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:14.178009 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39751204-fdc7-4416-8c45-9257ba1429cd admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:14.178366 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39751204-fdc7-4416-8c45-9257ba1429cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:14.178818 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39751204-fdc7-4416-8c45-9257ba1429cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:14.179530 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39751204-fdc7-4416-8c45-9257ba1429cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:14.181648 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39751204-fdc7-4416-8c45-9257ba1429cd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:14.225775 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1007/1983] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:14 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:14.227772 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bab15a-f05d-45af-8763-f54819ac2e20 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:14.244662 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bab15a-f05d-45af-8763-f54819ac2e20 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:14.355058 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39751204-fdc7-4416-8c45-9257ba1429cd admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:14.359942 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-39751204-fdc7-4416-8c45-9257ba1429cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:14.368170 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c69740-e0cb-4036-b087-c2d963add53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:14.368170 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69740-e0cb-4036-b087-c2d963add53a admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:14.368170 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69740-e0cb-4036-b087-c2d963add53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:14.368170 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69740-e0cb-4036-b087-c2d963add53a admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:14.368701 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c69740-e0cb-4036-b087-c2d963add53a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:14.368701 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c69740-e0cb-4036-b087-c2d963add53a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:14.421421 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:14.447646 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39751204-fdc7-4416-8c45-9257ba1429cd admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:14.448732 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 977/1984] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:14 2022] POST /identity/v3/users => generated 284 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:14.454163 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c69740-e0cb-4036-b087-c2d963add53a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:14.460505 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db03a23-cd0a-4e23-8da0-4e7af185708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:14.461609 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db03a23-cd0a-4e23-8da0-4e7af185708c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:14.461784 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db03a23-cd0a-4e23-8da0-4e7af185708c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:14.462266 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db03a23-cd0a-4e23-8da0-4e7af185708c admin admin] PATH_INFO: `/v3/projects/7be9a82f8cb1434cb67bbfafbea88101` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:14.465266 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db03a23-cd0a-4e23-8da0-4e7af185708c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7be9a82f8cb1434cb67bbfafbea88101)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:14.468876 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db03a23-cd0a-4e23-8da0-4e7af185708c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:14.480026 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c69740-e0cb-4036-b087-c2d963add53a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:14.505511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ca129-2cf5-4b7c-ae9a-4f5ea17f3e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:14.505511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ca129-2cf5-4b7c-ae9a-4f5ea17f3e3f admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:14.505511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ca129-2cf5-4b7c-ae9a-4f5ea17f3e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:14.505511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ca129-2cf5-4b7c-ae9a-4f5ea17f3e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:14.505846 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ca129-2cf5-4b7c-ae9a-4f5ea17f3e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:14.505846 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ca129-2cf5-4b7c-ae9a-4f5ea17f3e3f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:14.529273 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 978/1985] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:14.534982 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ca129-2cf5-4b7c-ae9a-4f5ea17f3e3f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:14.555252 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ca129-2cf5-4b7c-ae9a-4f5ea17f3e3f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:14.572745 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6db03a23-cd0a-4e23-8da0-4e7af185708c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7be9a82f8cb1434cb67bbfafbea88101', 'request_id': 'req-6db03a23-cd0a-4e23-8da0-4e7af185708c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:14.587460 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6db03a23-cd0a-4e23-8da0-4e7af185708c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7be9a82f8cb1434cb67bbfafbea88101', 'request_id': 'req-6db03a23-cd0a-4e23-8da0-4e7af185708c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:14.607910 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6db03a23-cd0a-4e23-8da0-4e7af185708c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7be9a82f8cb1434cb67bbfafbea88101', 'request_id': 'req-6db03a23-cd0a-4e23-8da0-4e7af185708c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:14.624345 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6db03a23-cd0a-4e23-8da0-4e7af185708c admin admin] The token cache is being invalidate because project 7be9a82f8cb1434cb67bbfafbea88101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:14.624791 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6db03a23-cd0a-4e23-8da0-4e7af185708c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:14.625632 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6db03a23-cd0a-4e23-8da0-4e7af185708c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:14.629044 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1008/1986] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:14 2022] DELETE /identity/v3/projects/7be9a82f8cb1434cb67bbfafbea88101 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:14.633157 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db03a23-cd0a-4e23-8da0-4e7af185708c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:14.634696 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6db03a23-cd0a-4e23-8da0-4e7af185708c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:14.653335 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec85dbf-450e-455e-ba05-7f58cbc6e592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:14.654203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec85dbf-450e-455e-ba05-7f58cbc6e592 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:14.654584 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec85dbf-450e-455e-ba05-7f58cbc6e592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:14.655511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec85dbf-450e-455e-ba05-7f58cbc6e592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:14.655742 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec85dbf-450e-455e-ba05-7f58cbc6e592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:14.658581 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec85dbf-450e-455e-ba05-7f58cbc6e592 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:14.675133 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 979/1987] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:14.679873 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec85dbf-450e-455e-ba05-7f58cbc6e592 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:14.681002 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:14.684322 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7ec85dbf-450e-455e-ba05-7f58cbc6e592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:14.700999 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec85dbf-450e-455e-ba05-7f58cbc6e592 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:14.708412 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aeed05-d725-4378-b220-9555693f628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:14.709248 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aeed05-d725-4378-b220-9555693f628c admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:14.709649 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aeed05-d725-4378-b220-9555693f628c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:14.710094 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aeed05-d725-4378-b220-9555693f628c admin admin] PATH_INFO: `/v3/projects/cf11e55151cc4868ad67a89c0ae920a4/users/c155f1a8d649499eb0a76b8c34d149f2/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:14.728178 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aeed05-d725-4378-b220-9555693f628c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf11e55151cc4868ad67a89c0ae920a4, user_id=c155f1a8d649499eb0a76b8c34d149f2, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:14.732063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aeed05-d725-4378-b220-9555693f628c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:14.732918 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db03a23-cd0a-4e23-8da0-4e7af185708c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:14.739254 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407e5de-a5c5-4831-bc1b-7e9467a54dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:14.740058 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407e5de-a5c5-4831-bc1b-7e9467a54dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:14.740491 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407e5de-a5c5-4831-bc1b-7e9467a54dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:14.740803 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407e5de-a5c5-4831-bc1b-7e9467a54dcc admin admin] PATH_INFO: `/v3/users/539e2b9ae7ed4cfa952a5376aed9a6b6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:14.742508 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407e5de-a5c5-4831-bc1b-7e9467a54dcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=539e2b9ae7ed4cfa952a5376aed9a6b6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:14.744404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407e5de-a5c5-4831-bc1b-7e9467a54dcc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:14.760251 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 980/1988] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:14 2022] PUT /identity/v3/projects/cf11e55151cc4868ad67a89c0ae920a4/users/c155f1a8d649499eb0a76b8c34d149f2/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:57:14.769602 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a645f-2549-485c-b8c4-a5de8eefd7b2 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:14.769989 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a645f-2549-485c-b8c4-a5de8eefd7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:14.770343 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a645f-2549-485c-b8c4-a5de8eefd7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:14.807281 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c407e5de-a5c5-4831-bc1b-7e9467a54dcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '539e2b9ae7ed4cfa952a5376aed9a6b6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:14.807513 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-483a645f-2549-485c-b8c4-a5de8eefd7b2 None None] MFA Rules not processed for user `c155f1a8d649499eb0a76b8c34d149f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:14.807946 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c407e5de-a5c5-4831-bc1b-7e9467a54dcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '539e2b9ae7ed4cfa952a5376aed9a6b6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:14.808649 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-483a645f-2549-485c-b8c4-a5de8eefd7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:14.822877 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c407e5de-a5c5-4831-bc1b-7e9467a54dcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '539e2b9ae7ed4cfa952a5376aed9a6b6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:14.832963 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c407e5de-a5c5-4831-bc1b-7e9467a54dcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '539e2b9ae7ed4cfa952a5376aed9a6b6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:14.833714 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c407e5de-a5c5-4831-bc1b-7e9467a54dcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '539e2b9ae7ed4cfa952a5376aed9a6b6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:14.851954 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1009/1989] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:14 2022] DELETE /identity/v3/users/539e2b9ae7ed4cfa952a5376aed9a6b6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:57:14.890559 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 981/1990] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:14.894862 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407e5de-a5c5-4831-bc1b-7e9467a54dcc admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:14.896298 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c407e5de-a5c5-4831-bc1b-7e9467a54dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:14.991128 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407e5de-a5c5-4831-bc1b-7e9467a54dcc admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:14.998082 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f41ee1-37c9-425b-a757-118ad3ca57b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:14.998729 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f41ee1-37c9-425b-a757-118ad3ca57b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:14.999305 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f41ee1-37c9-425b-a757-118ad3ca57b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:14.999666 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f41ee1-37c9-425b-a757-118ad3ca57b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:15.000347 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f41ee1-37c9-425b-a757-118ad3ca57b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:15.005983 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f41ee1-37c9-425b-a757-118ad3ca57b4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:15.052516 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1010/1991] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:14 2022] POST /identity/v3/projects => generated 365 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:15.056370 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a645f-2549-485c-b8c4-a5de8eefd7b2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:15.184661 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:15.207730 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a645f-2549-485c-b8c4-a5de8eefd7b2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:15.280284 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b9ce2-59b6-4995-b736-c2d395b4a944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:15.281205 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b9ce2-59b6-4995-b736-c2d395b4a944 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:15.281481 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b9ce2-59b6-4995-b736-c2d395b4a944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:15.281751 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b9ce2-59b6-4995-b736-c2d395b4a944 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:15.282393 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b9ce2-59b6-4995-b736-c2d395b4a944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:15.287398 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b9ce2-59b6-4995-b736-c2d395b4a944 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:15.288321 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f41ee1-37c9-425b-a757-118ad3ca57b4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:15.290211 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-39f41ee1-37c9-425b-a757-118ad3ca57b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:15.307658 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f41ee1-37c9-425b-a757-118ad3ca57b4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:15.315494 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3251f76-aa75-41fe-a8bd-3907a27d75df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:15.316358 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3251f76-aa75-41fe-a8bd-3907a27d75df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:15.316742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3251f76-aa75-41fe-a8bd-3907a27d75df admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:15.317158 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3251f76-aa75-41fe-a8bd-3907a27d75df admin admin] PATH_INFO: `/v3/projects/2b48d4ce33f641c096d078a2c5740fe0` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:15.318638 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3251f76-aa75-41fe-a8bd-3907a27d75df admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b48d4ce33f641c096d078a2c5740fe0)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:15.321084 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3251f76-aa75-41fe-a8bd-3907a27d75df admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:15.333008 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 982/1992] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:15 2022] POST /identity/v3/users => generated 289 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:57:15.337882 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b9ce2-59b6-4995-b736-c2d395b4a944 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:15.364333 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b9ce2-59b6-4995-b736-c2d395b4a944 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:15.369797 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd85e8-73e7-4ba7-80f4-dd9a4e58c55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:15.370416 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd85e8-73e7-4ba7-80f4-dd9a4e58c55a admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:15.370695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd85e8-73e7-4ba7-80f4-dd9a4e58c55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:15.371052 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd85e8-73e7-4ba7-80f4-dd9a4e58c55a admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:15.371600 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd85e8-73e7-4ba7-80f4-dd9a4e58c55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:15.373825 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:15.374264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd85e8-73e7-4ba7-80f4-dd9a4e58c55a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:15.390803 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 983/1993] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:15.396690 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd85e8-73e7-4ba7-80f4-dd9a4e58c55a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:15.410465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f3251f76-aa75-41fe-a8bd-3907a27d75df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b48d4ce33f641c096d078a2c5740fe0', 'request_id': 'req-f3251f76-aa75-41fe-a8bd-3907a27d75df'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:15.413865 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd85e8-73e7-4ba7-80f4-dd9a4e58c55a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:15.422004 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f3251f76-aa75-41fe-a8bd-3907a27d75df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b48d4ce33f641c096d078a2c5740fe0', 'request_id': 'req-f3251f76-aa75-41fe-a8bd-3907a27d75df'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:15.435979 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f3251f76-aa75-41fe-a8bd-3907a27d75df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b48d4ce33f641c096d078a2c5740fe0', 'request_id': 'req-f3251f76-aa75-41fe-a8bd-3907a27d75df'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:15.451870 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f3251f76-aa75-41fe-a8bd-3907a27d75df admin admin] The token cache is being invalidate because project 2b48d4ce33f641c096d078a2c5740fe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:15.452314 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f3251f76-aa75-41fe-a8bd-3907a27d75df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:15.452997 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f3251f76-aa75-41fe-a8bd-3907a27d75df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:15.455326 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1011/1994] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:15 2022] DELETE /identity/v3/projects/2b48d4ce33f641c096d078a2c5740fe0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:57:15.460125 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3251f76-aa75-41fe-a8bd-3907a27d75df admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:15.461960 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f3251f76-aa75-41fe-a8bd-3907a27d75df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:15.522045 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91c325-8969-43cf-8432-d79588817e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:15.523426 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91c325-8969-43cf-8432-d79588817e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:15.523903 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91c325-8969-43cf-8432-d79588817e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:15.524380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91c325-8969-43cf-8432-d79588817e44 admin admin] PATH_INFO: `/v3/projects/6e4285be206d4d2496a840b9b97b00ce/users/1d299d6191cb46778875ec5a0b11ec63/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:15.565888 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91c325-8969-43cf-8432-d79588817e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4285be206d4d2496a840b9b97b00ce, user_id=1d299d6191cb46778875ec5a0b11ec63, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:15.571725 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91c325-8969-43cf-8432-d79588817e44 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:15.581585 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3251f76-aa75-41fe-a8bd-3907a27d75df admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:15.631697 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3cb56-7811-4285-937c-a049e5bbad79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:15.641356 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3cb56-7811-4285-937c-a049e5bbad79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:15.641356 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3cb56-7811-4285-937c-a049e5bbad79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:15.641356 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3cb56-7811-4285-937c-a049e5bbad79 admin admin] PATH_INFO: `/v3/users/f2c9973dd68b4e27b139355f30c98098` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:15.644343 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3cb56-7811-4285-937c-a049e5bbad79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2c9973dd68b4e27b139355f30c98098)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:15.646670 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3cb56-7811-4285-937c-a049e5bbad79 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:15.676052 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 984/1995] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:15 2022] PUT /identity/v3/projects/6e4285be206d4d2496a840b9b97b00ce/users/1d299d6191cb46778875ec5a0b11ec63/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:15.676052 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91c325-8969-43cf-8432-d79588817e44 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:15.685069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1b91c325-8969-43cf-8432-d79588817e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:15.854236 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7df3cb56-7811-4285-937c-a049e5bbad79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2c9973dd68b4e27b139355f30c98098'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:15.855196 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7df3cb56-7811-4285-937c-a049e5bbad79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2c9973dd68b4e27b139355f30c98098'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:15.892864 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7df3cb56-7811-4285-937c-a049e5bbad79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2c9973dd68b4e27b139355f30c98098'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:15.902384 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:15.906172 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7df3cb56-7811-4285-937c-a049e5bbad79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2c9973dd68b4e27b139355f30c98098'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:15.907170 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7df3cb56-7811-4285-937c-a049e5bbad79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2c9973dd68b4e27b139355f30c98098'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:15.920271 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91c325-8969-43cf-8432-d79588817e44 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:15.932587 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673736bd-0d6e-4e05-b4b6-d0b8c50c2835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:15.933681 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673736bd-0d6e-4e05-b4b6-d0b8c50c2835 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:15.933968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673736bd-0d6e-4e05-b4b6-d0b8c50c2835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:15.934474 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673736bd-0d6e-4e05-b4b6-d0b8c50c2835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:15.935153 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673736bd-0d6e-4e05-b4b6-d0b8c50c2835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:15.937023 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673736bd-0d6e-4e05-b4b6-d0b8c50c2835 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:15.957710 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 985/1996] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:15.958975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673736bd-0d6e-4e05-b4b6-d0b8c50c2835 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:15.961009 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-673736bd-0d6e-4e05-b4b6-d0b8c50c2835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:15.963362 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1012/1997] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:15 2022] DELETE /identity/v3/users/f2c9973dd68b4e27b139355f30c98098 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:57:15.983942 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673736bd-0d6e-4e05-b4b6-d0b8c50c2835 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:16.068169 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbde8d4-f5ae-40a1-893f-00553f14dd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:16.069813 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbde8d4-f5ae-40a1-893f-00553f14dd74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:16.070188 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbde8d4-f5ae-40a1-893f-00553f14dd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:16.070639 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbde8d4-f5ae-40a1-893f-00553f14dd74 admin admin] PATH_INFO: `/v3/projects/6e4285be206d4d2496a840b9b97b00ce/users/1d299d6191cb46778875ec5a0b11ec63/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:16.073193 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbde8d4-f5ae-40a1-893f-00553f14dd74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4285be206d4d2496a840b9b97b00ce, user_id=1d299d6191cb46778875ec5a0b11ec63, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:16.076300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbde8d4-f5ae-40a1-893f-00553f14dd74 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:16.089902 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 986/1998] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:15 2022] PUT /identity/v3/projects/6e4285be206d4d2496a840b9b97b00ce/users/1d299d6191cb46778875ec5a0b11ec63/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:16.101888 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedbe6b-d0af-41ae-95e2-837ec1bb0cdf None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:16.102166 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedbe6b-d0af-41ae-95e2-837ec1bb0cdf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:16.103050 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedbe6b-d0af-41ae-95e2-837ec1bb0cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:16.143169 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5dedbe6b-d0af-41ae-95e2-837ec1bb0cdf None None] MFA Rules not processed for user `1d299d6191cb46778875ec5a0b11ec63`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:16.144590 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5dedbe6b-d0af-41ae-95e2-837ec1bb0cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:16.169588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:16.297816 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1013/1999] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:16.309753 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbde8d4-f5ae-40a1-893f-00553f14dd74 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:16.311783 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1cbde8d4-f5ae-40a1-893f-00553f14dd74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:16.450439 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbde8d4-f5ae-40a1-893f-00553f14dd74 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:16.457793 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3dc4a-474f-4905-b8f3-3c76edac1a45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:16.458498 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3dc4a-474f-4905-b8f3-3c76edac1a45 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:16.459372 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3dc4a-474f-4905-b8f3-3c76edac1a45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:16.459659 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3dc4a-474f-4905-b8f3-3c76edac1a45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:16.478662 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3dc4a-474f-4905-b8f3-3c76edac1a45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:16.479867 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3dc4a-474f-4905-b8f3-3c76edac1a45 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:16.494191 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 987/2000] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:16.575342 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedbe6b-d0af-41ae-95e2-837ec1bb0cdf None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:16.578104 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5dedbe6b-d0af-41ae-95e2-837ec1bb0cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:16.642547 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3dc4a-474f-4905-b8f3-3c76edac1a45 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:16.657354 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3dc4a-474f-4905-b8f3-3c76edac1a45 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:16.674883 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a08c72-7b27-41ff-8a1c-0a6f53e5abf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:16.676962 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a08c72-7b27-41ff-8a1c-0a6f53e5abf5 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:16.678053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a08c72-7b27-41ff-8a1c-0a6f53e5abf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:16.682818 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a08c72-7b27-41ff-8a1c-0a6f53e5abf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:16.688270 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a3a08c72-7b27-41ff-8a1c-0a6f53e5abf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:16.843190 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedbe6b-d0af-41ae-95e2-837ec1bb0cdf None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:16.856781 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb413edc-ff9e-4b78-8649-302434e5ab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:16.865019 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb413edc-ff9e-4b78-8649-302434e5ab2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:16.867607 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb413edc-ff9e-4b78-8649-302434e5ab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:16.867929 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb413edc-ff9e-4b78-8649-302434e5ab2d admin admin] PATH_INFO: `/v3/projects/bea5d5d2c8444e72ab4f62df2d2aada5` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:16.873861 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb413edc-ff9e-4b78-8649-302434e5ab2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea5d5d2c8444e72ab4f62df2d2aada5)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:16.899542 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb413edc-ff9e-4b78-8649-302434e5ab2d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:16.920550 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a08c72-7b27-41ff-8a1c-0a6f53e5abf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:16.922012 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a08c72-7b27-41ff-8a1c-0a6f53e5abf5 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:16.967962 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 988/2001] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:57:17.080875 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fb413edc-ff9e-4b78-8649-302434e5ab2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea5d5d2c8444e72ab4f62df2d2aada5', 'request_id': 'req-fb413edc-ff9e-4b78-8649-302434e5ab2d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:17.097470 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fb413edc-ff9e-4b78-8649-302434e5ab2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea5d5d2c8444e72ab4f62df2d2aada5', 'request_id': 'req-fb413edc-ff9e-4b78-8649-302434e5ab2d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:17.116441 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fb413edc-ff9e-4b78-8649-302434e5ab2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea5d5d2c8444e72ab4f62df2d2aada5', 'request_id': 'req-fb413edc-ff9e-4b78-8649-302434e5ab2d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:17.143272 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fb413edc-ff9e-4b78-8649-302434e5ab2d admin admin] The token cache is being invalidate because project bea5d5d2c8444e72ab4f62df2d2aada5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:17.144195 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fb413edc-ff9e-4b78-8649-302434e5ab2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:17.145405 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fb413edc-ff9e-4b78-8649-302434e5ab2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:17.148156 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1014/2002] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:16 2022] DELETE /identity/v3/projects/bea5d5d2c8444e72ab4f62df2d2aada5 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:17.154476 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2926a1d-f5e2-44fa-b83d-5bcb7db5ded0 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:17.155311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2926a1d-f5e2-44fa-b83d-5bcb7db5ded0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:17.155311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2926a1d-f5e2-44fa-b83d-5bcb7db5ded0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:17.191287 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d2926a1d-f5e2-44fa-b83d-5bcb7db5ded0 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:17.193916 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d2926a1d-f5e2-44fa-b83d-5bcb7db5ded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:17.255027 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:17.378060 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 989/2003] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:17.384815 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b736b31-e16d-4002-8dd6-51fd3370f660 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:17.385147 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b736b31-e16d-4002-8dd6-51fd3370f660 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:17.385447 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b736b31-e16d-4002-8dd6-51fd3370f660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:17.459406 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1b736b31-e16d-4002-8dd6-51fd3370f660 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:17.472341 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1b736b31-e16d-4002-8dd6-51fd3370f660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:17.508642 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1015/2004] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:17.513949 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2926a1d-f5e2-44fa-b83d-5bcb7db5ded0 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:17.535918 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2926a1d-f5e2-44fa-b83d-5bcb7db5ded0 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:17.555212 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b0020-565d-44c6-baac-5b0f0a25bc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:17.555934 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b0020-565d-44c6-baac-5b0f0a25bc57 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:17.556220 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b0020-565d-44c6-baac-5b0f0a25bc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:17.556502 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b0020-565d-44c6-baac-5b0f0a25bc57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:17.557207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b0020-565d-44c6-baac-5b0f0a25bc57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:57:17.557946 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b0020-565d-44c6-baac-5b0f0a25bc57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:17.559229 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b0020-565d-44c6-baac-5b0f0a25bc57 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:17.589742 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 990/2005] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:57:17.593948 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b736b31-e16d-4002-8dd6-51fd3370f660 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:17.611567 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b736b31-e16d-4002-8dd6-51fd3370f660 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:17.627562 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233a0a0-6cfc-4547-9137-2608f149afdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:17.628191 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233a0a0-6cfc-4547-9137-2608f149afdf admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:17.628476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233a0a0-6cfc-4547-9137-2608f149afdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:17.628752 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233a0a0-6cfc-4547-9137-2608f149afdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:17.629424 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233a0a0-6cfc-4547-9137-2608f149afdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:17.632040 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233a0a0-6cfc-4547-9137-2608f149afdf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:17.723069 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1016/2006] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:17 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:17.724417 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b0020-565d-44c6-baac-5b0f0a25bc57 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:17.745383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b0020-565d-44c6-baac-5b0f0a25bc57 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:17.884541 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607db2e-9330-4643-9f09-92d861a47fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:17.885273 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607db2e-9330-4643-9f09-92d861a47fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:17.885497 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607db2e-9330-4643-9f09-92d861a47fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:17.885776 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607db2e-9330-4643-9f09-92d861a47fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:17.887124 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607db2e-9330-4643-9f09-92d861a47fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:17.889159 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607db2e-9330-4643-9f09-92d861a47fe3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:17.921117 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 991/2007] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:17 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:17.936874 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233a0a0-6cfc-4547-9137-2608f149afdf admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:17.949639 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233a0a0-6cfc-4547-9137-2608f149afdf admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:17.954790 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978d871-9b19-4795-8d74-202c661fbaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:17.955764 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978d871-9b19-4795-8d74-202c661fbaae admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:17.956385 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978d871-9b19-4795-8d74-202c661fbaae admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:17.956815 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978d871-9b19-4795-8d74-202c661fbaae admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:17.957677 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978d871-9b19-4795-8d74-202c661fbaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:17.959744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978d871-9b19-4795-8d74-202c661fbaae admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:17.988862 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1017/2008] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 00:57:17.992913 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607db2e-9330-4643-9f09-92d861a47fe3 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:18.004559 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607db2e-9330-4643-9f09-92d861a47fe3 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:18.010309 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acdec4-7f28-446a-b9e3-d50750555013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:18.010977 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acdec4-7f28-446a-b9e3-d50750555013 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:18.011286 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acdec4-7f28-446a-b9e3-d50750555013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:18.011559 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acdec4-7f28-446a-b9e3-d50750555013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:18.012594 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acdec4-7f28-446a-b9e3-d50750555013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:18.013902 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acdec4-7f28-446a-b9e3-d50750555013 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:18.030698 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 992/2009] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:18.032036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978d871-9b19-4795-8d74-202c661fbaae admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:18.049244 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978d871-9b19-4795-8d74-202c661fbaae admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:18.057424 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04006454-8def-4cf8-951f-b5e835fba8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:18.058539 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04006454-8def-4cf8-951f-b5e835fba8eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:18.059238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04006454-8def-4cf8-951f-b5e835fba8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:18.060131 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04006454-8def-4cf8-951f-b5e835fba8eb admin admin] PATH_INFO: `/v3/projects/ccf608fd63c84c51ae4f904778fefa8e/users/92d05da877d24d3e919f076d0935430b/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:18.065569 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:18.090096 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04006454-8def-4cf8-951f-b5e835fba8eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf608fd63c84c51ae4f904778fefa8e, user_id=92d05da877d24d3e919f076d0935430b, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:18.093289 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04006454-8def-4cf8-951f-b5e835fba8eb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:18.110111 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1018/2010] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:18 2022] PUT /identity/v3/projects/ccf608fd63c84c51ae4f904778fefa8e/users/92d05da877d24d3e919f076d0935430b/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:18.123276 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad841b-e9d0-47d7-ac2f-4dee798eb22d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:18.123644 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad841b-e9d0-47d7-ac2f-4dee798eb22d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:18.123998 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad841b-e9d0-47d7-ac2f-4dee798eb22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:18.173269 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-15ad841b-e9d0-47d7-ac2f-4dee798eb22d None None] MFA Rules not processed for user `92d05da877d24d3e919f076d0935430b`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:18.174611 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-15ad841b-e9d0-47d7-ac2f-4dee798eb22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:18.265224 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 993/2011] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:18.272998 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04006454-8def-4cf8-951f-b5e835fba8eb admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:18.276533 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-04006454-8def-4cf8-951f-b5e835fba8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:18.370937 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04006454-8def-4cf8-951f-b5e835fba8eb admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:18.375807 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23223fc6-e575-41a1-9666-b2e079622f3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:18.377400 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23223fc6-e575-41a1-9666-b2e079622f3e service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:18.385984 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23223fc6-e575-41a1-9666-b2e079622f3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:18.385984 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23223fc6-e575-41a1-9666-b2e079622f3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:18.395351 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23223fc6-e575-41a1-9666-b2e079622f3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:18.396892 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23223fc6-e575-41a1-9666-b2e079622f3e service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:18.425604 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1019/2012] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:18.460656 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad841b-e9d0-47d7-ac2f-4dee798eb22d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:18.510043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:18.590537 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad841b-e9d0-47d7-ac2f-4dee798eb22d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:18.596408 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3da77-f374-441a-af71-b6ec25ec0fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:18.597339 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3da77-f374-441a-af71-b6ec25ec0fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:18.597726 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3da77-f374-441a-af71-b6ec25ec0fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:18.598103 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3da77-f374-441a-af71-b6ec25ec0fb6 admin admin] PATH_INFO: `/v3/users/92d05da877d24d3e919f076d0935430b` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:18.599568 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3da77-f374-441a-af71-b6ec25ec0fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d05da877d24d3e919f076d0935430b)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:18.601882 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3da77-f374-441a-af71-b6ec25ec0fb6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:18.691952 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5ae3da77-f374-441a-af71-b6ec25ec0fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d05da877d24d3e919f076d0935430b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:18.693201 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5ae3da77-f374-441a-af71-b6ec25ec0fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d05da877d24d3e919f076d0935430b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:18.706040 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5ae3da77-f374-441a-af71-b6ec25ec0fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d05da877d24d3e919f076d0935430b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:18.706718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5ae3da77-f374-441a-af71-b6ec25ec0fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d05da877d24d3e919f076d0935430b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:18.716232 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5ae3da77-f374-441a-af71-b6ec25ec0fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d05da877d24d3e919f076d0935430b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:18.746823 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 994/2013] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:18 2022] DELETE /identity/v3/users/92d05da877d24d3e919f076d0935430b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:18.752403 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc773a8-a6b0-4b13-931f-411127b4b9cd None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:18.752685 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc773a8-a6b0-4b13-931f-411127b4b9cd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:18.753191 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc773a8-a6b0-4b13-931f-411127b4b9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:18.804773 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ecc773a8-a6b0-4b13-931f-411127b4b9cd None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:18.807161 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ecc773a8-a6b0-4b13-931f-411127b4b9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:18.901964 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1020/2014] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:18.913415 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3da77-f374-441a-af71-b6ec25ec0fb6 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:18.914993 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5ae3da77-f374-441a-af71-b6ec25ec0fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:19.020353 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3da77-f374-441a-af71-b6ec25ec0fb6 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:19.025085 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa7afa-c3a3-49df-8804-e335546fb18f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:19.025735 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa7afa-c3a3-49df-8804-e335546fb18f service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:19.026028 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa7afa-c3a3-49df-8804-e335546fb18f service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:19.026305 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa7afa-c3a3-49df-8804-e335546fb18f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:19.039291 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa7afa-c3a3-49df-8804-e335546fb18f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:19.041837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa7afa-c3a3-49df-8804-e335546fb18f service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:19.058724 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 995/2015] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:19.605194 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc773a8-a6b0-4b13-931f-411127b4b9cd None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:19.607050 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ecc773a8-a6b0-4b13-931f-411127b4b9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:19.621242 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc773a8-a6b0-4b13-931f-411127b4b9cd None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:19.629994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfd52d-a265-4705-950a-73eb0b6d0d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:19.630900 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfd52d-a265-4705-950a-73eb0b6d0d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:19.631283 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfd52d-a265-4705-950a-73eb0b6d0d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:19.631662 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfd52d-a265-4705-950a-73eb0b6d0d3c admin admin] PATH_INFO: `/v3/projects/ccf608fd63c84c51ae4f904778fefa8e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:19.634003 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfd52d-a265-4705-950a-73eb0b6d0d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf608fd63c84c51ae4f904778fefa8e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:19.636703 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfd52d-a265-4705-950a-73eb0b6d0d3c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:19.699903 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-47bfd52d-a265-4705-950a-73eb0b6d0d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf608fd63c84c51ae4f904778fefa8e', 'request_id': 'req-47bfd52d-a265-4705-950a-73eb0b6d0d3c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:19.708984 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-47bfd52d-a265-4705-950a-73eb0b6d0d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf608fd63c84c51ae4f904778fefa8e', 'request_id': 'req-47bfd52d-a265-4705-950a-73eb0b6d0d3c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:19.717966 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-47bfd52d-a265-4705-950a-73eb0b6d0d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf608fd63c84c51ae4f904778fefa8e', 'request_id': 'req-47bfd52d-a265-4705-950a-73eb0b6d0d3c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:19.730268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-47bfd52d-a265-4705-950a-73eb0b6d0d3c admin admin] The token cache is being invalidate because project ccf608fd63c84c51ae4f904778fefa8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:19.730566 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-47bfd52d-a265-4705-950a-73eb0b6d0d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:19.731524 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-47bfd52d-a265-4705-950a-73eb0b6d0d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:19.733707 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1021/2016] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:19 2022] DELETE /identity/v3/projects/ccf608fd63c84c51ae4f904778fefa8e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:19.739381 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b657a-0be8-4011-9ecb-88f9bed67f09 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:19.739893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b657a-0be8-4011-9ecb-88f9bed67f09 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:19.740144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b657a-0be8-4011-9ecb-88f9bed67f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:19.763301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-0c1b657a-0be8-4011-9ecb-88f9bed67f09 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:19.765203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0c1b657a-0be8-4011-9ecb-88f9bed67f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:19.809914 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:19.840809 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 996/2017] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:57:19.849264 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af99f6-1898-410c-8859-845fec26116d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:19.849705 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af99f6-1898-410c-8859-845fec26116d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:19.850082 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af99f6-1898-410c-8859-845fec26116d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:19.877099 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c4af99f6-1898-410c-8859-845fec26116d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:19.878712 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c4af99f6-1898-410c-8859-845fec26116d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:19.892458 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1022/2018] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:19.897630 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b657a-0be8-4011-9ecb-88f9bed67f09 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:19.917302 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b657a-0be8-4011-9ecb-88f9bed67f09 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:19.923389 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ba4fc-416c-43e9-8cf9-5125144b41ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:19.924055 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ba4fc-416c-43e9-8cf9-5125144b41ac admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:19.924353 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ba4fc-416c-43e9-8cf9-5125144b41ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:19.924503 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ba4fc-416c-43e9-8cf9-5125144b41ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:19.925224 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ba4fc-416c-43e9-8cf9-5125144b41ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:57:19.925513 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ba4fc-416c-43e9-8cf9-5125144b41ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:19.927282 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ba4fc-416c-43e9-8cf9-5125144b41ac admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:19.942650 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 997/2019] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:57:19.947417 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af99f6-1898-410c-8859-845fec26116d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:19.952114 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:19.960620 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af99f6-1898-410c-8859-845fec26116d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:19.967062 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dad211-425f-4d1a-8cf2-88dcbbe63cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:19.968047 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dad211-425f-4d1a-8cf2-88dcbbe63cce admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:19.968398 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dad211-425f-4d1a-8cf2-88dcbbe63cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:19.968742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dad211-425f-4d1a-8cf2-88dcbbe63cce admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:19.969488 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dad211-425f-4d1a-8cf2-88dcbbe63cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:19.971665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dad211-425f-4d1a-8cf2-88dcbbe63cce admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:20.021018 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1023/2020] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:19 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:57:20.021845 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ba4fc-416c-43e9-8cf9-5125144b41ac admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:20.047878 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ba4fc-416c-43e9-8cf9-5125144b41ac admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:20.138449 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8e5f7-f8c6-4b03-a927-137e4a18cf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:20.139410 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8e5f7-f8c6-4b03-a927-137e4a18cf25 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:20.139825 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8e5f7-f8c6-4b03-a927-137e4a18cf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:20.140331 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8e5f7-f8c6-4b03-a927-137e4a18cf25 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:20.141237 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8e5f7-f8c6-4b03-a927-137e4a18cf25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:20.145042 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8e5f7-f8c6-4b03-a927-137e4a18cf25 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:20.174273 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 998/2021] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:20 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:20.179157 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dad211-425f-4d1a-8cf2-88dcbbe63cce admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:20.197070 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dad211-425f-4d1a-8cf2-88dcbbe63cce admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:20.202021 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916b178-5588-4661-8af9-4406d9126ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:20.202652 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916b178-5588-4661-8af9-4406d9126ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:20.202930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916b178-5588-4661-8af9-4406d9126ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:20.203194 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916b178-5588-4661-8af9-4406d9126ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:20.203878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916b178-5588-4661-8af9-4406d9126ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:20.205671 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916b178-5588-4661-8af9-4406d9126ed5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:20.216620 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1024/2022] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:20.220777 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8e5f7-f8c6-4b03-a927-137e4a18cf25 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:20.234361 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8e5f7-f8c6-4b03-a927-137e4a18cf25 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:20.242256 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45fc0b-e687-4777-97bd-1c1aa33cd9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:20.244539 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45fc0b-e687-4777-97bd-1c1aa33cd9ee admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:20.244927 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45fc0b-e687-4777-97bd-1c1aa33cd9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:20.245245 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45fc0b-e687-4777-97bd-1c1aa33cd9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:20.246066 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45fc0b-e687-4777-97bd-1c1aa33cd9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:20.249738 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45fc0b-e687-4777-97bd-1c1aa33cd9ee admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:20.271461 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 999/2023] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:20.272854 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916b178-5588-4661-8af9-4406d9126ed5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:20.287131 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916b178-5588-4661-8af9-4406d9126ed5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:20.304897 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c2218-261c-4849-8a53-e76b613aaf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:20.306099 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c2218-261c-4849-8a53-e76b613aaf48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:20.306503 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c2218-261c-4849-8a53-e76b613aaf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:20.306979 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c2218-261c-4849-8a53-e76b613aaf48 admin admin] PATH_INFO: `/v3/projects/c4bf24ea75824896bf7c33c3037e3654/users/7abd8f370307422880a120981aa4b755/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:20.335001 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c2218-261c-4849-8a53-e76b613aaf48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bf24ea75824896bf7c33c3037e3654, user_id=7abd8f370307422880a120981aa4b755, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:20.337913 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c2218-261c-4849-8a53-e76b613aaf48 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:20.359543 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1025/2024] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:20 2022] PUT /identity/v3/projects/c4bf24ea75824896bf7c33c3037e3654/users/7abd8f370307422880a120981aa4b755/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:57:20.365879 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcacded-f7b3-4dcf-a5e9-db44462ee0c8 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:20.366466 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcacded-f7b3-4dcf-a5e9-db44462ee0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:20.367021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcacded-f7b3-4dcf-a5e9-db44462ee0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:20.400458 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5bcacded-f7b3-4dcf-a5e9-db44462ee0c8 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:20.401114 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5bcacded-f7b3-4dcf-a5e9-db44462ee0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:20.494535 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1000/2025] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:20.516917 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c2218-261c-4849-8a53-e76b613aaf48 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:20.518845 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-987c2218-261c-4849-8a53-e76b613aaf48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:20.664982 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c2218-261c-4849-8a53-e76b613aaf48 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:20.671048 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd841cdd-a4ae-4a57-b557-9df8e0f79f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:20.672443 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd841cdd-a4ae-4a57-b557-9df8e0f79f34 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:20.676403 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd841cdd-a4ae-4a57-b557-9df8e0f79f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:20.676403 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd841cdd-a4ae-4a57-b557-9df8e0f79f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:20.696165 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd841cdd-a4ae-4a57-b557-9df8e0f79f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:20.697896 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd841cdd-a4ae-4a57-b557-9df8e0f79f34 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:20.716545 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1026/2026] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:22.045710 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45d230-3651-491a-82d3-95a412674fb1 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:22.046227 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45d230-3651-491a-82d3-95a412674fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:22.046431 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45d230-3651-491a-82d3-95a412674fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:22.094062 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3a45d230-3651-491a-82d3-95a412674fb1 None None] MFA Rules not processed for user `7abd8f370307422880a120981aa4b755`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:22.095419 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3a45d230-3651-491a-82d3-95a412674fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:22.144519 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:22.197870 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1001/2027] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:22.210784 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd841cdd-a4ae-4a57-b557-9df8e0f79f34 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:22.212980 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dd841cdd-a4ae-4a57-b557-9df8e0f79f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:22.297653 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd841cdd-a4ae-4a57-b557-9df8e0f79f34 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:22.303423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a14c8-d6d3-4086-b919-351bb1025fe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:22.304326 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a14c8-d6d3-4086-b919-351bb1025fe7 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:22.304326 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a14c8-d6d3-4086-b919-351bb1025fe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:22.304542 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a14c8-d6d3-4086-b919-351bb1025fe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:22.315401 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a14c8-d6d3-4086-b919-351bb1025fe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:22.317441 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a14c8-d6d3-4086-b919-351bb1025fe7 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:22.327390 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1027/2028] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:23.189603 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45d230-3651-491a-82d3-95a412674fb1 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:23.191947 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3a45d230-3651-491a-82d3-95a412674fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:23.207887 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45d230-3651-491a-82d3-95a412674fb1 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:23.213053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6b868-2536-4562-bb63-1034af9be7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:23.214025 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6b868-2536-4562-bb63-1034af9be7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:23.214317 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6b868-2536-4562-bb63-1034af9be7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:23.214601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6b868-2536-4562-bb63-1034af9be7b9 admin admin] PATH_INFO: `/v3/users/c155f1a8d649499eb0a76b8c34d149f2` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:23.215820 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6b868-2536-4562-bb63-1034af9be7b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c155f1a8d649499eb0a76b8c34d149f2)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:23.218140 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6b868-2536-4562-bb63-1034af9be7b9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:23.297343 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24b6b868-2536-4562-bb63-1034af9be7b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c155f1a8d649499eb0a76b8c34d149f2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:23.299805 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24b6b868-2536-4562-bb63-1034af9be7b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c155f1a8d649499eb0a76b8c34d149f2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:23.314353 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24b6b868-2536-4562-bb63-1034af9be7b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c155f1a8d649499eb0a76b8c34d149f2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:23.315587 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24b6b868-2536-4562-bb63-1034af9be7b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c155f1a8d649499eb0a76b8c34d149f2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:23.328124 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24b6b868-2536-4562-bb63-1034af9be7b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c155f1a8d649499eb0a76b8c34d149f2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:23.353561 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1002/2029] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:23 2022] DELETE /identity/v3/users/c155f1a8d649499eb0a76b8c34d149f2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:23.357585 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a04f4-f831-4e24-96a2-671aa3fa485c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:23.358476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a04f4-f831-4e24-96a2-671aa3fa485c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:23.358766 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a04f4-f831-4e24-96a2-671aa3fa485c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:23.379841 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e34a04f4-f831-4e24-96a2-671aa3fa485c None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:23.381244 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e34a04f4-f831-4e24-96a2-671aa3fa485c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:23.435982 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:23.456568 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1028/2030] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:23.466081 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6b868-2536-4562-bb63-1034af9be7b9 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:23.468265 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-24b6b868-2536-4562-bb63-1034af9be7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:23.529770 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6b868-2536-4562-bb63-1034af9be7b9 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:23.534069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cf6ea-b137-4189-8fc9-f23ec46b2de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:23.534682 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cf6ea-b137-4189-8fc9-f23ec46b2de9 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:23.534994 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cf6ea-b137-4189-8fc9-f23ec46b2de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:23.535278 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cf6ea-b137-4189-8fc9-f23ec46b2de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:23.544455 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cf6ea-b137-4189-8fc9-f23ec46b2de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:23.545955 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cf6ea-b137-4189-8fc9-f23ec46b2de9 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:23.556667 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1003/2031] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:23.783948 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58dad0-acd3-4007-a73e-7ee002bb0054 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:23.784137 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58dad0-acd3-4007-a73e-7ee002bb0054 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:23.784410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58dad0-acd3-4007-a73e-7ee002bb0054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:23.804602 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ad58dad0-acd3-4007-a73e-7ee002bb0054 None None] MFA Rules not processed for user `7abd8f370307422880a120981aa4b755`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:23.805890 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ad58dad0-acd3-4007-a73e-7ee002bb0054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:23.856657 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cf6ea-b137-4189-8fc9-f23ec46b2de9 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:23.858642 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5d9cf6ea-b137-4189-8fc9-f23ec46b2de9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:23.878392 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cf6ea-b137-4189-8fc9-f23ec46b2de9 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:23.878603 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1029/2032] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:23.882055 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4a7b6-15bd-4350-a378-cc7291fd626f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:23.883001 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4a7b6-15bd-4350-a378-cc7291fd626f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:23.883001 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4a7b6-15bd-4350-a378-cc7291fd626f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:23.883303 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4a7b6-15bd-4350-a378-cc7291fd626f admin admin] PATH_INFO: `/v3/projects/cf11e55151cc4868ad67a89c0ae920a4` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:23.884362 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4a7b6-15bd-4350-a378-cc7291fd626f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf11e55151cc4868ad67a89c0ae920a4)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:23.887017 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4a7b6-15bd-4350-a378-cc7291fd626f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:23.945563 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:23.947415 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b0b4a7b6-15bd-4350-a378-cc7291fd626f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf11e55151cc4868ad67a89c0ae920a4', 'request_id': 'req-b0b4a7b6-15bd-4350-a378-cc7291fd626f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:23.956700 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b0b4a7b6-15bd-4350-a378-cc7291fd626f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf11e55151cc4868ad67a89c0ae920a4', 'request_id': 'req-b0b4a7b6-15bd-4350-a378-cc7291fd626f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:23.969207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b0b4a7b6-15bd-4350-a378-cc7291fd626f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf11e55151cc4868ad67a89c0ae920a4', 'request_id': 'req-b0b4a7b6-15bd-4350-a378-cc7291fd626f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:23.983849 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b0b4a7b6-15bd-4350-a378-cc7291fd626f admin admin] The token cache is being invalidate because project cf11e55151cc4868ad67a89c0ae920a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:23.984060 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b0b4a7b6-15bd-4350-a378-cc7291fd626f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:23.984658 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b0b4a7b6-15bd-4350-a378-cc7291fd626f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:23.986491 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1004/2033] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:23 2022] DELETE /identity/v3/projects/cf11e55151cc4868ad67a89c0ae920a4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:57:23.990597 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58dad0-acd3-4007-a73e-7ee002bb0054 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:24.002081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58dad0-acd3-4007-a73e-7ee002bb0054 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:24.074745 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242067c3-4e0f-4792-af29-9f73c9431c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:24.075802 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242067c3-4e0f-4792-af29-9f73c9431c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:24.076284 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242067c3-4e0f-4792-af29-9f73c9431c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:24.076743 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242067c3-4e0f-4792-af29-9f73c9431c75 admin admin] PATH_INFO: `/v3/users/1d299d6191cb46778875ec5a0b11ec63` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:24.078751 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242067c3-4e0f-4792-af29-9f73c9431c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d299d6191cb46778875ec5a0b11ec63)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:24.083541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242067c3-4e0f-4792-af29-9f73c9431c75 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:24.157230 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-242067c3-4e0f-4792-af29-9f73c9431c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d299d6191cb46778875ec5a0b11ec63'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:24.158294 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-242067c3-4e0f-4792-af29-9f73c9431c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d299d6191cb46778875ec5a0b11ec63'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:24.173759 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-242067c3-4e0f-4792-af29-9f73c9431c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d299d6191cb46778875ec5a0b11ec63'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:24.183763 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-242067c3-4e0f-4792-af29-9f73c9431c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d299d6191cb46778875ec5a0b11ec63'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:24.184463 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-242067c3-4e0f-4792-af29-9f73c9431c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d299d6191cb46778875ec5a0b11ec63'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:24.199513 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1030/2034] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:23 2022] DELETE /identity/v3/users/1d299d6191cb46778875ec5a0b11ec63 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:24.604905 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4a7b6-15bd-4350-a378-cc7291fd626f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:24.607493 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b0b4a7b6-15bd-4350-a378-cc7291fd626f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:24.645016 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4a7b6-15bd-4350-a378-cc7291fd626f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:24.768290 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77243b-48c9-443e-b6e5-15c08877021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:24.768970 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77243b-48c9-443e-b6e5-15c08877021d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:24.769268 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77243b-48c9-443e-b6e5-15c08877021d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:24.769574 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77243b-48c9-443e-b6e5-15c08877021d admin admin] PATH_INFO: `/v3/projects/6e4285be206d4d2496a840b9b97b00ce` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:24.770737 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77243b-48c9-443e-b6e5-15c08877021d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e4285be206d4d2496a840b9b97b00ce)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:24.773636 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77243b-48c9-443e-b6e5-15c08877021d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:24.860930 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9d77243b-48c9-443e-b6e5-15c08877021d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e4285be206d4d2496a840b9b97b00ce', 'request_id': 'req-9d77243b-48c9-443e-b6e5-15c08877021d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:24.869903 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9d77243b-48c9-443e-b6e5-15c08877021d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e4285be206d4d2496a840b9b97b00ce', 'request_id': 'req-9d77243b-48c9-443e-b6e5-15c08877021d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:24.879705 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9d77243b-48c9-443e-b6e5-15c08877021d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e4285be206d4d2496a840b9b97b00ce', 'request_id': 'req-9d77243b-48c9-443e-b6e5-15c08877021d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:24.910461 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9d77243b-48c9-443e-b6e5-15c08877021d admin admin] The token cache is being invalidate because project 6e4285be206d4d2496a840b9b97b00ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:24.910461 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9d77243b-48c9-443e-b6e5-15c08877021d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:24.910461 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9d77243b-48c9-443e-b6e5-15c08877021d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:24.910461 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1005/2035] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:24 2022] DELETE /identity/v3/projects/6e4285be206d4d2496a840b9b97b00ce => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:24.914557 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c83159-a63d-4a19-ab7d-6fb91500272a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:24.915026 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c83159-a63d-4a19-ab7d-6fb91500272a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:24.915132 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c83159-a63d-4a19-ab7d-6fb91500272a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:24.940623 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-18c83159-a63d-4a19-ab7d-6fb91500272a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:24.942450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-18c83159-a63d-4a19-ab7d-6fb91500272a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:24.955591 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:25.044982 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1031/2036] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:25.050542 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872ffbc-21c5-40dc-9e48-287c62ac4c2d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:25.051038 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872ffbc-21c5-40dc-9e48-287c62ac4c2d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:25.051342 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872ffbc-21c5-40dc-9e48-287c62ac4c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:25.090382 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-1872ffbc-21c5-40dc-9e48-287c62ac4c2d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:25.091582 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1872ffbc-21c5-40dc-9e48-287c62ac4c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:25.103164 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1006/2037] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:25.107233 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c83159-a63d-4a19-ab7d-6fb91500272a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:25.122309 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c83159-a63d-4a19-ab7d-6fb91500272a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:25.128931 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d854ea-c968-4282-acd9-94bec65bcd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:25.129839 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d854ea-c968-4282-acd9-94bec65bcd50 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:25.130265 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d854ea-c968-4282-acd9-94bec65bcd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:25.130684 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d854ea-c968-4282-acd9-94bec65bcd50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:25.131522 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d854ea-c968-4282-acd9-94bec65bcd50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:57:25.131974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d854ea-c968-4282-acd9-94bec65bcd50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:25.133832 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d854ea-c968-4282-acd9-94bec65bcd50 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:25.152197 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1032/2038] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:57:25.156586 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872ffbc-21c5-40dc-9e48-287c62ac4c2d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:25.171180 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872ffbc-21c5-40dc-9e48-287c62ac4c2d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:25.178297 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383e78d-2484-4319-b3c5-0b28bc8f4086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:25.179073 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383e78d-2484-4319-b3c5-0b28bc8f4086 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:25.179419 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383e78d-2484-4319-b3c5-0b28bc8f4086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:25.179756 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383e78d-2484-4319-b3c5-0b28bc8f4086 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:25.180483 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383e78d-2484-4319-b3c5-0b28bc8f4086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:25.182760 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383e78d-2484-4319-b3c5-0b28bc8f4086 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:25.229332 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1007/2039] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:25 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:57:25.230460 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d854ea-c968-4282-acd9-94bec65bcd50 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:25.246691 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d854ea-c968-4282-acd9-94bec65bcd50 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:25.341862 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f71bf9-92b6-4756-b618-a9edc4517b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:25.343285 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f71bf9-92b6-4756-b618-a9edc4517b84 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:25.349504 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f71bf9-92b6-4756-b618-a9edc4517b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:25.349811 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f71bf9-92b6-4756-b618-a9edc4517b84 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:25.351187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f71bf9-92b6-4756-b618-a9edc4517b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:25.353487 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f71bf9-92b6-4756-b618-a9edc4517b84 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:25.387947 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1033/2040] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:25 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:25.389248 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383e78d-2484-4319-b3c5-0b28bc8f4086 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:25.402517 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383e78d-2484-4319-b3c5-0b28bc8f4086 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:25.414678 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830a9a3-2a7c-4f36-b903-fd3c05e72c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:25.415075 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830a9a3-2a7c-4f36-b903-fd3c05e72c6e admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:25.419618 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830a9a3-2a7c-4f36-b903-fd3c05e72c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:25.419968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830a9a3-2a7c-4f36-b903-fd3c05e72c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:25.420828 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830a9a3-2a7c-4f36-b903-fd3c05e72c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:25.422675 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830a9a3-2a7c-4f36-b903-fd3c05e72c6e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:25.437009 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1008/2041] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 00:57:25.438831 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f71bf9-92b6-4756-b618-a9edc4517b84 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:25.451390 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f71bf9-92b6-4756-b618-a9edc4517b84 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:25.457229 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47cf4b-e844-4b0f-847d-85e6902decb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:25.457829 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47cf4b-e844-4b0f-847d-85e6902decb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:25.458102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47cf4b-e844-4b0f-847d-85e6902decb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:25.458366 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47cf4b-e844-4b0f-847d-85e6902decb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:25.459000 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47cf4b-e844-4b0f-847d-85e6902decb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:25.460585 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47cf4b-e844-4b0f-847d-85e6902decb3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:25.475331 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1034/2042] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:25.478033 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830a9a3-2a7c-4f36-b903-fd3c05e72c6e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:25.491174 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830a9a3-2a7c-4f36-b903-fd3c05e72c6e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:25.496625 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b359da3-4050-4fef-a1bc-18f29b9f32ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:25.497594 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b359da3-4050-4fef-a1bc-18f29b9f32ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:25.497872 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b359da3-4050-4fef-a1bc-18f29b9f32ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:25.498143 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b359da3-4050-4fef-a1bc-18f29b9f32ff admin admin] PATH_INFO: `/v3/projects/a1d8395a7c0d4fe590ddbddeab3b22e4/users/05de3fd320c14f2b883a908938d515bc/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:25.514226 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b359da3-4050-4fef-a1bc-18f29b9f32ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d8395a7c0d4fe590ddbddeab3b22e4, user_id=05de3fd320c14f2b883a908938d515bc, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:25.517418 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b359da3-4050-4fef-a1bc-18f29b9f32ff admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:25.531973 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1009/2043] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:25 2022] PUT /identity/v3/projects/a1d8395a7c0d4fe590ddbddeab3b22e4/users/05de3fd320c14f2b883a908938d515bc/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:25.544593 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3ef97-03a6-4b31-9911-37ce56ece626 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:25.545011 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3ef97-03a6-4b31-9911-37ce56ece626 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:25.545194 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3ef97-03a6-4b31-9911-37ce56ece626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:25.577320 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d7b3ef97-03a6-4b31-9911-37ce56ece626 None None] MFA Rules not processed for user `05de3fd320c14f2b883a908938d515bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:25.578044 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d7b3ef97-03a6-4b31-9911-37ce56ece626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:25.661288 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1035/2044] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:25.669812 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b359da3-4050-4fef-a1bc-18f29b9f32ff admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:25.679272 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:25.778687 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b359da3-4050-4fef-a1bc-18f29b9f32ff admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:25.787347 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427566ed-e96c-4d68-9cb7-2fbf2aefe31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:25.788242 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427566ed-e96c-4d68-9cb7-2fbf2aefe31c admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:25.788819 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427566ed-e96c-4d68-9cb7-2fbf2aefe31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:25.789904 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427566ed-e96c-4d68-9cb7-2fbf2aefe31c admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:25.790884 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427566ed-e96c-4d68-9cb7-2fbf2aefe31c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:25.793491 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427566ed-e96c-4d68-9cb7-2fbf2aefe31c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:25.830681 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1010/2045] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:25 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:25.835299 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3ef97-03a6-4b31-9911-37ce56ece626 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:25.847790 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3ef97-03a6-4b31-9911-37ce56ece626 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:25.857130 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:25.942164 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614925dd-8dad-4433-ad1c-5af255ba930c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:25.942821 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614925dd-8dad-4433-ad1c-5af255ba930c admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:25.943091 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614925dd-8dad-4433-ad1c-5af255ba930c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:25.943356 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614925dd-8dad-4433-ad1c-5af255ba930c admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:25.943981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614925dd-8dad-4433-ad1c-5af255ba930c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:25.946101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614925dd-8dad-4433-ad1c-5af255ba930c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:25.973013 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1036/2046] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:25 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:25.975653 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427566ed-e96c-4d68-9cb7-2fbf2aefe31c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:25.987216 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427566ed-e96c-4d68-9cb7-2fbf2aefe31c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:25.991917 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c8f88-0183-44fa-b453-a11620703a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:25.992562 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c8f88-0183-44fa-b453-a11620703a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:25.992849 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c8f88-0183-44fa-b453-a11620703a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:25.993157 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c8f88-0183-44fa-b453-a11620703a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:25.993802 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c8f88-0183-44fa-b453-a11620703a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:25.995546 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c8f88-0183-44fa-b453-a11620703a91 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:26.007211 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1011/2047] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 00:57:26.011748 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614925dd-8dad-4433-ad1c-5af255ba930c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:26.022532 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614925dd-8dad-4433-ad1c-5af255ba930c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:26.027655 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6b9c9-358d-4710-8d8b-d514273e1cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:26.028445 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6b9c9-358d-4710-8d8b-d514273e1cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:26.028728 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6b9c9-358d-4710-8d8b-d514273e1cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:26.029034 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6b9c9-358d-4710-8d8b-d514273e1cd3 admin admin] PATH_INFO: `/v3/projects/29e0c993c3d54771944f315f14a65859/users/2f423f87b98d41edb6bcb065b5196a7e/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:26.044345 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6b9c9-358d-4710-8d8b-d514273e1cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e0c993c3d54771944f315f14a65859, user_id=2f423f87b98d41edb6bcb065b5196a7e, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:26.047048 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6b9c9-358d-4710-8d8b-d514273e1cd3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:26.062231 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1037/2048] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:26 2022] PUT /identity/v3/projects/29e0c993c3d54771944f315f14a65859/users/2f423f87b98d41edb6bcb065b5196a7e/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:26.066437 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c8f88-0183-44fa-b453-a11620703a91 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:26.076929 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c8f88-0183-44fa-b453-a11620703a91 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:26.143635 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33c825-be38-4c08-8240-8a558d19f3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:26.144176 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33c825-be38-4c08-8240-8a558d19f3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:26.144481 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33c825-be38-4c08-8240-8a558d19f3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:26.144680 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33c825-be38-4c08-8240-8a558d19f3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:26.145351 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33c825-be38-4c08-8240-8a558d19f3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:26.146989 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33c825-be38-4c08-8240-8a558d19f3e6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:26.158151 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1012/2049] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:26.163100 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6b9c9-358d-4710-8d8b-d514273e1cd3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:26.174413 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6b9c9-358d-4710-8d8b-d514273e1cd3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:26.179463 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f681dc6-08ef-4aa0-a8b1-959bffb1179e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:26.180189 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f681dc6-08ef-4aa0-a8b1-959bffb1179e admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:26.180527 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f681dc6-08ef-4aa0-a8b1-959bffb1179e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:26.181112 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f681dc6-08ef-4aa0-a8b1-959bffb1179e admin admin] PATH_INFO: `/v3/projects/29e0c993c3d54771944f315f14a65859/users/2f423f87b98d41edb6bcb065b5196a7e/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:26.183109 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f681dc6-08ef-4aa0-a8b1-959bffb1179e admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e0c993c3d54771944f315f14a65859, user_id=2f423f87b98d41edb6bcb065b5196a7e, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:26.185903 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f681dc6-08ef-4aa0-a8b1-959bffb1179e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:26.197962 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1038/2050] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:26 2022] PUT /identity/v3/projects/29e0c993c3d54771944f315f14a65859/users/2f423f87b98d41edb6bcb065b5196a7e/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:26.209677 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f6b31-026b-4486-8498-841e10eb3ef0 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:26.209985 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f6b31-026b-4486-8498-841e10eb3ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:26.210268 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f6b31-026b-4486-8498-841e10eb3ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:26.248190 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-099f6b31-026b-4486-8498-841e10eb3ef0 None None] MFA Rules not processed for user `2f423f87b98d41edb6bcb065b5196a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:26.249466 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-099f6b31-026b-4486-8498-841e10eb3ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:26.333273 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:26.345650 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1013/2051] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:26.354862 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f681dc6-08ef-4aa0-a8b1-959bffb1179e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:26.356797 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6f681dc6-08ef-4aa0-a8b1-959bffb1179e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:26.484476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f681dc6-08ef-4aa0-a8b1-959bffb1179e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:26.489549 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5517a1-a2d9-4878-8378-8c63ac5ff1fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:26.490769 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5517a1-a2d9-4878-8378-8c63ac5ff1fe service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:26.491971 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5517a1-a2d9-4878-8378-8c63ac5ff1fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:26.492491 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5517a1-a2d9-4878-8378-8c63ac5ff1fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:26.605548 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5517a1-a2d9-4878-8378-8c63ac5ff1fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:26.608240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5517a1-a2d9-4878-8378-8c63ac5ff1fe service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:26.649501 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1039/2052] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:27.033373 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f6b31-026b-4486-8498-841e10eb3ef0 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:27.034904 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-099f6b31-026b-4486-8498-841e10eb3ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:27.175190 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f6b31-026b-4486-8498-841e10eb3ef0 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:27.182682 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0c35c-265e-431f-8ec9-0b1d2dca5698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:27.183437 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0c35c-265e-431f-8ec9-0b1d2dca5698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:27.183779 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0c35c-265e-431f-8ec9-0b1d2dca5698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:27.184127 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0c35c-265e-431f-8ec9-0b1d2dca5698 admin admin] PATH_INFO: `/v3/users/af056787509040ad9ad1d08bda92100e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:27.185532 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0c35c-265e-431f-8ec9-0b1d2dca5698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af056787509040ad9ad1d08bda92100e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:27.191457 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0c35c-265e-431f-8ec9-0b1d2dca5698 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:27.263384 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-59d0c35c-265e-431f-8ec9-0b1d2dca5698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af056787509040ad9ad1d08bda92100e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:27.264176 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-59d0c35c-265e-431f-8ec9-0b1d2dca5698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af056787509040ad9ad1d08bda92100e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:27.274441 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-59d0c35c-265e-431f-8ec9-0b1d2dca5698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af056787509040ad9ad1d08bda92100e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:27.275077 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-59d0c35c-265e-431f-8ec9-0b1d2dca5698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af056787509040ad9ad1d08bda92100e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:27.284307 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-59d0c35c-265e-431f-8ec9-0b1d2dca5698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af056787509040ad9ad1d08bda92100e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:27.304556 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1014/2053] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:27 2022] DELETE /identity/v3/users/af056787509040ad9ad1d08bda92100e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:27.309124 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f579fc-d1ac-48d8-9d24-34e87f873c71 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:27.309609 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f579fc-d1ac-48d8-9d24-34e87f873c71 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:27.309722 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f579fc-d1ac-48d8-9d24-34e87f873c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:27.330326 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-76f579fc-d1ac-48d8-9d24-34e87f873c71 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:27.331657 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-76f579fc-d1ac-48d8-9d24-34e87f873c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:27.361804 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:27.422704 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1040/2054] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:27.434150 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0c35c-265e-431f-8ec9-0b1d2dca5698 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:27.435811 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-59d0c35c-265e-431f-8ec9-0b1d2dca5698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:27.503497 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0c35c-265e-431f-8ec9-0b1d2dca5698 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:27.507986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8d99f-c155-4c1d-b4e2-6af5d057d24d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:27.508633 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8d99f-c155-4c1d-b4e2-6af5d057d24d service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:27.508909 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8d99f-c155-4c1d-b4e2-6af5d057d24d service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:27.509215 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8d99f-c155-4c1d-b4e2-6af5d057d24d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:27.520054 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8d99f-c155-4c1d-b4e2-6af5d057d24d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:27.521704 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8d99f-c155-4c1d-b4e2-6af5d057d24d service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:27.541747 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1015/2055] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:27.964022 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f579fc-d1ac-48d8-9d24-34e87f873c71 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:27.966914 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-76f579fc-d1ac-48d8-9d24-34e87f873c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:27.991564 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f579fc-d1ac-48d8-9d24-34e87f873c71 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:28.001779 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fdde3-e630-4da5-aae3-e03f1c7d9f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:28.002494 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fdde3-e630-4da5-aae3-e03f1c7d9f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:28.002775 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fdde3-e630-4da5-aae3-e03f1c7d9f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:28.003207 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fdde3-e630-4da5-aae3-e03f1c7d9f1c admin admin] PATH_INFO: `/v3/projects/c4edc3555dda40888408fe99b1db5cee` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:28.007089 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fdde3-e630-4da5-aae3-e03f1c7d9f1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4edc3555dda40888408fe99b1db5cee)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:28.009656 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fdde3-e630-4da5-aae3-e03f1c7d9f1c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:28.084132 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-992fdde3-e630-4da5-aae3-e03f1c7d9f1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4edc3555dda40888408fe99b1db5cee', 'request_id': 'req-992fdde3-e630-4da5-aae3-e03f1c7d9f1c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:28.091360 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-992fdde3-e630-4da5-aae3-e03f1c7d9f1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4edc3555dda40888408fe99b1db5cee', 'request_id': 'req-992fdde3-e630-4da5-aae3-e03f1c7d9f1c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:28.100381 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-992fdde3-e630-4da5-aae3-e03f1c7d9f1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4edc3555dda40888408fe99b1db5cee', 'request_id': 'req-992fdde3-e630-4da5-aae3-e03f1c7d9f1c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:28.117020 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-992fdde3-e630-4da5-aae3-e03f1c7d9f1c admin admin] The token cache is being invalidate because project c4edc3555dda40888408fe99b1db5cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:28.117322 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-992fdde3-e630-4da5-aae3-e03f1c7d9f1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:28.117985 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-992fdde3-e630-4da5-aae3-e03f1c7d9f1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:28.123291 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1041/2056] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:27 2022] DELETE /identity/v3/projects/c4edc3555dda40888408fe99b1db5cee => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:28.125038 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6211b9-f092-40ab-b33b-880c35d62de2 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:28.126449 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6211b9-f092-40ab-b33b-880c35d62de2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:28.126721 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6211b9-f092-40ab-b33b-880c35d62de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:28.171351 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3c6211b9-f092-40ab-b33b-880c35d62de2 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:28.179870 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3c6211b9-f092-40ab-b33b-880c35d62de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:28.202342 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:28.278406 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1016/2057] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:28.288600 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24e6a1-8f82-4759-a6ae-bd1fb221223a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:28.288909 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24e6a1-8f82-4759-a6ae-bd1fb221223a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:28.289230 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24e6a1-8f82-4759-a6ae-bd1fb221223a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:28.330457 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0a24e6a1-8f82-4759-a6ae-bd1fb221223a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:28.331744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0a24e6a1-8f82-4759-a6ae-bd1fb221223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:28.349605 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1042/2058] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:28.354168 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6211b9-f092-40ab-b33b-880c35d62de2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:28.368492 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6211b9-f092-40ab-b33b-880c35d62de2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:28.378156 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdc308-6cdb-42c2-89a2-b4840854da6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:28.379601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdc308-6cdb-42c2-89a2-b4840854da6d admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:28.379883 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdc308-6cdb-42c2-89a2-b4840854da6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:28.380184 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdc308-6cdb-42c2-89a2-b4840854da6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:28.380867 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdc308-6cdb-42c2-89a2-b4840854da6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:57:28.381438 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdc308-6cdb-42c2-89a2-b4840854da6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:28.383502 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdc308-6cdb-42c2-89a2-b4840854da6d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:28.408755 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1017/2059] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:57:28.413868 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24e6a1-8f82-4759-a6ae-bd1fb221223a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:28.425265 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24e6a1-8f82-4759-a6ae-bd1fb221223a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:28.430605 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e0e9c-90a9-40a9-a073-0bcbb250dfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:28.431232 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e0e9c-90a9-40a9-a073-0bcbb250dfa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:28.431509 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e0e9c-90a9-40a9-a073-0bcbb250dfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:28.431781 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e0e9c-90a9-40a9-a073-0bcbb250dfa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:28.433353 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e0e9c-90a9-40a9-a073-0bcbb250dfa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:28.435953 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e0e9c-90a9-40a9-a073-0bcbb250dfa0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:28.482616 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1043/2060] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:28 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:28.483809 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdc308-6cdb-42c2-89a2-b4840854da6d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:28.495086 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdc308-6cdb-42c2-89a2-b4840854da6d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:28.576634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fbb6a-8c3b-4235-b932-6303d02b3b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:28.577730 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fbb6a-8c3b-4235-b932-6303d02b3b02 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:28.578238 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fbb6a-8c3b-4235-b932-6303d02b3b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:28.579310 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fbb6a-8c3b-4235-b932-6303d02b3b02 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:28.580472 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fbb6a-8c3b-4235-b932-6303d02b3b02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:28.584374 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fbb6a-8c3b-4235-b932-6303d02b3b02 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:28.615615 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1018/2061] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:28 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:28.622364 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e0e9c-90a9-40a9-a073-0bcbb250dfa0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:28.642601 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e0e9c-90a9-40a9-a073-0bcbb250dfa0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:28.652189 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fd68b-128e-41c2-aed5-5f9861372d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:28.653282 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fd68b-128e-41c2-aed5-5f9861372d2e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:28.653783 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fd68b-128e-41c2-aed5-5f9861372d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:28.654291 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fd68b-128e-41c2-aed5-5f9861372d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:28.655507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fd68b-128e-41c2-aed5-5f9861372d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:28.659506 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fd68b-128e-41c2-aed5-5f9861372d2e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:28.687209 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1044/2062] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:28.688867 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fbb6a-8c3b-4235-b932-6303d02b3b02 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:28.699895 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fbb6a-8c3b-4235-b932-6303d02b3b02 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:28.704928 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54928c2-14cf-4b94-9b04-549afd3bc593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:28.705644 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54928c2-14cf-4b94-9b04-549afd3bc593 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:28.705993 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54928c2-14cf-4b94-9b04-549afd3bc593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:28.706334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54928c2-14cf-4b94-9b04-549afd3bc593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:28.707065 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54928c2-14cf-4b94-9b04-549afd3bc593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:28.708758 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54928c2-14cf-4b94-9b04-549afd3bc593 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:28.721391 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1019/2063] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 00:57:28.725704 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fd68b-128e-41c2-aed5-5f9861372d2e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:28.737142 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fd68b-128e-41c2-aed5-5f9861372d2e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:28.742520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d2e31-bf2a-464e-92a3-2f7807e83f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:28.743192 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d2e31-bf2a-464e-92a3-2f7807e83f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:28.743478 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d2e31-bf2a-464e-92a3-2f7807e83f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:28.743754 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d2e31-bf2a-464e-92a3-2f7807e83f2c admin admin] PATH_INFO: `/v3/projects/8630a2ffe62b447c9500cd276d363307/users/91219933644a45fa8d1754922d60bedd/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:28.760328 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d2e31-bf2a-464e-92a3-2f7807e83f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8630a2ffe62b447c9500cd276d363307, user_id=91219933644a45fa8d1754922d60bedd, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:28.763125 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d2e31-bf2a-464e-92a3-2f7807e83f2c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:28.789817 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1045/2064] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:28 2022] PUT /identity/v3/projects/8630a2ffe62b447c9500cd276d363307/users/91219933644a45fa8d1754922d60bedd/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:28.793681 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82244d8-af0a-4230-97cf-492216b5678a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:28.794001 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82244d8-af0a-4230-97cf-492216b5678a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:28.794302 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82244d8-af0a-4230-97cf-492216b5678a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:28.836581 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d82244d8-af0a-4230-97cf-492216b5678a None None] MFA Rules not processed for user `91219933644a45fa8d1754922d60bedd`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:28.837730 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d82244d8-af0a-4230-97cf-492216b5678a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:28.920130 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1020/2065] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:28.928613 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d2e31-bf2a-464e-92a3-2f7807e83f2c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:28.930346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3a5d2e31-bf2a-464e-92a3-2f7807e83f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:29.011518 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:29.038653 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d2e31-bf2a-464e-92a3-2f7807e83f2c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:29.043677 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41c509-ef0f-4376-98f5-1a51c3e9dfde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:29.046151 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41c509-ef0f-4376-98f5-1a51c3e9dfde service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:29.046665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41c509-ef0f-4376-98f5-1a51c3e9dfde service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:29.047031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41c509-ef0f-4376-98f5-1a51c3e9dfde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:29.074680 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41c509-ef0f-4376-98f5-1a51c3e9dfde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:29.076247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41c509-ef0f-4376-98f5-1a51c3e9dfde service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:29.095531 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1046/2066] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:29.543627 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82244d8-af0a-4230-97cf-492216b5678a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:29.545804 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d82244d8-af0a-4230-97cf-492216b5678a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:29.587824 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:29.678479 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82244d8-af0a-4230-97cf-492216b5678a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:29.695265 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccb3b5-c8e4-402b-8437-fbbf91a4d57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:29.696241 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccb3b5-c8e4-402b-8437-fbbf91a4d57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:29.696821 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccb3b5-c8e4-402b-8437-fbbf91a4d57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:29.698039 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccb3b5-c8e4-402b-8437-fbbf91a4d57d admin admin] PATH_INFO: `/v3/users/05de3fd320c14f2b883a908938d515bc` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:29.701167 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccb3b5-c8e4-402b-8437-fbbf91a4d57d admin admin] RBAC: Authorizing `identity:delete_user(user_id=05de3fd320c14f2b883a908938d515bc)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:29.708163 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccb3b5-c8e4-402b-8437-fbbf91a4d57d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:29.793388 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-46ccb3b5-c8e4-402b-8437-fbbf91a4d57d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05de3fd320c14f2b883a908938d515bc'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:29.794514 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-46ccb3b5-c8e4-402b-8437-fbbf91a4d57d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05de3fd320c14f2b883a908938d515bc'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:29.804687 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-46ccb3b5-c8e4-402b-8437-fbbf91a4d57d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05de3fd320c14f2b883a908938d515bc'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:29.805440 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-46ccb3b5-c8e4-402b-8437-fbbf91a4d57d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05de3fd320c14f2b883a908938d515bc'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:29.819385 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-46ccb3b5-c8e4-402b-8437-fbbf91a4d57d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05de3fd320c14f2b883a908938d515bc'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:29.842309 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1021/2067] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:29 2022] DELETE /identity/v3/users/05de3fd320c14f2b883a908938d515bc => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:29.847794 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c46977-8413-4a42-8827-119926ba1959 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:29.848287 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c46977-8413-4a42-8827-119926ba1959 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:29.848407 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c46977-8413-4a42-8827-119926ba1959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:29.873445 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-91c46977-8413-4a42-8827-119926ba1959 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:29.874675 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-91c46977-8413-4a42-8827-119926ba1959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:29.963703 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1047/2068] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:29.972095 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccb3b5-c8e4-402b-8437-fbbf91a4d57d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:29.974008 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-46ccb3b5-c8e4-402b-8437-fbbf91a4d57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:30.059018 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccb3b5-c8e4-402b-8437-fbbf91a4d57d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:30.064082 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b5168-4058-420d-8ba8-87ba188bbd1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:30.064800 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b5168-4058-420d-8ba8-87ba188bbd1c service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:30.065559 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b5168-4058-420d-8ba8-87ba188bbd1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:30.065696 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b5168-4058-420d-8ba8-87ba188bbd1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:30.082270 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b5168-4058-420d-8ba8-87ba188bbd1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:30.083757 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b5168-4058-420d-8ba8-87ba188bbd1c service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:30.095852 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1022/2069] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:57:30.555551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c46977-8413-4a42-8827-119926ba1959 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:30.561817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-91c46977-8413-4a42-8827-119926ba1959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:30.577722 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c46977-8413-4a42-8827-119926ba1959 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:30.584572 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc186906-1498-4bd1-85f8-961a78e95df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:30.585235 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc186906-1498-4bd1-85f8-961a78e95df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:30.585521 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc186906-1498-4bd1-85f8-961a78e95df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:30.585800 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc186906-1498-4bd1-85f8-961a78e95df0 admin admin] PATH_INFO: `/v3/projects/a1d8395a7c0d4fe590ddbddeab3b22e4` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:30.586989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc186906-1498-4bd1-85f8-961a78e95df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d8395a7c0d4fe590ddbddeab3b22e4)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:30.589197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc186906-1498-4bd1-85f8-961a78e95df0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:30.712328 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc186906-1498-4bd1-85f8-961a78e95df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d8395a7c0d4fe590ddbddeab3b22e4', 'request_id': 'req-bc186906-1498-4bd1-85f8-961a78e95df0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:30.731934 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc186906-1498-4bd1-85f8-961a78e95df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d8395a7c0d4fe590ddbddeab3b22e4', 'request_id': 'req-bc186906-1498-4bd1-85f8-961a78e95df0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:30.747688 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc186906-1498-4bd1-85f8-961a78e95df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d8395a7c0d4fe590ddbddeab3b22e4', 'request_id': 'req-bc186906-1498-4bd1-85f8-961a78e95df0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:30.775811 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc186906-1498-4bd1-85f8-961a78e95df0 admin admin] The token cache is being invalidate because project a1d8395a7c0d4fe590ddbddeab3b22e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:30.776116 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc186906-1498-4bd1-85f8-961a78e95df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:30.779628 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc186906-1498-4bd1-85f8-961a78e95df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:30.781904 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1048/2070] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:30 2022] DELETE /identity/v3/projects/a1d8395a7c0d4fe590ddbddeab3b22e4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:30.787071 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b5168-4058-420d-8ba8-87ba188bbd1c service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:30.800566 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b5168-4058-420d-8ba8-87ba188bbd1c service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:30.922987 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:30.993358 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e75f9f-21a8-41a6-9a8b-44a00c68aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:30.995002 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e75f9f-21a8-41a6-9a8b-44a00c68aea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:30.995345 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e75f9f-21a8-41a6-9a8b-44a00c68aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:30.995679 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e75f9f-21a8-41a6-9a8b-44a00c68aea8 admin admin] PATH_INFO: `/v3/users/2f423f87b98d41edb6bcb065b5196a7e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:30.999235 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e75f9f-21a8-41a6-9a8b-44a00c68aea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f423f87b98d41edb6bcb065b5196a7e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:31.005942 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e75f9f-21a8-41a6-9a8b-44a00c68aea8 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:31.139333 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f4e75f9f-21a8-41a6-9a8b-44a00c68aea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f423f87b98d41edb6bcb065b5196a7e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:31.140407 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f4e75f9f-21a8-41a6-9a8b-44a00c68aea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f423f87b98d41edb6bcb065b5196a7e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:31.152014 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f4e75f9f-21a8-41a6-9a8b-44a00c68aea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f423f87b98d41edb6bcb065b5196a7e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:31.153598 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f4e75f9f-21a8-41a6-9a8b-44a00c68aea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f423f87b98d41edb6bcb065b5196a7e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:31.177789 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f4e75f9f-21a8-41a6-9a8b-44a00c68aea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f423f87b98d41edb6bcb065b5196a7e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:31.210939 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1023/2071] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:30 2022] DELETE /identity/v3/users/2f423f87b98d41edb6bcb065b5196a7e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:32.506234 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc186906-1498-4bd1-85f8-961a78e95df0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:32.507700 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bc186906-1498-4bd1-85f8-961a78e95df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:32.525606 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc186906-1498-4bd1-85f8-961a78e95df0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:32.645725 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e75f9f-21a8-41a6-9a8b-44a00c68aea8 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:32.647388 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f4e75f9f-21a8-41a6-9a8b-44a00c68aea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:32.695940 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6e58b-1072-44d0-88fb-e5e6e60feb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:32.696588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6e58b-1072-44d0-88fb-e5e6e60feb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:32.696884 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6e58b-1072-44d0-88fb-e5e6e60feb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:32.700158 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6e58b-1072-44d0-88fb-e5e6e60feb37 admin admin] PATH_INFO: `/v3/projects/29e0c993c3d54771944f315f14a65859` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:32.702771 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6e58b-1072-44d0-88fb-e5e6e60feb37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e0c993c3d54771944f315f14a65859)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:32.711285 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6e58b-1072-44d0-88fb-e5e6e60feb37 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:32.729001 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:32.761413 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e75f9f-21a8-41a6-9a8b-44a00c68aea8 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:32.761413 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cfc45-6bc1-4a6a-87ac-eb12e48f8193 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:32.761413 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cfc45-6bc1-4a6a-87ac-eb12e48f8193 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:32.761413 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cfc45-6bc1-4a6a-87ac-eb12e48f8193 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:32.761786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cfc45-6bc1-4a6a-87ac-eb12e48f8193 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:32.761786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b33cfc45-6bc1-4a6a-87ac-eb12e48f8193 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:32.814042 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d0b6e58b-1072-44d0-88fb-e5e6e60feb37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e0c993c3d54771944f315f14a65859', 'request_id': 'req-d0b6e58b-1072-44d0-88fb-e5e6e60feb37'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:32.822497 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d0b6e58b-1072-44d0-88fb-e5e6e60feb37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e0c993c3d54771944f315f14a65859', 'request_id': 'req-d0b6e58b-1072-44d0-88fb-e5e6e60feb37'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:32.835909 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d0b6e58b-1072-44d0-88fb-e5e6e60feb37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e0c993c3d54771944f315f14a65859', 'request_id': 'req-d0b6e58b-1072-44d0-88fb-e5e6e60feb37'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:32.865484 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d0b6e58b-1072-44d0-88fb-e5e6e60feb37 admin admin] The token cache is being invalidate because project 29e0c993c3d54771944f315f14a65859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:32.865808 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d0b6e58b-1072-44d0-88fb-e5e6e60feb37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:32.866525 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d0b6e58b-1072-44d0-88fb-e5e6e60feb37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:32.868113 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1049/2072] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:32 2022] DELETE /identity/v3/projects/29e0c993c3d54771944f315f14a65859 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:32.882316 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cfc45-6bc1-4a6a-87ac-eb12e48f8193 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:32.883815 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cfc45-6bc1-4a6a-87ac-eb12e48f8193 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:32.896396 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1024/2073] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:57:33.080227 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6e58b-1072-44d0-88fb-e5e6e60feb37 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:33.081678 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d0b6e58b-1072-44d0-88fb-e5e6e60feb37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:33.151864 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6e58b-1072-44d0-88fb-e5e6e60feb37 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:33.157756 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e6ab0-0005-46dd-8983-b3ee3d3cb13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:33.158419 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e6ab0-0005-46dd-8983-b3ee3d3cb13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:33.158697 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e6ab0-0005-46dd-8983-b3ee3d3cb13b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:33.158968 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e6ab0-0005-46dd-8983-b3ee3d3cb13b admin admin] PATH_INFO: `/v3/users/4a82acab3a5b4808b62a72adf3c61d48` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:33.160093 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e6ab0-0005-46dd-8983-b3ee3d3cb13b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a82acab3a5b4808b62a72adf3c61d48)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:33.162047 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e6ab0-0005-46dd-8983-b3ee3d3cb13b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:33.220292 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-af8e6ab0-0005-46dd-8983-b3ee3d3cb13b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a82acab3a5b4808b62a72adf3c61d48'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:33.221291 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-af8e6ab0-0005-46dd-8983-b3ee3d3cb13b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a82acab3a5b4808b62a72adf3c61d48'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:33.235175 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-af8e6ab0-0005-46dd-8983-b3ee3d3cb13b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a82acab3a5b4808b62a72adf3c61d48'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:33.243438 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-af8e6ab0-0005-46dd-8983-b3ee3d3cb13b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a82acab3a5b4808b62a72adf3c61d48'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:33.244104 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-af8e6ab0-0005-46dd-8983-b3ee3d3cb13b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a82acab3a5b4808b62a72adf3c61d48'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:33.258235 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1050/2074] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:33 2022] DELETE /identity/v3/users/4a82acab3a5b4808b62a72adf3c61d48 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:33.471594 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cfc45-6bc1-4a6a-87ac-eb12e48f8193 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:33.475664 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b33cfc45-6bc1-4a6a-87ac-eb12e48f8193 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:33.493661 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cfc45-6bc1-4a6a-87ac-eb12e48f8193 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:33.517354 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:33.588883 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80b173-eea3-4d11-aae8-d7a6224c612a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:33.589717 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80b173-eea3-4d11-aae8-d7a6224c612a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:33.590010 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80b173-eea3-4d11-aae8-d7a6224c612a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:33.590294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80b173-eea3-4d11-aae8-d7a6224c612a admin admin] PATH_INFO: `/v3/projects/f9c28bdfe12d4a6a956d0f52696c3721` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:33.591481 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80b173-eea3-4d11-aae8-d7a6224c612a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c28bdfe12d4a6a956d0f52696c3721)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:33.594420 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80b173-eea3-4d11-aae8-d7a6224c612a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:33.701199 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4f80b173-eea3-4d11-aae8-d7a6224c612a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c28bdfe12d4a6a956d0f52696c3721', 'request_id': 'req-4f80b173-eea3-4d11-aae8-d7a6224c612a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:33.714268 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4f80b173-eea3-4d11-aae8-d7a6224c612a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c28bdfe12d4a6a956d0f52696c3721', 'request_id': 'req-4f80b173-eea3-4d11-aae8-d7a6224c612a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:33.729904 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4f80b173-eea3-4d11-aae8-d7a6224c612a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c28bdfe12d4a6a956d0f52696c3721', 'request_id': 'req-4f80b173-eea3-4d11-aae8-d7a6224c612a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:33.753406 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4f80b173-eea3-4d11-aae8-d7a6224c612a admin admin] The token cache is being invalidate because project f9c28bdfe12d4a6a956d0f52696c3721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:33.753744 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4f80b173-eea3-4d11-aae8-d7a6224c612a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:33.754834 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4f80b173-eea3-4d11-aae8-d7a6224c612a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:33.764773 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1025/2075] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:33 2022] DELETE /identity/v3/projects/f9c28bdfe12d4a6a956d0f52696c3721 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:33.770753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8805a1b-8b4d-47c4-9151-e8506b23d283 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:33.771612 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8805a1b-8b4d-47c4-9151-e8506b23d283 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:33.772071 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8805a1b-8b4d-47c4-9151-e8506b23d283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:33.799546 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a8805a1b-8b4d-47c4-9151-e8506b23d283 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:33.801329 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a8805a1b-8b4d-47c4-9151-e8506b23d283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:33.813130 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:33.882397 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1051/2076] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:33.890550 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ad526-d0b8-40fc-b561-5ff7fc3e1323 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:33.891627 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ad526-d0b8-40fc-b561-5ff7fc3e1323 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:33.892315 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ad526-d0b8-40fc-b561-5ff7fc3e1323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:33.916183 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8e7ad526-d0b8-40fc-b561-5ff7fc3e1323 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:33.917791 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8e7ad526-d0b8-40fc-b561-5ff7fc3e1323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:33.936886 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1026/2077] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:33.942379 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8805a1b-8b4d-47c4-9151-e8506b23d283 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:33.955526 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8805a1b-8b4d-47c4-9151-e8506b23d283 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:33.961624 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10cf96-9a67-483a-ac9c-8aa9cb4b54c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:33.961624 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10cf96-9a67-483a-ac9c-8aa9cb4b54c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:33.961979 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10cf96-9a67-483a-ac9c-8aa9cb4b54c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:33.962267 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10cf96-9a67-483a-ac9c-8aa9cb4b54c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:33.962769 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10cf96-9a67-483a-ac9c-8aa9cb4b54c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:57:33.963064 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10cf96-9a67-483a-ac9c-8aa9cb4b54c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:33.964792 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10cf96-9a67-483a-ac9c-8aa9cb4b54c4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:33.986403 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1052/2078] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:57:33.991830 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ad526-d0b8-40fc-b561-5ff7fc3e1323 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:34.003569 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ad526-d0b8-40fc-b561-5ff7fc3e1323 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:34.008820 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff36bcd-6490-411d-9020-b5ec57e6fbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:34.009595 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff36bcd-6490-411d-9020-b5ec57e6fbad admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:34.010504 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff36bcd-6490-411d-9020-b5ec57e6fbad admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:34.010504 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff36bcd-6490-411d-9020-b5ec57e6fbad admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:34.011002 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff36bcd-6490-411d-9020-b5ec57e6fbad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:34.012966 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff36bcd-6490-411d-9020-b5ec57e6fbad admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:34.042348 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1027/2079] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:33 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:34.046705 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10cf96-9a67-483a-ac9c-8aa9cb4b54c4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:34.060718 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10cf96-9a67-483a-ac9c-8aa9cb4b54c4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:34.130142 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdd67b-cde9-45f1-b19c-291b0cff2425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:34.130799 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdd67b-cde9-45f1-b19c-291b0cff2425 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:34.131093 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdd67b-cde9-45f1-b19c-291b0cff2425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:34.131366 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdd67b-cde9-45f1-b19c-291b0cff2425 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:34.132014 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdd67b-cde9-45f1-b19c-291b0cff2425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:34.134061 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdd67b-cde9-45f1-b19c-291b0cff2425 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:34.158641 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1053/2080] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:34 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:34.163030 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff36bcd-6490-411d-9020-b5ec57e6fbad admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:34.175554 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff36bcd-6490-411d-9020-b5ec57e6fbad admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:34.181135 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56dc479-1ef9-45ee-962d-c13abd975d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:34.181765 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56dc479-1ef9-45ee-962d-c13abd975d5d admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:34.182049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56dc479-1ef9-45ee-962d-c13abd975d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:34.182323 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56dc479-1ef9-45ee-962d-c13abd975d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:34.182970 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56dc479-1ef9-45ee-962d-c13abd975d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:34.184577 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56dc479-1ef9-45ee-962d-c13abd975d5d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:34.195738 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1028/2081] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:34.199911 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdd67b-cde9-45f1-b19c-291b0cff2425 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:34.210747 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdd67b-cde9-45f1-b19c-291b0cff2425 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:34.215465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce95066-e479-498d-b8e8-b949bd5a922f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:34.216007 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce95066-e479-498d-b8e8-b949bd5a922f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:34.216280 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce95066-e479-498d-b8e8-b949bd5a922f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:34.216550 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce95066-e479-498d-b8e8-b949bd5a922f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:34.217214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce95066-e479-498d-b8e8-b949bd5a922f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:34.218817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce95066-e479-498d-b8e8-b949bd5a922f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:34.234073 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1054/2082] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:34.238320 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56dc479-1ef9-45ee-962d-c13abd975d5d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:34.249501 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56dc479-1ef9-45ee-962d-c13abd975d5d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:34.254243 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670cc7e-a535-4997-af7d-5993c3b7660f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:34.254881 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670cc7e-a535-4997-af7d-5993c3b7660f admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:34.255158 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670cc7e-a535-4997-af7d-5993c3b7660f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:34.255424 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670cc7e-a535-4997-af7d-5993c3b7660f admin admin] PATH_INFO: `/v3/projects/3ddae0d720f94b9b80d9e49eb465bdc4/users/bff6d842f3054c80b7bc973b4643b089/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:34.272432 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670cc7e-a535-4997-af7d-5993c3b7660f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ddae0d720f94b9b80d9e49eb465bdc4, user_id=bff6d842f3054c80b7bc973b4643b089, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:34.275154 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670cc7e-a535-4997-af7d-5993c3b7660f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:34.288678 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1029/2083] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:34 2022] PUT /identity/v3/projects/3ddae0d720f94b9b80d9e49eb465bdc4/users/bff6d842f3054c80b7bc973b4643b089/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:34.299278 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f25b9-cdc6-4436-b448-71558482c2b0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:34.299588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f25b9-cdc6-4436-b448-71558482c2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:34.299860 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f25b9-cdc6-4436-b448-71558482c2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:34.330528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d59f25b9-cdc6-4436-b448-71558482c2b0 None None] MFA Rules not processed for user `bff6d842f3054c80b7bc973b4643b089`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:34.331403 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d59f25b9-cdc6-4436-b448-71558482c2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:34.412404 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1055/2084] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:34.416840 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670cc7e-a535-4997-af7d-5993c3b7660f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:34.452269 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:34.484722 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670cc7e-a535-4997-af7d-5993c3b7660f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:34.489519 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114e118-f7aa-4abc-a0ac-1785dcd8fd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:34.490127 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114e118-f7aa-4abc-a0ac-1785dcd8fd08 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:34.490407 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114e118-f7aa-4abc-a0ac-1785dcd8fd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:34.490680 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114e118-f7aa-4abc-a0ac-1785dcd8fd08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:34.491324 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114e118-f7aa-4abc-a0ac-1785dcd8fd08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:34.493316 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114e118-f7aa-4abc-a0ac-1785dcd8fd08 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:34.523164 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1030/2085] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:34 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:34.527291 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f25b9-cdc6-4436-b448-71558482c2b0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:34.539118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f25b9-cdc6-4436-b448-71558482c2b0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:34.544150 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:34.602182 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadb5e8-d87b-4ea8-aab9-2965472dd692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:34.602797 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadb5e8-d87b-4ea8-aab9-2965472dd692 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:34.603092 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadb5e8-d87b-4ea8-aab9-2965472dd692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:34.603359 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadb5e8-d87b-4ea8-aab9-2965472dd692 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:34.604016 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadb5e8-d87b-4ea8-aab9-2965472dd692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:34.606016 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadb5e8-d87b-4ea8-aab9-2965472dd692 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:34.629882 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1056/2086] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:34 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:34.633912 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114e118-f7aa-4abc-a0ac-1785dcd8fd08 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:34.645501 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114e118-f7aa-4abc-a0ac-1785dcd8fd08 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:34.651913 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c20f2f-bff8-4067-b0b6-b05d47bf8c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:34.652813 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c20f2f-bff8-4067-b0b6-b05d47bf8c6f admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:34.653118 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c20f2f-bff8-4067-b0b6-b05d47bf8c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:34.653389 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c20f2f-bff8-4067-b0b6-b05d47bf8c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:34.654044 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c20f2f-bff8-4067-b0b6-b05d47bf8c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:34.655836 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c20f2f-bff8-4067-b0b6-b05d47bf8c6f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:34.667817 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1031/2087] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:34.672278 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadb5e8-d87b-4ea8-aab9-2965472dd692 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:34.682454 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadb5e8-d87b-4ea8-aab9-2965472dd692 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:34.687259 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e40d0-a816-4e02-bca7-cf2904f5442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:34.688473 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e40d0-a816-4e02-bca7-cf2904f5442a admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:34.688753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e40d0-a816-4e02-bca7-cf2904f5442a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:34.689072 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e40d0-a816-4e02-bca7-cf2904f5442a admin admin] PATH_INFO: `/v3/projects/5136f439eecf440c9649ac36861291e3/users/ab74e78077b4425f9331533e2fc8d3b4/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:34.706981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e40d0-a816-4e02-bca7-cf2904f5442a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5136f439eecf440c9649ac36861291e3, user_id=ab74e78077b4425f9331533e2fc8d3b4, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:34.709875 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e40d0-a816-4e02-bca7-cf2904f5442a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:34.724449 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1057/2088] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:34 2022] PUT /identity/v3/projects/5136f439eecf440c9649ac36861291e3/users/ab74e78077b4425f9331533e2fc8d3b4/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:34.729680 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c20f2f-bff8-4067-b0b6-b05d47bf8c6f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:34.740727 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c20f2f-bff8-4067-b0b6-b05d47bf8c6f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:34.820030 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132e03f-e591-4187-a5eb-d7cd593e4ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:34.820646 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132e03f-e591-4187-a5eb-d7cd593e4ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:34.820906 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132e03f-e591-4187-a5eb-d7cd593e4ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:34.821208 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132e03f-e591-4187-a5eb-d7cd593e4ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:34.821847 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132e03f-e591-4187-a5eb-d7cd593e4ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:34.823472 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132e03f-e591-4187-a5eb-d7cd593e4ee0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:34.834549 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1032/2089] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:34.838803 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e40d0-a816-4e02-bca7-cf2904f5442a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:34.850960 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e40d0-a816-4e02-bca7-cf2904f5442a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:34.855944 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cbee1-46e4-4d42-a9cd-e6d22ea12630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:34.856655 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cbee1-46e4-4d42-a9cd-e6d22ea12630 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:34.856902 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cbee1-46e4-4d42-a9cd-e6d22ea12630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:34.857207 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cbee1-46e4-4d42-a9cd-e6d22ea12630 admin admin] PATH_INFO: `/v3/projects/5136f439eecf440c9649ac36861291e3/users/ab74e78077b4425f9331533e2fc8d3b4/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:34.859176 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cbee1-46e4-4d42-a9cd-e6d22ea12630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5136f439eecf440c9649ac36861291e3, user_id=ab74e78077b4425f9331533e2fc8d3b4, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:34.861924 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cbee1-46e4-4d42-a9cd-e6d22ea12630 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:34.874098 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1058/2090] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:34 2022] PUT /identity/v3/projects/5136f439eecf440c9649ac36861291e3/users/ab74e78077b4425f9331533e2fc8d3b4/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:57:34.886467 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed51f16-db24-4d4b-9968-f31f2b531d78 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:34.886762 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed51f16-db24-4d4b-9968-f31f2b531d78 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:34.887047 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed51f16-db24-4d4b-9968-f31f2b531d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:34.921660 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6ed51f16-db24-4d4b-9968-f31f2b531d78 None None] MFA Rules not processed for user `ab74e78077b4425f9331533e2fc8d3b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:34.923831 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6ed51f16-db24-4d4b-9968-f31f2b531d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:35.021294 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1033/2091] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:35.039803 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cbee1-46e4-4d42-a9cd-e6d22ea12630 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:35.041593 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a68cbee1-46e4-4d42-a9cd-e6d22ea12630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:35.137243 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cbee1-46e4-4d42-a9cd-e6d22ea12630 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:35.141930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc2df5-0b3a-483c-a925-c1644254d00e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:35.142758 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc2df5-0b3a-483c-a925-c1644254d00e service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:35.143049 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc2df5-0b3a-483c-a925-c1644254d00e service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:35.145800 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc2df5-0b3a-483c-a925-c1644254d00e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:35.157664 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc2df5-0b3a-483c-a925-c1644254d00e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:35.159386 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc2df5-0b3a-483c-a925-c1644254d00e service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:35.171219 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1059/2092] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:35.256023 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed51f16-db24-4d4b-9968-f31f2b531d78 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:35.266296 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed51f16-db24-4d4b-9968-f31f2b531d78 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:35.270323 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6151338-6ef5-4a47-9fbf-82633538b478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:35.270935 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6151338-6ef5-4a47-9fbf-82633538b478 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:35.271214 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6151338-6ef5-4a47-9fbf-82633538b478 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:35.271485 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6151338-6ef5-4a47-9fbf-82633538b478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:35.306138 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:35.348017 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6151338-6ef5-4a47-9fbf-82633538b478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:35.349664 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6151338-6ef5-4a47-9fbf-82633538b478 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:35.364089 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1034/2093] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:41.605579 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc2df5-0b3a-483c-a925-c1644254d00e service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:41.607076 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0ccc2df5-0b3a-483c-a925-c1644254d00e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:41.678915 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc2df5-0b3a-483c-a925-c1644254d00e service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:41.683629 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c43342-bdd9-4f03-8eea-e99b95457555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:41.684343 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c43342-bdd9-4f03-8eea-e99b95457555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:41.684711 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c43342-bdd9-4f03-8eea-e99b95457555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:41.685055 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c43342-bdd9-4f03-8eea-e99b95457555 admin admin] PATH_INFO: `/v3/users/91219933644a45fa8d1754922d60bedd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:41.686205 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c43342-bdd9-4f03-8eea-e99b95457555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91219933644a45fa8d1754922d60bedd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:41.688227 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c43342-bdd9-4f03-8eea-e99b95457555 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:41.693451 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:41.743617 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-01c43342-bdd9-4f03-8eea-e99b95457555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91219933644a45fa8d1754922d60bedd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:41.744346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-01c43342-bdd9-4f03-8eea-e99b95457555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91219933644a45fa8d1754922d60bedd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:41.759565 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-01c43342-bdd9-4f03-8eea-e99b95457555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91219933644a45fa8d1754922d60bedd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:41.768745 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-01c43342-bdd9-4f03-8eea-e99b95457555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91219933644a45fa8d1754922d60bedd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:41.769418 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-01c43342-bdd9-4f03-8eea-e99b95457555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91219933644a45fa8d1754922d60bedd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:41.783629 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1060/2094] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:41 2022] DELETE /identity/v3/users/91219933644a45fa8d1754922d60bedd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:41.793192 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097a14a-3991-425d-90fe-61c4bb6f26c5 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:41.793718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097a14a-3991-425d-90fe-61c4bb6f26c5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:41.793811 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097a14a-3991-425d-90fe-61c4bb6f26c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:41.826292 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-c097a14a-3991-425d-90fe-61c4bb6f26c5 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:41.827530 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c097a14a-3991-425d-90fe-61c4bb6f26c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:41.904665 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1035/2095] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:41.926318 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c43342-bdd9-4f03-8eea-e99b95457555 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:41.927859 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-01c43342-bdd9-4f03-8eea-e99b95457555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:41.988007 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c43342-bdd9-4f03-8eea-e99b95457555 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:41.991942 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204719a8-7325-4c8f-b0aa-3504cebbfac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:41.992557 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204719a8-7325-4c8f-b0aa-3504cebbfac0 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:41.992840 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204719a8-7325-4c8f-b0aa-3504cebbfac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:41.993153 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204719a8-7325-4c8f-b0aa-3504cebbfac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:42.002822 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204719a8-7325-4c8f-b0aa-3504cebbfac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:42.004308 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204719a8-7325-4c8f-b0aa-3504cebbfac0 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:42.016380 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1061/2096] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:42.310889 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097a14a-3991-425d-90fe-61c4bb6f26c5 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:42.312922 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c097a14a-3991-425d-90fe-61c4bb6f26c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:42.329222 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097a14a-3991-425d-90fe-61c4bb6f26c5 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:42.335015 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225da683-1c00-48e5-9573-96e71193bffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:42.335723 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225da683-1c00-48e5-9573-96e71193bffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:42.335996 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225da683-1c00-48e5-9573-96e71193bffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:42.336323 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225da683-1c00-48e5-9573-96e71193bffb admin admin] PATH_INFO: `/v3/projects/8630a2ffe62b447c9500cd276d363307` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:42.337499 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225da683-1c00-48e5-9573-96e71193bffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8630a2ffe62b447c9500cd276d363307)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:42.339624 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225da683-1c00-48e5-9573-96e71193bffb admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:42.395418 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-225da683-1c00-48e5-9573-96e71193bffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8630a2ffe62b447c9500cd276d363307', 'request_id': 'req-225da683-1c00-48e5-9573-96e71193bffb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:42.401699 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-225da683-1c00-48e5-9573-96e71193bffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8630a2ffe62b447c9500cd276d363307', 'request_id': 'req-225da683-1c00-48e5-9573-96e71193bffb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:42.413620 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-225da683-1c00-48e5-9573-96e71193bffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8630a2ffe62b447c9500cd276d363307', 'request_id': 'req-225da683-1c00-48e5-9573-96e71193bffb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:42.427790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-225da683-1c00-48e5-9573-96e71193bffb admin admin] The token cache is being invalidate because project 8630a2ffe62b447c9500cd276d363307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:42.428308 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-225da683-1c00-48e5-9573-96e71193bffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:42.429127 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-225da683-1c00-48e5-9573-96e71193bffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:42.431326 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1036/2097] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:42 2022] DELETE /identity/v3/projects/8630a2ffe62b447c9500cd276d363307 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:42.440258 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96004df0-cc9a-4ffd-b6e8-93c3ff04d650 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:42.440726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96004df0-cc9a-4ffd-b6e8-93c3ff04d650 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:42.441320 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96004df0-cc9a-4ffd-b6e8-93c3ff04d650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:42.462987 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-96004df0-cc9a-4ffd-b6e8-93c3ff04d650 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:42.464346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-96004df0-cc9a-4ffd-b6e8-93c3ff04d650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:42.541149 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1062/2098] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:42.546622 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041c28f-d49e-40fb-ba70-bfbb66b7d919 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:42.547601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041c28f-d49e-40fb-ba70-bfbb66b7d919 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:42.548031 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041c28f-d49e-40fb-ba70-bfbb66b7d919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:42.574281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-9041c28f-d49e-40fb-ba70-bfbb66b7d919 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:42.584420 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9041c28f-d49e-40fb-ba70-bfbb66b7d919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:42.597017 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1037/2099] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:42.598841 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96004df0-cc9a-4ffd-b6e8-93c3ff04d650 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:42.612230 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96004df0-cc9a-4ffd-b6e8-93c3ff04d650 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:42.617241 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff2206-40bc-4a52-af92-cf0691ae6114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:42.617878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff2206-40bc-4a52-af92-cf0691ae6114 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:42.618167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff2206-40bc-4a52-af92-cf0691ae6114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:42.618435 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff2206-40bc-4a52-af92-cf0691ae6114 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:42.619084 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff2206-40bc-4a52-af92-cf0691ae6114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:57:42.619373 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff2206-40bc-4a52-af92-cf0691ae6114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:42.621183 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff2206-40bc-4a52-af92-cf0691ae6114 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:42.644268 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1063/2100] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:57:42.647602 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041c28f-d49e-40fb-ba70-bfbb66b7d919 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:42.656294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041c28f-d49e-40fb-ba70-bfbb66b7d919 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:42.662206 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcb0c4-840f-4f29-8c1c-d73213f86d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:42.662714 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcb0c4-840f-4f29-8c1c-d73213f86d94 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:42.662958 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcb0c4-840f-4f29-8c1c-d73213f86d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:42.663231 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcb0c4-840f-4f29-8c1c-d73213f86d94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:42.663877 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcb0c4-840f-4f29-8c1c-d73213f86d94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:42.665876 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcb0c4-840f-4f29-8c1c-d73213f86d94 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:42.712965 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1038/2101] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:42 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:42.713384 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff2206-40bc-4a52-af92-cf0691ae6114 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:42.716684 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff2206-40bc-4a52-af92-cf0691ae6114 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:42.727035 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:42.796382 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5b928-9758-4d02-aa3b-10e192962c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:42.797122 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5b928-9758-4d02-aa3b-10e192962c96 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:42.797395 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5b928-9758-4d02-aa3b-10e192962c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:42.797666 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5b928-9758-4d02-aa3b-10e192962c96 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:42.798305 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5b928-9758-4d02-aa3b-10e192962c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:42.800230 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5b928-9758-4d02-aa3b-10e192962c96 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:42.821405 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1064/2102] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:42 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:42.825590 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcb0c4-840f-4f29-8c1c-d73213f86d94 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:42.837190 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcb0c4-840f-4f29-8c1c-d73213f86d94 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:42.841967 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c71e6-0e30-4e0e-b941-f6028e4200d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:42.842575 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c71e6-0e30-4e0e-b941-f6028e4200d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:42.842847 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c71e6-0e30-4e0e-b941-f6028e4200d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:42.843117 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c71e6-0e30-4e0e-b941-f6028e4200d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:42.844338 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c71e6-0e30-4e0e-b941-f6028e4200d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:42.845972 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c71e6-0e30-4e0e-b941-f6028e4200d0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:42.856354 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1039/2103] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:42.860606 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5b928-9758-4d02-aa3b-10e192962c96 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:42.871237 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5b928-9758-4d02-aa3b-10e192962c96 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:42.877038 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d59986-676c-4868-a6ba-637e67def4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:42.877649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d59986-676c-4868-a6ba-637e67def4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:42.877934 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d59986-676c-4868-a6ba-637e67def4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:42.878204 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d59986-676c-4868-a6ba-637e67def4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:42.878849 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d59986-676c-4868-a6ba-637e67def4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:42.880451 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d59986-676c-4868-a6ba-637e67def4e6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:42.893646 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1065/2104] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:42.898216 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c71e6-0e30-4e0e-b941-f6028e4200d0 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:42.909101 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c71e6-0e30-4e0e-b941-f6028e4200d0 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:42.913823 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebd580-3d00-4a79-94da-630a19842858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:42.914462 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebd580-3d00-4a79-94da-630a19842858 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:42.914745 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebd580-3d00-4a79-94da-630a19842858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:42.915062 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebd580-3d00-4a79-94da-630a19842858 admin admin] PATH_INFO: `/v3/projects/487af610c1e84d9193a10b3706643e5e/users/b9d25cd33e9b48a6b1df954a92ae3c21/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:42.923694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:42.933514 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebd580-3d00-4a79-94da-630a19842858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487af610c1e84d9193a10b3706643e5e, user_id=b9d25cd33e9b48a6b1df954a92ae3c21, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:42.936322 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebd580-3d00-4a79-94da-630a19842858 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:42.952758 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1040/2105] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:42 2022] PUT /identity/v3/projects/487af610c1e84d9193a10b3706643e5e/users/b9d25cd33e9b48a6b1df954a92ae3c21/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:57:42.966353 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e72c3d-0e0c-4082-a5d6-b037f691f1c0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:42.966643 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e72c3d-0e0c-4082-a5d6-b037f691f1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:42.966916 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e72c3d-0e0c-4082-a5d6-b037f691f1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:42.996405 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b2e72c3d-0e0c-4082-a5d6-b037f691f1c0 None None] MFA Rules not processed for user `b9d25cd33e9b48a6b1df954a92ae3c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:42.997915 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b2e72c3d-0e0c-4082-a5d6-b037f691f1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:43.073084 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1066/2106] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:43.077665 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebd580-3d00-4a79-94da-630a19842858 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:43.151648 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebd580-3d00-4a79-94da-630a19842858 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:43.158358 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3df9b-e554-4c34-aa6e-293347904e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:43.159032 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3df9b-e554-4c34-aa6e-293347904e91 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:43.159422 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3df9b-e554-4c34-aa6e-293347904e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:43.163287 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3df9b-e554-4c34-aa6e-293347904e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:43.163860 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3df9b-e554-4c34-aa6e-293347904e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:43.165841 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3df9b-e554-4c34-aa6e-293347904e91 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:43.206159 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1041/2107] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:43 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:43.209856 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e72c3d-0e0c-4082-a5d6-b037f691f1c0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:43.222989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e72c3d-0e0c-4082-a5d6-b037f691f1c0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:43.303060 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a1f75-9e73-4075-80a5-8ea7798dd7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:43.303670 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1f75-9e73-4075-80a5-8ea7798dd7ce admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:43.303945 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1f75-9e73-4075-80a5-8ea7798dd7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:43.304216 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1f75-9e73-4075-80a5-8ea7798dd7ce admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:43.304854 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a1f75-9e73-4075-80a5-8ea7798dd7ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:43.306820 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a1f75-9e73-4075-80a5-8ea7798dd7ce admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:43.328414 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1067/2108] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:43 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:43.332572 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3df9b-e554-4c34-aa6e-293347904e91 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:43.342696 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3df9b-e554-4c34-aa6e-293347904e91 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:43.347249 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab88c6-6274-4b22-b2c5-b6105d3665a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:43.347832 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab88c6-6274-4b22-b2c5-b6105d3665a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:43.348108 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab88c6-6274-4b22-b2c5-b6105d3665a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:43.348376 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab88c6-6274-4b22-b2c5-b6105d3665a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:43.349042 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab88c6-6274-4b22-b2c5-b6105d3665a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:43.350651 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab88c6-6274-4b22-b2c5-b6105d3665a5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:43.361833 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1042/2109] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:43.365931 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a1f75-9e73-4075-80a5-8ea7798dd7ce admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:43.377813 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a1f75-9e73-4075-80a5-8ea7798dd7ce admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:43.382619 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a84af-c0b8-4d7e-b115-b89b06144224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:43.383288 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a84af-c0b8-4d7e-b115-b89b06144224 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:43.383572 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a84af-c0b8-4d7e-b115-b89b06144224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:43.383848 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a84af-c0b8-4d7e-b115-b89b06144224 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:43.384495 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a84af-c0b8-4d7e-b115-b89b06144224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:43.386130 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a84af-c0b8-4d7e-b115-b89b06144224 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:43.391875 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:43.400763 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1068/2110] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:43.401868 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab88c6-6274-4b22-b2c5-b6105d3665a5 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:43.412439 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab88c6-6274-4b22-b2c5-b6105d3665a5 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:43.417724 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72d375-3d59-45e8-87cb-175ba2f1c74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:43.418434 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72d375-3d59-45e8-87cb-175ba2f1c74b admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:43.418715 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72d375-3d59-45e8-87cb-175ba2f1c74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:43.418987 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72d375-3d59-45e8-87cb-175ba2f1c74b admin admin] PATH_INFO: `/v3/projects/3422dbcd63904fbe811a792806d2bd35/users/a7965bcbdf8c488e87a3169730277877/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:43.441322 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72d375-3d59-45e8-87cb-175ba2f1c74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3422dbcd63904fbe811a792806d2bd35, user_id=a7965bcbdf8c488e87a3169730277877, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:43.445846 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72d375-3d59-45e8-87cb-175ba2f1c74b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:43.462221 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1043/2111] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:43 2022] PUT /identity/v3/projects/3422dbcd63904fbe811a792806d2bd35/users/a7965bcbdf8c488e87a3169730277877/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:43.472452 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c2e22-6442-4f3c-9410-e4edb35f6c0e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:43.472734 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c2e22-6442-4f3c-9410-e4edb35f6c0e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:43.473043 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c2e22-6442-4f3c-9410-e4edb35f6c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:43.502954 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-298c2e22-6442-4f3c-9410-e4edb35f6c0e None None] MFA Rules not processed for user `a7965bcbdf8c488e87a3169730277877`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:43.504149 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-298c2e22-6442-4f3c-9410-e4edb35f6c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:43.572691 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1069/2112] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:43.577318 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72d375-3d59-45e8-87cb-175ba2f1c74b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:43.646933 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72d375-3d59-45e8-87cb-175ba2f1c74b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:43.652291 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a117cd7-f534-46ad-9687-1ab1c45c4656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:43.652912 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a117cd7-f534-46ad-9687-1ab1c45c4656 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:43.653233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a117cd7-f534-46ad-9687-1ab1c45c4656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:43.653511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a117cd7-f534-46ad-9687-1ab1c45c4656 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:43.654166 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a117cd7-f534-46ad-9687-1ab1c45c4656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:43.656695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a117cd7-f534-46ad-9687-1ab1c45c4656 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:43.685642 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1044/2113] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:43 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:43.689647 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c2e22-6442-4f3c-9410-e4edb35f6c0e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:43.701114 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c2e22-6442-4f3c-9410-e4edb35f6c0e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:43.760216 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851b34b-dc01-46a7-a828-06f859267228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:43.760906 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851b34b-dc01-46a7-a828-06f859267228 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:43.761285 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851b34b-dc01-46a7-a828-06f859267228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:43.761584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851b34b-dc01-46a7-a828-06f859267228 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:43.762420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851b34b-dc01-46a7-a828-06f859267228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:43.764971 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851b34b-dc01-46a7-a828-06f859267228 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:43.787333 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1070/2114] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:43 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:43.791374 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a117cd7-f534-46ad-9687-1ab1c45c4656 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:43.803698 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a117cd7-f534-46ad-9687-1ab1c45c4656 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:43.808910 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41ec25-3210-456f-9610-25c478b865d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:43.809490 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41ec25-3210-456f-9610-25c478b865d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:43.809995 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41ec25-3210-456f-9610-25c478b865d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:43.810212 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41ec25-3210-456f-9610-25c478b865d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:43.810851 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41ec25-3210-456f-9610-25c478b865d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:43.813128 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41ec25-3210-456f-9610-25c478b865d5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:43.826562 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1045/2115] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:43.831539 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851b34b-dc01-46a7-a828-06f859267228 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:43.843133 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851b34b-dc01-46a7-a828-06f859267228 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:43.848855 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e0074-bc4f-4765-b837-5b2fa2fd0ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:43.849621 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e0074-bc4f-4765-b837-5b2fa2fd0ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:43.849835 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e0074-bc4f-4765-b837-5b2fa2fd0ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:43.850106 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e0074-bc4f-4765-b837-5b2fa2fd0ae0 admin admin] PATH_INFO: `/v3/projects/6a9a5866f0f04868ada1fc4c6b08adde/users/1a5eddcba37048d09b8658aa5002ae52/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:43.872242 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e0074-bc4f-4765-b837-5b2fa2fd0ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9a5866f0f04868ada1fc4c6b08adde, user_id=1a5eddcba37048d09b8658aa5002ae52, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:43.875702 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e0074-bc4f-4765-b837-5b2fa2fd0ae0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:43.900589 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1071/2116] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:43 2022] PUT /identity/v3/projects/6a9a5866f0f04868ada1fc4c6b08adde/users/1a5eddcba37048d09b8658aa5002ae52/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:57:43.904449 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41ec25-3210-456f-9610-25c478b865d5 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:43.915881 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41ec25-3210-456f-9610-25c478b865d5 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:43.929228 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:44.005980 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2a32a-89d5-4cf0-9110-f82d08232b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:44.006596 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2a32a-89d5-4cf0-9110-f82d08232b08 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:44.006874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2a32a-89d5-4cf0-9110-f82d08232b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:44.007144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2a32a-89d5-4cf0-9110-f82d08232b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:44.007781 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2a32a-89d5-4cf0-9110-f82d08232b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:44.009563 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2a32a-89d5-4cf0-9110-f82d08232b08 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:44.019779 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1046/2117] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:44.024260 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e0074-bc4f-4765-b837-5b2fa2fd0ae0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:44.035245 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e0074-bc4f-4765-b837-5b2fa2fd0ae0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:44.040100 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb1f43-8c44-4b3a-a404-386e1c1c20aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:44.040755 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb1f43-8c44-4b3a-a404-386e1c1c20aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:44.041062 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb1f43-8c44-4b3a-a404-386e1c1c20aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:44.041340 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb1f43-8c44-4b3a-a404-386e1c1c20aa admin admin] PATH_INFO: `/v3/projects/6a9a5866f0f04868ada1fc4c6b08adde/users/1a5eddcba37048d09b8658aa5002ae52/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:44.043348 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb1f43-8c44-4b3a-a404-386e1c1c20aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9a5866f0f04868ada1fc4c6b08adde, user_id=1a5eddcba37048d09b8658aa5002ae52, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:44.046312 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb1f43-8c44-4b3a-a404-386e1c1c20aa admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:44.058471 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1072/2118] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:44 2022] PUT /identity/v3/projects/6a9a5866f0f04868ada1fc4c6b08adde/users/1a5eddcba37048d09b8658aa5002ae52/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:44.072999 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea250dd-8e4c-4dd2-b4b1-159cdd4351c2 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:44.073112 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea250dd-8e4c-4dd2-b4b1-159cdd4351c2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:44.073378 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea250dd-8e4c-4dd2-b4b1-159cdd4351c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:44.103512 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-7ea250dd-8e4c-4dd2-b4b1-159cdd4351c2 None None] MFA Rules not processed for user `1a5eddcba37048d09b8658aa5002ae52`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:44.104734 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7ea250dd-8e4c-4dd2-b4b1-159cdd4351c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:44.182806 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1047/2119] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:44.195811 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb1f43-8c44-4b3a-a404-386e1c1c20aa admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:44.197573 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f1fb1f43-8c44-4b3a-a404-386e1c1c20aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:44.245614 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:44.260510 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb1f43-8c44-4b3a-a404-386e1c1c20aa admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:44.264566 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6fa92-ff91-4ee1-a115-bfbcdc482162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:44.265224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6fa92-ff91-4ee1-a115-bfbcdc482162 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:44.265969 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6fa92-ff91-4ee1-a115-bfbcdc482162 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:44.266301 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6fa92-ff91-4ee1-a115-bfbcdc482162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:44.327664 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6fa92-ff91-4ee1-a115-bfbcdc482162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:44.329101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6fa92-ff91-4ee1-a115-bfbcdc482162 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:44.339491 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1073/2120] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:45.980798 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea250dd-8e4c-4dd2-b4b1-159cdd4351c2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:45.991032 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea250dd-8e4c-4dd2-b4b1-159cdd4351c2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:45.995024 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde6ff6-bfc5-4506-ad31-16156e4ba26d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:45.995675 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde6ff6-bfc5-4506-ad31-16156e4ba26d service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:45.995968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde6ff6-bfc5-4506-ad31-16156e4ba26d service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:45.996263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde6ff6-bfc5-4506-ad31-16156e4ba26d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:46.062634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde6ff6-bfc5-4506-ad31-16156e4ba26d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:46.064550 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde6ff6-bfc5-4506-ad31-16156e4ba26d service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:46.075549 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1048/2121] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:46.730732 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6fa92-ff91-4ee1-a115-bfbcdc482162 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:46.739989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6fa92-ff91-4ee1-a115-bfbcdc482162 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:46.743859 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e158a9-4a95-44cf-8349-bb769cb59a60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:46.744481 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e158a9-4a95-44cf-8349-bb769cb59a60 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:46.744755 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e158a9-4a95-44cf-8349-bb769cb59a60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:46.745181 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e158a9-4a95-44cf-8349-bb769cb59a60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:46.755927 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e158a9-4a95-44cf-8349-bb769cb59a60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:46.757441 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e158a9-4a95-44cf-8349-bb769cb59a60 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:46.768315 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1074/2122] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:50.871164 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde6ff6-bfc5-4506-ad31-16156e4ba26d service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:50.907312 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:50.941836 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde6ff6-bfc5-4506-ad31-16156e4ba26d service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:50.946795 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38c63d-8d7c-410d-8167-a936a8c46211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:50.947429 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38c63d-8d7c-410d-8167-a936a8c46211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:50.947718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38c63d-8d7c-410d-8167-a936a8c46211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:50.948018 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38c63d-8d7c-410d-8167-a936a8c46211 admin admin] PATH_INFO: `/v3/users/b9d25cd33e9b48a6b1df954a92ae3c21` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:50.949233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38c63d-8d7c-410d-8167-a936a8c46211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d25cd33e9b48a6b1df954a92ae3c21)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:50.951230 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38c63d-8d7c-410d-8167-a936a8c46211 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:51.001096 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8c38c63d-8d7c-410d-8167-a936a8c46211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d25cd33e9b48a6b1df954a92ae3c21'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:51.001745 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8c38c63d-8d7c-410d-8167-a936a8c46211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d25cd33e9b48a6b1df954a92ae3c21'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:51.009810 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8c38c63d-8d7c-410d-8167-a936a8c46211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d25cd33e9b48a6b1df954a92ae3c21'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:51.010556 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8c38c63d-8d7c-410d-8167-a936a8c46211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d25cd33e9b48a6b1df954a92ae3c21'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:51.019423 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8c38c63d-8d7c-410d-8167-a936a8c46211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d25cd33e9b48a6b1df954a92ae3c21'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:51.038012 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1049/2123] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:50 2022] DELETE /identity/v3/users/b9d25cd33e9b48a6b1df954a92ae3c21 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:51.042563 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e802d4-9618-4238-8d6f-faad378a4e59 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:51.043060 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e802d4-9618-4238-8d6f-faad378a4e59 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:51.043139 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e802d4-9618-4238-8d6f-faad378a4e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:51.068839 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-67e802d4-9618-4238-8d6f-faad378a4e59 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:51.070109 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-67e802d4-9618-4238-8d6f-faad378a4e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:51.147775 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1075/2124] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:51.157698 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38c63d-8d7c-410d-8167-a936a8c46211 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:51.159135 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8c38c63d-8d7c-410d-8167-a936a8c46211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:51.230497 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38c63d-8d7c-410d-8167-a936a8c46211 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:51.234743 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e473090-b8b0-4d6d-a35c-fde61fdeae01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:51.235404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e473090-b8b0-4d6d-a35c-fde61fdeae01 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:51.235864 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e473090-b8b0-4d6d-a35c-fde61fdeae01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:51.236146 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e473090-b8b0-4d6d-a35c-fde61fdeae01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:51.246175 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e473090-b8b0-4d6d-a35c-fde61fdeae01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:51.247935 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e473090-b8b0-4d6d-a35c-fde61fdeae01 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:51.258120 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1050/2125] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:57:51.605589 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e802d4-9618-4238-8d6f-faad378a4e59 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:51.612249 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-67e802d4-9618-4238-8d6f-faad378a4e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:51.653917 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e802d4-9618-4238-8d6f-faad378a4e59 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:51.659025 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504d0d0-ec01-4a55-8aea-8f49ff5d2807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:51.660304 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504d0d0-ec01-4a55-8aea-8f49ff5d2807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:51.660596 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504d0d0-ec01-4a55-8aea-8f49ff5d2807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:51.660873 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504d0d0-ec01-4a55-8aea-8f49ff5d2807 admin admin] PATH_INFO: `/v3/projects/487af610c1e84d9193a10b3706643e5e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:51.662162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504d0d0-ec01-4a55-8aea-8f49ff5d2807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=487af610c1e84d9193a10b3706643e5e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:51.664261 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504d0d0-ec01-4a55-8aea-8f49ff5d2807 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:51.735191 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4504d0d0-ec01-4a55-8aea-8f49ff5d2807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487af610c1e84d9193a10b3706643e5e', 'request_id': 'req-4504d0d0-ec01-4a55-8aea-8f49ff5d2807'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:51.742252 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4504d0d0-ec01-4a55-8aea-8f49ff5d2807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487af610c1e84d9193a10b3706643e5e', 'request_id': 'req-4504d0d0-ec01-4a55-8aea-8f49ff5d2807'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:51.751216 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4504d0d0-ec01-4a55-8aea-8f49ff5d2807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487af610c1e84d9193a10b3706643e5e', 'request_id': 'req-4504d0d0-ec01-4a55-8aea-8f49ff5d2807'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:51.775915 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4504d0d0-ec01-4a55-8aea-8f49ff5d2807 admin admin] The token cache is being invalidate because project 487af610c1e84d9193a10b3706643e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:51.776703 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4504d0d0-ec01-4a55-8aea-8f49ff5d2807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:51.778331 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4504d0d0-ec01-4a55-8aea-8f49ff5d2807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:51.781628 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1076/2126] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:51 2022] DELETE /identity/v3/projects/487af610c1e84d9193a10b3706643e5e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:51.786765 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e473090-b8b0-4d6d-a35c-fde61fdeae01 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:51.811268 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e473090-b8b0-4d6d-a35c-fde61fdeae01 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:51.935981 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:51.965616 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed427813-f016-45f4-ac9a-8542efbe3e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:51.967389 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed427813-f016-45f4-ac9a-8542efbe3e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:51.967389 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed427813-f016-45f4-ac9a-8542efbe3e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:51.968094 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed427813-f016-45f4-ac9a-8542efbe3e6a admin admin] PATH_INFO: `/v3/users/a7965bcbdf8c488e87a3169730277877` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:51.970841 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed427813-f016-45f4-ac9a-8542efbe3e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7965bcbdf8c488e87a3169730277877)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:51.973428 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed427813-f016-45f4-ac9a-8542efbe3e6a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:52.058728 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ed427813-f016-45f4-ac9a-8542efbe3e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7965bcbdf8c488e87a3169730277877'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:52.059804 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ed427813-f016-45f4-ac9a-8542efbe3e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7965bcbdf8c488e87a3169730277877'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:52.072428 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ed427813-f016-45f4-ac9a-8542efbe3e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7965bcbdf8c488e87a3169730277877'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:52.073199 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ed427813-f016-45f4-ac9a-8542efbe3e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7965bcbdf8c488e87a3169730277877'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:52.083269 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ed427813-f016-45f4-ac9a-8542efbe3e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7965bcbdf8c488e87a3169730277877'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:52.104369 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1051/2127] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:51 2022] DELETE /identity/v3/users/a7965bcbdf8c488e87a3169730277877 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:52.580181 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504d0d0-ec01-4a55-8aea-8f49ff5d2807 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:52.582203 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4504d0d0-ec01-4a55-8aea-8f49ff5d2807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:52.597342 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504d0d0-ec01-4a55-8aea-8f49ff5d2807 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:52.603896 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:52.698506 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d29bc-ae8d-4cda-bdad-a3fadf04cce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:52.699151 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d29bc-ae8d-4cda-bdad-a3fadf04cce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:52.699462 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d29bc-ae8d-4cda-bdad-a3fadf04cce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:52.699736 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d29bc-ae8d-4cda-bdad-a3fadf04cce5 admin admin] PATH_INFO: `/v3/projects/3422dbcd63904fbe811a792806d2bd35` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:52.700908 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d29bc-ae8d-4cda-bdad-a3fadf04cce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3422dbcd63904fbe811a792806d2bd35)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:52.703189 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d29bc-ae8d-4cda-bdad-a3fadf04cce5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:52.786123 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dc8d29bc-ae8d-4cda-bdad-a3fadf04cce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3422dbcd63904fbe811a792806d2bd35', 'request_id': 'req-dc8d29bc-ae8d-4cda-bdad-a3fadf04cce5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:52.793605 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dc8d29bc-ae8d-4cda-bdad-a3fadf04cce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3422dbcd63904fbe811a792806d2bd35', 'request_id': 'req-dc8d29bc-ae8d-4cda-bdad-a3fadf04cce5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:52.805575 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dc8d29bc-ae8d-4cda-bdad-a3fadf04cce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3422dbcd63904fbe811a792806d2bd35', 'request_id': 'req-dc8d29bc-ae8d-4cda-bdad-a3fadf04cce5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:52.817935 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dc8d29bc-ae8d-4cda-bdad-a3fadf04cce5 admin admin] The token cache is being invalidate because project 3422dbcd63904fbe811a792806d2bd35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:52.818281 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dc8d29bc-ae8d-4cda-bdad-a3fadf04cce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:52.818914 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dc8d29bc-ae8d-4cda-bdad-a3fadf04cce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:52.820755 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1077/2128] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:52 2022] DELETE /identity/v3/projects/3422dbcd63904fbe811a792806d2bd35 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:52.829155 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed427813-f016-45f4-ac9a-8542efbe3e6a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:52.829155 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ed427813-f016-45f4-ac9a-8542efbe3e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:52.842358 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed427813-f016-45f4-ac9a-8542efbe3e6a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:52.907893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295faae-c9aa-48ba-a8b3-f07caa47915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:52.908726 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295faae-c9aa-48ba-a8b3-f07caa47915f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:52.909094 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295faae-c9aa-48ba-a8b3-f07caa47915f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:52.909317 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295faae-c9aa-48ba-a8b3-f07caa47915f admin admin] PATH_INFO: `/v3/users/1a5eddcba37048d09b8658aa5002ae52` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:52.910732 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295faae-c9aa-48ba-a8b3-f07caa47915f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a5eddcba37048d09b8658aa5002ae52)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:52.912756 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295faae-c9aa-48ba-a8b3-f07caa47915f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:52.974381 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c295faae-c9aa-48ba-a8b3-f07caa47915f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a5eddcba37048d09b8658aa5002ae52'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:52.976148 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c295faae-c9aa-48ba-a8b3-f07caa47915f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a5eddcba37048d09b8658aa5002ae52'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:52.998173 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c295faae-c9aa-48ba-a8b3-f07caa47915f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a5eddcba37048d09b8658aa5002ae52'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:52.998962 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c295faae-c9aa-48ba-a8b3-f07caa47915f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a5eddcba37048d09b8658aa5002ae52'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:53.015144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c295faae-c9aa-48ba-a8b3-f07caa47915f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a5eddcba37048d09b8658aa5002ae52'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:53.039504 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:53.053822 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1052/2129] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:52 2022] DELETE /identity/v3/users/1a5eddcba37048d09b8658aa5002ae52 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:53.590136 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d29bc-ae8d-4cda-bdad-a3fadf04cce5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:53.591738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dc8d29bc-ae8d-4cda-bdad-a3fadf04cce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:53.617370 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d29bc-ae8d-4cda-bdad-a3fadf04cce5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:53.688280 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc8736-0842-4124-8ca5-bbb43bfc0920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:53.689246 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc8736-0842-4124-8ca5-bbb43bfc0920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:53.689721 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc8736-0842-4124-8ca5-bbb43bfc0920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:53.689990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc8736-0842-4124-8ca5-bbb43bfc0920 admin admin] PATH_INFO: `/v3/projects/6a9a5866f0f04868ada1fc4c6b08adde` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:53.691142 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc8736-0842-4124-8ca5-bbb43bfc0920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9a5866f0f04868ada1fc4c6b08adde)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:53.693116 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc8736-0842-4124-8ca5-bbb43bfc0920 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:53.745405 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:53.759446 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ebfc8736-0842-4124-8ca5-bbb43bfc0920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9a5866f0f04868ada1fc4c6b08adde', 'request_id': 'req-ebfc8736-0842-4124-8ca5-bbb43bfc0920'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:53.768839 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ebfc8736-0842-4124-8ca5-bbb43bfc0920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9a5866f0f04868ada1fc4c6b08adde', 'request_id': 'req-ebfc8736-0842-4124-8ca5-bbb43bfc0920'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:53.777971 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ebfc8736-0842-4124-8ca5-bbb43bfc0920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9a5866f0f04868ada1fc4c6b08adde', 'request_id': 'req-ebfc8736-0842-4124-8ca5-bbb43bfc0920'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:53.792422 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ebfc8736-0842-4124-8ca5-bbb43bfc0920 admin admin] The token cache is being invalidate because project 6a9a5866f0f04868ada1fc4c6b08adde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:53.792700 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ebfc8736-0842-4124-8ca5-bbb43bfc0920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:53.793436 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ebfc8736-0842-4124-8ca5-bbb43bfc0920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:53.795028 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1078/2130] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:53 2022] DELETE /identity/v3/projects/6a9a5866f0f04868ada1fc4c6b08adde => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:53.800536 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc461f-b8b0-4d88-be6b-4f5bad8a09fb None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:53.802467 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc461f-b8b0-4d88-be6b-4f5bad8a09fb None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:53.802856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc461f-b8b0-4d88-be6b-4f5bad8a09fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:53.835323 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-85bc461f-b8b0-4d88-be6b-4f5bad8a09fb None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:53.836609 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-85bc461f-b8b0-4d88-be6b-4f5bad8a09fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:53.908641 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1053/2131] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:53.916932 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00dc7-c48b-4495-af6b-5aec77ef5161 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:53.917395 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00dc7-c48b-4495-af6b-5aec77ef5161 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:53.917738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00dc7-c48b-4495-af6b-5aec77ef5161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:53.944981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bbb00dc7-c48b-4495-af6b-5aec77ef5161 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:53.946423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bbb00dc7-c48b-4495-af6b-5aec77ef5161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:53.956261 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1079/2132] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:53.960811 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc461f-b8b0-4d88-be6b-4f5bad8a09fb None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:53.972522 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc461f-b8b0-4d88-be6b-4f5bad8a09fb None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:53.977306 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ced12-4eb6-411d-9d5f-90835af79837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:53.978049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ced12-4eb6-411d-9d5f-90835af79837 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:53.978259 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ced12-4eb6-411d-9d5f-90835af79837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:53.978605 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ced12-4eb6-411d-9d5f-90835af79837 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:53.979311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ced12-4eb6-411d-9d5f-90835af79837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:57:53.979668 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ced12-4eb6-411d-9d5f-90835af79837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:53.981415 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ced12-4eb6-411d-9d5f-90835af79837 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:53.998866 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1054/2133] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:57:54.003543 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb00dc7-c48b-4495-af6b-5aec77ef5161 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:54.018777 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb00dc7-c48b-4495-af6b-5aec77ef5161 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:54.023801 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45ef68-3bb9-4f16-89d8-3f569664cb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:54.024766 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45ef68-3bb9-4f16-89d8-3f569664cb23 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:54.025351 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45ef68-3bb9-4f16-89d8-3f569664cb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:54.025488 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45ef68-3bb9-4f16-89d8-3f569664cb23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:54.026185 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45ef68-3bb9-4f16-89d8-3f569664cb23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:54.028224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45ef68-3bb9-4f16-89d8-3f569664cb23 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:54.059455 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1080/2134] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:54 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:54.065009 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ced12-4eb6-411d-9d5f-90835af79837 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:54.076178 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ced12-4eb6-411d-9d5f-90835af79837 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:54.150449 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba8114-c1b8-47a1-93ef-e26900f62c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:54.151312 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba8114-c1b8-47a1-93ef-e26900f62c63 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:54.151402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba8114-c1b8-47a1-93ef-e26900f62c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:54.151680 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba8114-c1b8-47a1-93ef-e26900f62c63 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:54.152325 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba8114-c1b8-47a1-93ef-e26900f62c63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:54.154300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba8114-c1b8-47a1-93ef-e26900f62c63 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:54.166521 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45ef68-3bb9-4f16-89d8-3f569664cb23 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:54.167407 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4f45ef68-3bb9-4f16-89d8-3f569664cb23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:54.185571 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1055/2135] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:54 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:54.188986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45ef68-3bb9-4f16-89d8-3f569664cb23 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:54.190632 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba8114-c1b8-47a1-93ef-e26900f62c63 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:54.194789 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29c2d4-8323-4a03-a4eb-01d2a62dde8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:54.195511 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29c2d4-8323-4a03-a4eb-01d2a62dde8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:54.195859 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29c2d4-8323-4a03-a4eb-01d2a62dde8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:54.196197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29c2d4-8323-4a03-a4eb-01d2a62dde8a admin admin] PATH_INFO: `/v3/users/7b9806fefa0042a380af7ac1175c53d7` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:54.197443 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29c2d4-8323-4a03-a4eb-01d2a62dde8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b9806fefa0042a380af7ac1175c53d7)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:54.199532 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29c2d4-8323-4a03-a4eb-01d2a62dde8a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:54.209280 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba8114-c1b8-47a1-93ef-e26900f62c63 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:54.212058 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2b3db-100f-41d9-b74a-382a322fd001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:54.212847 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2b3db-100f-41d9-b74a-382a322fd001 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:54.213263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2b3db-100f-41d9-b74a-382a322fd001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:54.213806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2b3db-100f-41d9-b74a-382a322fd001 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:54.214595 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2b3db-100f-41d9-b74a-382a322fd001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:54.216988 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2b3db-100f-41d9-b74a-382a322fd001 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:54.232017 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1056/2136] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:54.237531 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2b3db-100f-41d9-b74a-382a322fd001 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:54.252047 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2b3db-100f-41d9-b74a-382a322fd001 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:54.258841 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87c6c4-bce4-49c4-8a48-cb11f2646ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:54.259064 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87c6c4-bce4-49c4-8a48-cb11f2646ebb admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:54.259243 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87c6c4-bce4-49c4-8a48-cb11f2646ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:54.259638 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87c6c4-bce4-49c4-8a48-cb11f2646ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:54.260483 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87c6c4-bce4-49c4-8a48-cb11f2646ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:54.262687 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87c6c4-bce4-49c4-8a48-cb11f2646ebb admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:54.279443 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8c29c2d4-8323-4a03-a4eb-01d2a62dde8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b9806fefa0042a380af7ac1175c53d7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:54.279808 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1057/2137] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 00:57:54.281156 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8c29c2d4-8323-4a03-a4eb-01d2a62dde8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b9806fefa0042a380af7ac1175c53d7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:54.281333 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87c6c4-bce4-49c4-8a48-cb11f2646ebb admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:54.283862 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3d87c6c4-bce4-49c4-8a48-cb11f2646ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:54.300366 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87c6c4-bce4-49c4-8a48-cb11f2646ebb admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:54.302580 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8c29c2d4-8323-4a03-a4eb-01d2a62dde8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b9806fefa0042a380af7ac1175c53d7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:54.305927 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f978c-08e8-4d8f-bfa2-eb5b6df046d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:54.306597 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f978c-08e8-4d8f-bfa2-eb5b6df046d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:54.306876 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f978c-08e8-4d8f-bfa2-eb5b6df046d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:54.307149 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f978c-08e8-4d8f-bfa2-eb5b6df046d8 admin admin] PATH_INFO: `/v3/projects/f7ef11453bfe47d7a1e8a8ec84144362/users/5aa9341fc87840bc99378f1def51167b/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:54.315860 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8c29c2d4-8323-4a03-a4eb-01d2a62dde8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b9806fefa0042a380af7ac1175c53d7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:54.316964 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8c29c2d4-8323-4a03-a4eb-01d2a62dde8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b9806fefa0042a380af7ac1175c53d7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:54.332292 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f978c-08e8-4d8f-bfa2-eb5b6df046d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ef11453bfe47d7a1e8a8ec84144362, user_id=5aa9341fc87840bc99378f1def51167b, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:54.336968 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1081/2138] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:54 2022] DELETE /identity/v3/users/7b9806fefa0042a380af7ac1175c53d7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:54.337144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f978c-08e8-4d8f-bfa2-eb5b6df046d8 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:54.358170 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1058/2139] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:54 2022] PUT /identity/v3/projects/f7ef11453bfe47d7a1e8a8ec84144362/users/5aa9341fc87840bc99378f1def51167b/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:54.364508 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a8c7f-ba88-4642-98ad-a830ddd13c42 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:54.365214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a8c7f-ba88-4642-98ad-a830ddd13c42 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:54.365537 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a8c7f-ba88-4642-98ad-a830ddd13c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:54.386753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-791a8c7f-ba88-4642-98ad-a830ddd13c42 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:54.387988 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-791a8c7f-ba88-4642-98ad-a830ddd13c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:54.469560 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1082/2140] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:54.480100 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f978c-08e8-4d8f-bfa2-eb5b6df046d8 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:54.481833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e51f978c-08e8-4d8f-bfa2-eb5b6df046d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:54.511101 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:54.555655 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f978c-08e8-4d8f-bfa2-eb5b6df046d8 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:54.559411 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d12529-bc86-4e55-934a-f305d622743a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:54.560088 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d12529-bc86-4e55-934a-f305d622743a service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:54.560375 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d12529-bc86-4e55-934a-f305d622743a service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:54.560648 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d12529-bc86-4e55-934a-f305d622743a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:54.570786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d12529-bc86-4e55-934a-f305d622743a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:54.572274 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d12529-bc86-4e55-934a-f305d622743a service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:54.590197 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1059/2141] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:54.646102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a8c7f-ba88-4642-98ad-a830ddd13c42 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:54.647579 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-791a8c7f-ba88-4642-98ad-a830ddd13c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:54.661813 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a8c7f-ba88-4642-98ad-a830ddd13c42 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:54.670374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca2431-740a-4450-b350-5543797e1abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:54.671343 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca2431-740a-4450-b350-5543797e1abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:54.671504 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca2431-740a-4450-b350-5543797e1abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:54.671852 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca2431-740a-4450-b350-5543797e1abd admin admin] PATH_INFO: `/v3/projects/1aff223229af423dabb6cf1589554a1c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:54.673139 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca2431-740a-4450-b350-5543797e1abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aff223229af423dabb6cf1589554a1c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:54.676040 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca2431-740a-4450-b350-5543797e1abd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:54.694000 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:54.754647 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4fca2431-740a-4450-b350-5543797e1abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aff223229af423dabb6cf1589554a1c', 'request_id': 'req-4fca2431-740a-4450-b350-5543797e1abd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:54.761019 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4fca2431-740a-4450-b350-5543797e1abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aff223229af423dabb6cf1589554a1c', 'request_id': 'req-4fca2431-740a-4450-b350-5543797e1abd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:54.769186 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4fca2431-740a-4450-b350-5543797e1abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aff223229af423dabb6cf1589554a1c', 'request_id': 'req-4fca2431-740a-4450-b350-5543797e1abd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:54.780016 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4fca2431-740a-4450-b350-5543797e1abd admin admin] The token cache is being invalidate because project 1aff223229af423dabb6cf1589554a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:54.780319 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4fca2431-740a-4450-b350-5543797e1abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:54.781674 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4fca2431-740a-4450-b350-5543797e1abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:54.783875 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1083/2142] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:54 2022] DELETE /identity/v3/projects/1aff223229af423dabb6cf1589554a1c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:54.788639 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d12529-bc86-4e55-934a-f305d622743a service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:54.800182 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d12529-bc86-4e55-934a-f305d622743a service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:54.872563 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574b55d-ab21-4fb9-9520-adfe87ec534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:54.873383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574b55d-ab21-4fb9-9520-adfe87ec534e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:54.873663 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574b55d-ab21-4fb9-9520-adfe87ec534e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:54.873943 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574b55d-ab21-4fb9-9520-adfe87ec534e admin admin] PATH_INFO: `/v3/users/43cc9c07797a4524b00b11e7eedc78ce` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:54.875695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574b55d-ab21-4fb9-9520-adfe87ec534e admin admin] RBAC: Authorizing `identity:delete_user(user_id=43cc9c07797a4524b00b11e7eedc78ce)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:54.877709 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574b55d-ab21-4fb9-9520-adfe87ec534e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:54.930552 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b574b55d-ab21-4fb9-9520-adfe87ec534e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43cc9c07797a4524b00b11e7eedc78ce'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:54.931222 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b574b55d-ab21-4fb9-9520-adfe87ec534e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43cc9c07797a4524b00b11e7eedc78ce'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:54.941750 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b574b55d-ab21-4fb9-9520-adfe87ec534e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43cc9c07797a4524b00b11e7eedc78ce'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:54.942396 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b574b55d-ab21-4fb9-9520-adfe87ec534e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43cc9c07797a4524b00b11e7eedc78ce'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:54.950444 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b574b55d-ab21-4fb9-9520-adfe87ec534e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43cc9c07797a4524b00b11e7eedc78ce'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:54.972462 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1060/2143] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:57:54 2022] DELETE /identity/v3/users/43cc9c07797a4524b00b11e7eedc78ce => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:55.191885 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca2431-740a-4450-b350-5543797e1abd admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:55.193697 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4fca2431-740a-4450-b350-5543797e1abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:55.209039 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca2431-740a-4450-b350-5543797e1abd admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:55.282350 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ab632-06a3-417e-9f98-ea1c069c5b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:55.282918 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ab632-06a3-417e-9f98-ea1c069c5b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:55.283202 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ab632-06a3-417e-9f98-ea1c069c5b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:55.283479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ab632-06a3-417e-9f98-ea1c069c5b68 admin admin] PATH_INFO: `/v3/projects/4ead470e64214a4dbc518c60f2c192cf` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:55.285065 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ab632-06a3-417e-9f98-ea1c069c5b68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ead470e64214a4dbc518c60f2c192cf)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:55.287031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ab632-06a3-417e-9f98-ea1c069c5b68 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:55.349408 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-672ab632-06a3-417e-9f98-ea1c069c5b68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ead470e64214a4dbc518c60f2c192cf', 'request_id': 'req-672ab632-06a3-417e-9f98-ea1c069c5b68'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:55.368011 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-672ab632-06a3-417e-9f98-ea1c069c5b68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ead470e64214a4dbc518c60f2c192cf', 'request_id': 'req-672ab632-06a3-417e-9f98-ea1c069c5b68'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:55.380368 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb498d8-0053-4eba-ba1d-3d6601000c6c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:55.381076 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb498d8-0053-4eba-ba1d-3d6601000c6c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:55.381076 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb498d8-0053-4eba-ba1d-3d6601000c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:55.384629 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-672ab632-06a3-417e-9f98-ea1c069c5b68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ead470e64214a4dbc518c60f2c192cf', 'request_id': 'req-672ab632-06a3-417e-9f98-ea1c069c5b68'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:55.416833 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-672ab632-06a3-417e-9f98-ea1c069c5b68 admin admin] The token cache is being invalidate because project 4ead470e64214a4dbc518c60f2c192cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:57:55.417162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-672ab632-06a3-417e-9f98-ea1c069c5b68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:55.418358 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-672ab632-06a3-417e-9f98-ea1c069c5b68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:57:55.424099 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1084/2144] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:57:55 2022] DELETE /identity/v3/projects/4ead470e64214a4dbc518c60f2c192cf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:55.429354 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58214b3-82e2-494b-8076-179f64be5214 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:55.429722 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58214b3-82e2-494b-8076-179f64be5214 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:55.430068 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58214b3-82e2-494b-8076-179f64be5214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:55.439345 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-2fb498d8-0053-4eba-ba1d-3d6601000c6c None None] MFA Rules not processed for user `5aa9341fc87840bc99378f1def51167b`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:55.440684 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2fb498d8-0053-4eba-ba1d-3d6601000c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:55.485864 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f58214b3-82e2-494b-8076-179f64be5214 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:55.487016 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f58214b3-82e2-494b-8076-179f64be5214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:55.498223 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:55.512875 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:55.579015 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1061/2145] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:55.596447 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb498d8-0053-4eba-ba1d-3d6601000c6c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:55.596702 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2fb498d8-0053-4eba-ba1d-3d6601000c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:55.610979 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1085/2146] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:55.627857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b294e-6cab-4ca8-bcca-2b19d5bead8e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:55.628337 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b294e-6cab-4ca8-bcca-2b19d5bead8e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:55.628805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b294e-6cab-4ca8-bcca-2b19d5bead8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:55.671693 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b82b294e-6cab-4ca8-bcca-2b19d5bead8e None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:55.674943 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b82b294e-6cab-4ca8-bcca-2b19d5bead8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:55.693403 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1086/2147] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:55.695191 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b294e-6cab-4ca8-bcca-2b19d5bead8e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:55.718186 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b294e-6cab-4ca8-bcca-2b19d5bead8e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:55.727595 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcb68b-92ba-40b7-b204-66980fe4f2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:55.728727 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcb68b-92ba-40b7-b204-66980fe4f2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:55.729303 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcb68b-92ba-40b7-b204-66980fe4f2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:55.730036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcb68b-92ba-40b7-b204-66980fe4f2b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:55.731594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcb68b-92ba-40b7-b204-66980fe4f2b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:57:55.732467 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcb68b-92ba-40b7-b204-66980fe4f2b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:55.736522 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcb68b-92ba-40b7-b204-66980fe4f2b2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:55.759455 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1087/2148] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:57:55.765659 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcb68b-92ba-40b7-b204-66980fe4f2b2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:55.767835 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb498d8-0053-4eba-ba1d-3d6601000c6c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:55.773945 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe4308-2471-4b36-a146-fd97c4cea501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:55.774855 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe4308-2471-4b36-a146-fd97c4cea501 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:55.775140 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe4308-2471-4b36-a146-fd97c4cea501 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:55.775415 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe4308-2471-4b36-a146-fd97c4cea501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:55.777493 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcb68b-92ba-40b7-b204-66980fe4f2b2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:55.788303 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe4308-2471-4b36-a146-fd97c4cea501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:55.790071 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe4308-2471-4b36-a146-fd97c4cea501 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:55.796876 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a351d-4a6b-423f-b20d-0e8c7981d27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:55.797946 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a351d-4a6b-423f-b20d-0e8c7981d27c admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:55.798179 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a351d-4a6b-423f-b20d-0e8c7981d27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:55.798460 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a351d-4a6b-423f-b20d-0e8c7981d27c admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:55.799268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a351d-4a6b-423f-b20d-0e8c7981d27c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:55.801935 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a351d-4a6b-423f-b20d-0e8c7981d27c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:55.821164 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1062/2149] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:57:55.852209 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1088/2150] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:55 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:55.856558 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe4308-2471-4b36-a146-fd97c4cea501 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:55.871250 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe4308-2471-4b36-a146-fd97c4cea501 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:55.973141 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4740d2-1180-44c5-b587-aa2dedcd90b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:55.973759 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4740d2-1180-44c5-b587-aa2dedcd90b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:55.974037 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4740d2-1180-44c5-b587-aa2dedcd90b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:55.974305 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4740d2-1180-44c5-b587-aa2dedcd90b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:55.974942 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4740d2-1180-44c5-b587-aa2dedcd90b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:55.976876 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4740d2-1180-44c5-b587-aa2dedcd90b7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:56.004095 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1063/2151] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:55 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:56.008358 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a351d-4a6b-423f-b20d-0e8c7981d27c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:56.023809 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a351d-4a6b-423f-b20d-0e8c7981d27c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:56.030403 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4daf3-d0a1-485b-98fa-b2ac2df871c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:56.031200 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4daf3-d0a1-485b-98fa-b2ac2df871c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:56.031348 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4daf3-d0a1-485b-98fa-b2ac2df871c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:56.031753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4daf3-d0a1-485b-98fa-b2ac2df871c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:56.032574 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4daf3-d0a1-485b-98fa-b2ac2df871c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:56.034342 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4daf3-d0a1-485b-98fa-b2ac2df871c9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:56.045952 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1089/2152] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:56.051072 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4740d2-1180-44c5-b587-aa2dedcd90b7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:56.064021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4740d2-1180-44c5-b587-aa2dedcd90b7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:56.072042 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c966d6e-d68b-4c0e-b6af-972fc547758d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:56.073161 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c966d6e-d68b-4c0e-b6af-972fc547758d admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:56.073524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c966d6e-d68b-4c0e-b6af-972fc547758d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:56.073848 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c966d6e-d68b-4c0e-b6af-972fc547758d admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:56.075023 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c966d6e-d68b-4c0e-b6af-972fc547758d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:56.078823 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c966d6e-d68b-4c0e-b6af-972fc547758d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:56.098559 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1064/2153] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:56.103153 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4daf3-d0a1-485b-98fa-b2ac2df871c9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:56.118822 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4daf3-d0a1-485b-98fa-b2ac2df871c9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:56.125845 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81167b58-d720-4c61-84a2-5f2a318bce48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:56.126102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81167b58-d720-4c61-84a2-5f2a318bce48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:56.126484 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81167b58-d720-4c61-84a2-5f2a318bce48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:56.126830 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81167b58-d720-4c61-84a2-5f2a318bce48 admin admin] PATH_INFO: `/v3/projects/ff1a751a3d614cb4bb57eb465ec7cb80/users/35cbd55dcd2d4783a1ceac5f1962ee7e/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:56.149584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81167b58-d720-4c61-84a2-5f2a318bce48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1a751a3d614cb4bb57eb465ec7cb80, user_id=35cbd55dcd2d4783a1ceac5f1962ee7e, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:56.152445 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81167b58-d720-4c61-84a2-5f2a318bce48 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:56.170250 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1090/2154] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:56 2022] PUT /identity/v3/projects/ff1a751a3d614cb4bb57eb465ec7cb80/users/35cbd55dcd2d4783a1ceac5f1962ee7e/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:56.182524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38908803-769a-46e0-ae3f-90d038b20fde None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:56.182815 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38908803-769a-46e0-ae3f-90d038b20fde None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:56.183092 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38908803-769a-46e0-ae3f-90d038b20fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:56.219686 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-38908803-769a-46e0-ae3f-90d038b20fde None None] MFA Rules not processed for user `35cbd55dcd2d4783a1ceac5f1962ee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:56.221590 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-38908803-769a-46e0-ae3f-90d038b20fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:56.301292 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:56.328377 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1065/2155] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:56.332915 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81167b58-d720-4c61-84a2-5f2a318bce48 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:56.404681 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81167b58-d720-4c61-84a2-5f2a318bce48 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:56.415619 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca4d4a-99e1-483f-be0e-badaff83ede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:56.415619 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca4d4a-99e1-483f-be0e-badaff83ede3 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:56.415619 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca4d4a-99e1-483f-be0e-badaff83ede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:56.415619 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca4d4a-99e1-483f-be0e-badaff83ede3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:56.416612 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca4d4a-99e1-483f-be0e-badaff83ede3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:56.416612 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca4d4a-99e1-483f-be0e-badaff83ede3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:56.449950 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1091/2156] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:57:56 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:57:56.454470 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38908803-769a-46e0-ae3f-90d038b20fde None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:56.466322 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38908803-769a-46e0-ae3f-90d038b20fde None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:56.534263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54eb19-8ff7-4a93-8b62-0c7d2aebe314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:56.534883 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54eb19-8ff7-4a93-8b62-0c7d2aebe314 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:56.535274 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54eb19-8ff7-4a93-8b62-0c7d2aebe314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:56.535553 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54eb19-8ff7-4a93-8b62-0c7d2aebe314 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:56.536201 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54eb19-8ff7-4a93-8b62-0c7d2aebe314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:56.538343 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54eb19-8ff7-4a93-8b62-0c7d2aebe314 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:56.559775 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1066/2157] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:57:56 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:57:56.563920 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca4d4a-99e1-483f-be0e-badaff83ede3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:56.574376 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca4d4a-99e1-483f-be0e-badaff83ede3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:56.579357 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c58bae-ff84-4c19-917a-a7aa299db017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:56.579955 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c58bae-ff84-4c19-917a-a7aa299db017 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:56.580432 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c58bae-ff84-4c19-917a-a7aa299db017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:56.580931 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c58bae-ff84-4c19-917a-a7aa299db017 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:56.582126 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c58bae-ff84-4c19-917a-a7aa299db017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:56.583750 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c58bae-ff84-4c19-917a-a7aa299db017 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:56.595625 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1092/2158] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:56.600087 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54eb19-8ff7-4a93-8b62-0c7d2aebe314 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:56.610700 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54eb19-8ff7-4a93-8b62-0c7d2aebe314 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:56.615367 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2c4dd-69ac-4352-944e-afb9ee026951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:56.616014 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2c4dd-69ac-4352-944e-afb9ee026951 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:56.616295 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2c4dd-69ac-4352-944e-afb9ee026951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:56.616568 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2c4dd-69ac-4352-944e-afb9ee026951 admin admin] PATH_INFO: `/v3/projects/08ae414a87244df3841bf99625e48e52/users/da2c6f2c65f94e148807a4de0077052f/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:56.632211 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2c4dd-69ac-4352-944e-afb9ee026951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ae414a87244df3841bf99625e48e52, user_id=da2c6f2c65f94e148807a4de0077052f, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:56.634922 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2c4dd-69ac-4352-944e-afb9ee026951 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:56.650785 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1067/2159] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:56 2022] PUT /identity/v3/projects/08ae414a87244df3841bf99625e48e52/users/da2c6f2c65f94e148807a4de0077052f/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:56.656729 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c58bae-ff84-4c19-917a-a7aa299db017 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:56.666996 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c58bae-ff84-4c19-917a-a7aa299db017 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:56.685668 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:56.726927 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b443a-adc1-4793-ac56-0c527e38083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:56.727525 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b443a-adc1-4793-ac56-0c527e38083a admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:56.727803 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b443a-adc1-4793-ac56-0c527e38083a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:56.728070 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b443a-adc1-4793-ac56-0c527e38083a admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:56.728792 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b443a-adc1-4793-ac56-0c527e38083a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:56.730524 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b443a-adc1-4793-ac56-0c527e38083a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:56.740724 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1093/2160] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:57:56.746002 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2c4dd-69ac-4352-944e-afb9ee026951 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:56.757249 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2c4dd-69ac-4352-944e-afb9ee026951 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:56.761920 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fa0ab-a780-47fa-89f8-4a6bc5cf18e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:56.762564 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fa0ab-a780-47fa-89f8-4a6bc5cf18e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:56.762850 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fa0ab-a780-47fa-89f8-4a6bc5cf18e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:56.763120 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fa0ab-a780-47fa-89f8-4a6bc5cf18e4 admin admin] PATH_INFO: `/v3/projects/08ae414a87244df3841bf99625e48e52/users/da2c6f2c65f94e148807a4de0077052f/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:56.765570 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fa0ab-a780-47fa-89f8-4a6bc5cf18e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ae414a87244df3841bf99625e48e52, user_id=da2c6f2c65f94e148807a4de0077052f, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:56.768429 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fa0ab-a780-47fa-89f8-4a6bc5cf18e4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:56.778631 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1068/2161] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:57:56 2022] PUT /identity/v3/projects/08ae414a87244df3841bf99625e48e52/users/da2c6f2c65f94e148807a4de0077052f/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:57:56.789621 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9e5cb-7586-4406-a2b2-84b79a9e2f78 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:56.789938 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9e5cb-7586-4406-a2b2-84b79a9e2f78 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:56.790215 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9e5cb-7586-4406-a2b2-84b79a9e2f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:56.819258 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-93b9e5cb-7586-4406-a2b2-84b79a9e2f78 None None] MFA Rules not processed for user `da2c6f2c65f94e148807a4de0077052f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:56.820528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-93b9e5cb-7586-4406-a2b2-84b79a9e2f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:56.896916 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1094/2162] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:57:56.908630 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fa0ab-a780-47fa-89f8-4a6bc5cf18e4 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:57:56.910341 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-232fa0ab-a780-47fa-89f8-4a6bc5cf18e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:56.972443 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fa0ab-a780-47fa-89f8-4a6bc5cf18e4 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:57:56.976476 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757ae8e-44d1-4443-b1ed-68903527bcf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:57:56.976916 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757ae8e-44d1-4443-b1ed-68903527bcf9 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:56.977236 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757ae8e-44d1-4443-b1ed-68903527bcf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:56.977609 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757ae8e-44d1-4443-b1ed-68903527bcf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:57.037708 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:57.059123 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757ae8e-44d1-4443-b1ed-68903527bcf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:57:57.061304 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757ae8e-44d1-4443-b1ed-68903527bcf9 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:57:57.073299 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1069/2163] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:57:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:57:57.367512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc545aeb-5bfe-45c9-b56d-0f23bccc7080 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:57:57.368102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc545aeb-5bfe-45c9-b56d-0f23bccc7080 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:57:57.368381 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc545aeb-5bfe-45c9-b56d-0f23bccc7080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:57:57.397041 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bc545aeb-5bfe-45c9-b56d-0f23bccc7080 None None] MFA Rules not processed for user `5aa9341fc87840bc99378f1def51167b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:57:57.398503 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bc545aeb-5bfe-45c9-b56d-0f23bccc7080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:57:57.477771 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1095/2164] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:57:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:01.669865 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757ae8e-44d1-4443-b1ed-68903527bcf9 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:01.685036 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757ae8e-44d1-4443-b1ed-68903527bcf9 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:01.693281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ae8de-a609-43e0-a83a-b48014b36c59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:01.694051 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ae8de-a609-43e0-a83a-b48014b36c59 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:01.694332 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ae8de-a609-43e0-a83a-b48014b36c59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:01.694690 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ae8de-a609-43e0-a83a-b48014b36c59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:01.725939 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ae8de-a609-43e0-a83a-b48014b36c59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:01.728640 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ae8de-a609-43e0-a83a-b48014b36c59 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:01.756220 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1070/2165] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:06.978312 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc545aeb-5bfe-45c9-b56d-0f23bccc7080 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:07.057893 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:07.076279 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc545aeb-5bfe-45c9-b56d-0f23bccc7080 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:07.082061 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c02f8d-0a35-4084-b42d-224f5d3d7e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:07.082939 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c02f8d-0a35-4084-b42d-224f5d3d7e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:07.083172 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c02f8d-0a35-4084-b42d-224f5d3d7e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:07.083456 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c02f8d-0a35-4084-b42d-224f5d3d7e94 admin admin] PATH_INFO: `/v3/users/35cbd55dcd2d4783a1ceac5f1962ee7e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:07.084732 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c02f8d-0a35-4084-b42d-224f5d3d7e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35cbd55dcd2d4783a1ceac5f1962ee7e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:07.087238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c02f8d-0a35-4084-b42d-224f5d3d7e94 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:07.157371 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b3c02f8d-0a35-4084-b42d-224f5d3d7e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35cbd55dcd2d4783a1ceac5f1962ee7e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:07.158246 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b3c02f8d-0a35-4084-b42d-224f5d3d7e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35cbd55dcd2d4783a1ceac5f1962ee7e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:07.173250 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b3c02f8d-0a35-4084-b42d-224f5d3d7e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35cbd55dcd2d4783a1ceac5f1962ee7e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:07.181477 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b3c02f8d-0a35-4084-b42d-224f5d3d7e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35cbd55dcd2d4783a1ceac5f1962ee7e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:07.182089 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b3c02f8d-0a35-4084-b42d-224f5d3d7e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35cbd55dcd2d4783a1ceac5f1962ee7e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:07.195936 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1096/2166] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:58:06 2022] DELETE /identity/v3/users/35cbd55dcd2d4783a1ceac5f1962ee7e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:07.200301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb6e1e-de00-4458-9c1e-521e626531cb None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:07.200744 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb6e1e-de00-4458-9c1e-521e626531cb None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:07.200923 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb6e1e-de00-4458-9c1e-521e626531cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:07.227783 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-14eb6e1e-de00-4458-9c1e-521e626531cb None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:07.229334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-14eb6e1e-de00-4458-9c1e-521e626531cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:07.319495 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1071/2167] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:07.331338 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c02f8d-0a35-4084-b42d-224f5d3d7e94 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:07.333475 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b3c02f8d-0a35-4084-b42d-224f5d3d7e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:07.417097 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c02f8d-0a35-4084-b42d-224f5d3d7e94 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:07.421473 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cd9ba-2d4d-493e-9e3c-de0f16d976bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:07.422190 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cd9ba-2d4d-493e-9e3c-de0f16d976bd service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:07.422465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cd9ba-2d4d-493e-9e3c-de0f16d976bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:07.422734 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cd9ba-2d4d-493e-9e3c-de0f16d976bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:07.433294 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480cd9ba-2d4d-493e-9e3c-de0f16d976bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:07.434876 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480cd9ba-2d4d-493e-9e3c-de0f16d976bd service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:07.446431 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1097/2168] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:07.727284 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb6e1e-de00-4458-9c1e-521e626531cb None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:07.737291 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-14eb6e1e-de00-4458-9c1e-521e626531cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:07.753200 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb6e1e-de00-4458-9c1e-521e626531cb None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:07.759833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92223c1c-f9fa-4c13-a3f2-d161eae3ef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:07.760655 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92223c1c-f9fa-4c13-a3f2-d161eae3ef6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:07.761034 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92223c1c-f9fa-4c13-a3f2-d161eae3ef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:07.761399 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92223c1c-f9fa-4c13-a3f2-d161eae3ef6e admin admin] PATH_INFO: `/v3/projects/ff1a751a3d614cb4bb57eb465ec7cb80` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:07.762616 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92223c1c-f9fa-4c13-a3f2-d161eae3ef6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1a751a3d614cb4bb57eb465ec7cb80)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:07.765416 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92223c1c-f9fa-4c13-a3f2-d161eae3ef6e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:07.820503 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-92223c1c-f9fa-4c13-a3f2-d161eae3ef6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1a751a3d614cb4bb57eb465ec7cb80', 'request_id': 'req-92223c1c-f9fa-4c13-a3f2-d161eae3ef6e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:07.827948 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-92223c1c-f9fa-4c13-a3f2-d161eae3ef6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1a751a3d614cb4bb57eb465ec7cb80', 'request_id': 'req-92223c1c-f9fa-4c13-a3f2-d161eae3ef6e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:07.836957 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-92223c1c-f9fa-4c13-a3f2-d161eae3ef6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1a751a3d614cb4bb57eb465ec7cb80', 'request_id': 'req-92223c1c-f9fa-4c13-a3f2-d161eae3ef6e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:07.849873 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-92223c1c-f9fa-4c13-a3f2-d161eae3ef6e admin admin] The token cache is being invalidate because project ff1a751a3d614cb4bb57eb465ec7cb80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:58:07.850169 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-92223c1c-f9fa-4c13-a3f2-d161eae3ef6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:07.850836 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-92223c1c-f9fa-4c13-a3f2-d161eae3ef6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:07.852393 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1072/2169] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:58:07 2022] DELETE /identity/v3/projects/ff1a751a3d614cb4bb57eb465ec7cb80 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:07.856387 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cd9ba-2d4d-493e-9e3c-de0f16d976bd service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:07.867110 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cd9ba-2d4d-493e-9e3c-de0f16d976bd service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:07.940209 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c93dcf-2c37-4ca4-912a-cfd9d703c4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:07.940843 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c93dcf-2c37-4ca4-912a-cfd9d703c4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:07.941215 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c93dcf-2c37-4ca4-912a-cfd9d703c4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:07.941441 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c93dcf-2c37-4ca4-912a-cfd9d703c4ba admin admin] PATH_INFO: `/v3/users/da2c6f2c65f94e148807a4de0077052f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:07.942684 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c93dcf-2c37-4ca4-912a-cfd9d703c4ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2c6f2c65f94e148807a4de0077052f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:07.944673 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c93dcf-2c37-4ca4-912a-cfd9d703c4ba admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:07.958528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:07.992366 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-69c93dcf-2c37-4ca4-912a-cfd9d703c4ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2c6f2c65f94e148807a4de0077052f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:07.993007 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-69c93dcf-2c37-4ca4-912a-cfd9d703c4ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2c6f2c65f94e148807a4de0077052f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:08.005586 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-69c93dcf-2c37-4ca4-912a-cfd9d703c4ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2c6f2c65f94e148807a4de0077052f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:08.013389 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-69c93dcf-2c37-4ca4-912a-cfd9d703c4ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2c6f2c65f94e148807a4de0077052f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:08.015230 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-69c93dcf-2c37-4ca4-912a-cfd9d703c4ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2c6f2c65f94e148807a4de0077052f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:08.029123 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1098/2170] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:58:07 2022] DELETE /identity/v3/users/da2c6f2c65f94e148807a4de0077052f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:08.483038 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92223c1c-f9fa-4c13-a3f2-d161eae3ef6e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:08.484722 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-92223c1c-f9fa-4c13-a3f2-d161eae3ef6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:08.501458 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92223c1c-f9fa-4c13-a3f2-d161eae3ef6e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:08.582080 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d46cf-c6d2-41b9-ba5e-b8bd972016e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:08.582738 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d46cf-c6d2-41b9-ba5e-b8bd972016e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:08.583021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d46cf-c6d2-41b9-ba5e-b8bd972016e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:08.583305 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d46cf-c6d2-41b9-ba5e-b8bd972016e5 admin admin] PATH_INFO: `/v3/projects/08ae414a87244df3841bf99625e48e52` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:08.584502 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d46cf-c6d2-41b9-ba5e-b8bd972016e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08ae414a87244df3841bf99625e48e52)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:08.586519 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d46cf-c6d2-41b9-ba5e-b8bd972016e5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:08.594789 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:08.653609 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-892d46cf-c6d2-41b9-ba5e-b8bd972016e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08ae414a87244df3841bf99625e48e52', 'request_id': 'req-892d46cf-c6d2-41b9-ba5e-b8bd972016e5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:08.660690 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-892d46cf-c6d2-41b9-ba5e-b8bd972016e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08ae414a87244df3841bf99625e48e52', 'request_id': 'req-892d46cf-c6d2-41b9-ba5e-b8bd972016e5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:08.670352 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-892d46cf-c6d2-41b9-ba5e-b8bd972016e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08ae414a87244df3841bf99625e48e52', 'request_id': 'req-892d46cf-c6d2-41b9-ba5e-b8bd972016e5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:08.690583 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-892d46cf-c6d2-41b9-ba5e-b8bd972016e5 admin admin] The token cache is being invalidate because project 08ae414a87244df3841bf99625e48e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:58:08.690824 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-892d46cf-c6d2-41b9-ba5e-b8bd972016e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:08.699141 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-892d46cf-c6d2-41b9-ba5e-b8bd972016e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:08.707289 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1073/2171] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:58:08 2022] DELETE /identity/v3/projects/08ae414a87244df3841bf99625e48e52 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:08.708780 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d02dc-57cf-46f1-b609-c380735c8684 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:08.709116 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d02dc-57cf-46f1-b609-c380735c8684 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:08.709389 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d02dc-57cf-46f1-b609-c380735c8684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:08.733663 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d46cf-c6d2-41b9-ba5e-b8bd972016e5 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:08.735557 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-892d46cf-c6d2-41b9-ba5e-b8bd972016e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:08.742948 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-419d02dc-57cf-46f1-b609-c380735c8684 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:08.745278 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-419d02dc-57cf-46f1-b609-c380735c8684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:08.826401 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d46cf-c6d2-41b9-ba5e-b8bd972016e5 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:08.832241 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ba58e-0476-48ca-a246-73d22f4e98b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:08.833044 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba58e-0476-48ca-a246-73d22f4e98b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:08.833319 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba58e-0476-48ca-a246-73d22f4e98b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:08.833590 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba58e-0476-48ca-a246-73d22f4e98b4 admin admin] PATH_INFO: `/v3/users/bff6d842f3054c80b7bc973b4643b089` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:08.834891 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ba58e-0476-48ca-a246-73d22f4e98b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff6d842f3054c80b7bc973b4643b089)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:08.836819 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ba58e-0476-48ca-a246-73d22f4e98b4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:08.837942 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1099/2172] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:08.847338 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f199d56-2b5f-43a4-82c3-ac1da92da7ec None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:08.847622 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f199d56-2b5f-43a4-82c3-ac1da92da7ec None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:08.847957 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f199d56-2b5f-43a4-82c3-ac1da92da7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:08.870594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5f199d56-2b5f-43a4-82c3-ac1da92da7ec None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:08.872148 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5f199d56-2b5f-43a4-82c3-ac1da92da7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:08.885463 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1100/2173] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:08.886419 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f199d56-2b5f-43a4-82c3-ac1da92da7ec None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:08.898817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f199d56-2b5f-43a4-82c3-ac1da92da7ec None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:08.899012 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-372ba58e-0476-48ca-a246-73d22f4e98b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff6d842f3054c80b7bc973b4643b089'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:08.899783 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-372ba58e-0476-48ca-a246-73d22f4e98b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff6d842f3054c80b7bc973b4643b089'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:08.903644 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a90df2-b3dd-4d93-b4e5-0ab61295ef65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:08.904424 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a90df2-b3dd-4d93-b4e5-0ab61295ef65 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:08.904630 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a90df2-b3dd-4d93-b4e5-0ab61295ef65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:08.904917 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a90df2-b3dd-4d93-b4e5-0ab61295ef65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:08.906641 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a90df2-b3dd-4d93-b4e5-0ab61295ef65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:58:08.906996 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a90df2-b3dd-4d93-b4e5-0ab61295ef65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:08.908806 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a90df2-b3dd-4d93-b4e5-0ab61295ef65 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:08.909231 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-372ba58e-0476-48ca-a246-73d22f4e98b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff6d842f3054c80b7bc973b4643b089'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:08.909966 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-372ba58e-0476-48ca-a246-73d22f4e98b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff6d842f3054c80b7bc973b4643b089'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:08.918392 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-372ba58e-0476-48ca-a246-73d22f4e98b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff6d842f3054c80b7bc973b4643b089'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:08.924012 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1101/2174] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:58:08.938199 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a90df2-b3dd-4d93-b4e5-0ab61295ef65 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:08.956546 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-13a90df2-b3dd-4d93-b4e5-0ab61295ef65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:08.959865 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1074/2175] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:58:08 2022] DELETE /identity/v3/users/bff6d842f3054c80b7bc973b4643b089 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:08.961586 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517271e-835f-4973-8944-b1e63a5b759f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:08.961930 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517271e-835f-4973-8944-b1e63a5b759f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:08.962205 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517271e-835f-4973-8944-b1e63a5b759f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:08.985978 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5517271e-835f-4973-8944-b1e63a5b759f None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:08.987791 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5517271e-835f-4973-8944-b1e63a5b759f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:08.995609 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:09.007697 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a90df2-b3dd-4d93-b4e5-0ab61295ef65 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:09.127031 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1075/2176] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:09.142423 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517271e-835f-4973-8944-b1e63a5b759f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:09.144393 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5517271e-835f-4973-8944-b1e63a5b759f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:09.162313 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed0eae-7587-49a4-9ddd-16fb81733977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:09.163047 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed0eae-7587-49a4-9ddd-16fb81733977 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:09.163335 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed0eae-7587-49a4-9ddd-16fb81733977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:09.163640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed0eae-7587-49a4-9ddd-16fb81733977 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:09.164623 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed0eae-7587-49a4-9ddd-16fb81733977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:09.171461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed0eae-7587-49a4-9ddd-16fb81733977 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:09.206107 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:09.237790 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1102/2177] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:58:08 2022] POST /identity/v3/projects => generated 365 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:58:09.238752 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed0eae-7587-49a4-9ddd-16fb81733977 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:09.300394 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517271e-835f-4973-8944-b1e63a5b759f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:09.335865 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed0eae-7587-49a4-9ddd-16fb81733977 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:09.341678 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d546f-9340-4bef-9d2d-741f74f02199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:09.343994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d546f-9340-4bef-9d2d-741f74f02199 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:09.344450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d546f-9340-4bef-9d2d-741f74f02199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:09.345659 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d546f-9340-4bef-9d2d-741f74f02199 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:09.345847 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d546f-9340-4bef-9d2d-741f74f02199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:09.347875 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d546f-9340-4bef-9d2d-741f74f02199 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:09.374121 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6318b-1154-4aa5-918e-de700f38ed92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:09.374778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6318b-1154-4aa5-918e-de700f38ed92 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:09.377404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6318b-1154-4aa5-918e-de700f38ed92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:09.377695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6318b-1154-4aa5-918e-de700f38ed92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:09.381374 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1103/2178] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:58:09 2022] POST /identity/v3/users => generated 283 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:58:09.385650 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d546f-9340-4bef-9d2d-741f74f02199 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:09.401970 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6318b-1154-4aa5-918e-de700f38ed92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:09.405467 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d546f-9340-4bef-9d2d-741f74f02199 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:09.406938 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6318b-1154-4aa5-918e-de700f38ed92 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:09.420345 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820202b-85b7-4bd1-a6da-47fd6e4c50da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:09.421801 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820202b-85b7-4bd1-a6da-47fd6e4c50da admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:09.422237 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1076/2179] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:58:09.422638 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820202b-85b7-4bd1-a6da-47fd6e4c50da admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:09.422920 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820202b-85b7-4bd1-a6da-47fd6e4c50da admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:09.424086 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820202b-85b7-4bd1-a6da-47fd6e4c50da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:09.425558 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820202b-85b7-4bd1-a6da-47fd6e4c50da admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:09.438114 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1104/2180] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 00:58:09.443220 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6318b-1154-4aa5-918e-de700f38ed92 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:09.462674 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6318b-1154-4aa5-918e-de700f38ed92 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:09.468722 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f7cf4-65aa-41c4-a29f-0d8ebe04cc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:09.469478 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f7cf4-65aa-41c4-a29f-0d8ebe04cc2f admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:09.469852 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f7cf4-65aa-41c4-a29f-0d8ebe04cc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:09.470168 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f7cf4-65aa-41c4-a29f-0d8ebe04cc2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:09.470895 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f7cf4-65aa-41c4-a29f-0d8ebe04cc2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:09.473584 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f7cf4-65aa-41c4-a29f-0d8ebe04cc2f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:09.491374 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1077/2181] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:58:09.494029 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820202b-85b7-4bd1-a6da-47fd6e4c50da admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:09.513429 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820202b-85b7-4bd1-a6da-47fd6e4c50da admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:09.523512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d3eb8-cfbf-4bde-8bed-f48b0feff7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:09.525169 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d3eb8-cfbf-4bde-8bed-f48b0feff7e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:09.533265 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d3eb8-cfbf-4bde-8bed-f48b0feff7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:09.533652 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d3eb8-cfbf-4bde-8bed-f48b0feff7e0 admin admin] PATH_INFO: `/v3/projects/8296510529f6454ca56e4548bdad725d/users/afe52fa0ef4240d5beae29fdab4d5615/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:09.556380 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d3eb8-cfbf-4bde-8bed-f48b0feff7e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8296510529f6454ca56e4548bdad725d, user_id=afe52fa0ef4240d5beae29fdab4d5615, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:09.560032 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d3eb8-cfbf-4bde-8bed-f48b0feff7e0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:09.589675 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1105/2182] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:58:09 2022] PUT /identity/v3/projects/8296510529f6454ca56e4548bdad725d/users/afe52fa0ef4240d5beae29fdab4d5615/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:09.596564 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea15e6c-bc36-456a-a1ef-de444bcda3a1 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:09.597029 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea15e6c-bc36-456a-a1ef-de444bcda3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:09.598001 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea15e6c-bc36-456a-a1ef-de444bcda3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:09.659404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6ea15e6c-bc36-456a-a1ef-de444bcda3a1 None None] MFA Rules not processed for user `afe52fa0ef4240d5beae29fdab4d5615`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:09.661509 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6ea15e6c-bc36-456a-a1ef-de444bcda3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:09.744702 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:09.768473 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1078/2183] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:09.830679 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d3eb8-cfbf-4bde-8bed-f48b0feff7e0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:09.832713 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8a4d3eb8-cfbf-4bde-8bed-f48b0feff7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:09.922305 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d3eb8-cfbf-4bde-8bed-f48b0feff7e0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:09.927319 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccafa6f-3043-43ae-b750-46200e6f883f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:09.927946 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccafa6f-3043-43ae-b750-46200e6f883f service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:09.928385 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccafa6f-3043-43ae-b750-46200e6f883f service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:09.929373 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccafa6f-3043-43ae-b750-46200e6f883f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:09.941751 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccafa6f-3043-43ae-b750-46200e6f883f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:09.943240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccafa6f-3043-43ae-b750-46200e6f883f service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:09.971339 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1106/2184] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:10.011985 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea15e6c-bc36-456a-a1ef-de444bcda3a1 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:10.017099 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6ea15e6c-bc36-456a-a1ef-de444bcda3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:10.119606 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea15e6c-bc36-456a-a1ef-de444bcda3a1 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:10.125221 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2264d-bf7f-462d-8395-5ebbe3fdd79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:10.125871 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2264d-bf7f-462d-8395-5ebbe3fdd79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:10.126156 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2264d-bf7f-462d-8395-5ebbe3fdd79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:10.126432 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2264d-bf7f-462d-8395-5ebbe3fdd79c admin admin] PATH_INFO: `/v3/projects/3ddae0d720f94b9b80d9e49eb465bdc4` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:10.127575 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2264d-bf7f-462d-8395-5ebbe3fdd79c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ddae0d720f94b9b80d9e49eb465bdc4)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:10.129690 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2264d-bf7f-462d-8395-5ebbe3fdd79c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:10.188565 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-66f2264d-bf7f-462d-8395-5ebbe3fdd79c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ddae0d720f94b9b80d9e49eb465bdc4', 'request_id': 'req-66f2264d-bf7f-462d-8395-5ebbe3fdd79c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:10.195952 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-66f2264d-bf7f-462d-8395-5ebbe3fdd79c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ddae0d720f94b9b80d9e49eb465bdc4', 'request_id': 'req-66f2264d-bf7f-462d-8395-5ebbe3fdd79c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:10.205049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-66f2264d-bf7f-462d-8395-5ebbe3fdd79c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ddae0d720f94b9b80d9e49eb465bdc4', 'request_id': 'req-66f2264d-bf7f-462d-8395-5ebbe3fdd79c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:10.217913 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-66f2264d-bf7f-462d-8395-5ebbe3fdd79c admin admin] The token cache is being invalidate because project 3ddae0d720f94b9b80d9e49eb465bdc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:58:10.218531 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-66f2264d-bf7f-462d-8395-5ebbe3fdd79c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:10.219778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-66f2264d-bf7f-462d-8395-5ebbe3fdd79c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:10.222189 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1079/2185] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:58:10 2022] DELETE /identity/v3/projects/3ddae0d720f94b9b80d9e49eb465bdc4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:10.226180 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccafa6f-3043-43ae-b750-46200e6f883f service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:10.239459 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccafa6f-3043-43ae-b750-46200e6f883f service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:10.303542 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:10.314264 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cef10-f54b-4671-9979-0e4a1c078041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:10.315043 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cef10-f54b-4671-9979-0e4a1c078041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:10.315869 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cef10-f54b-4671-9979-0e4a1c078041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:10.315869 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cef10-f54b-4671-9979-0e4a1c078041 admin admin] PATH_INFO: `/v3/users/ab74e78077b4425f9331533e2fc8d3b4` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:10.317905 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cef10-f54b-4671-9979-0e4a1c078041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab74e78077b4425f9331533e2fc8d3b4)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:10.319878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cef10-f54b-4671-9979-0e4a1c078041 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:10.387841 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc4cef10-f54b-4671-9979-0e4a1c078041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab74e78077b4425f9331533e2fc8d3b4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:10.388619 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc4cef10-f54b-4671-9979-0e4a1c078041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab74e78077b4425f9331533e2fc8d3b4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:10.403305 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc4cef10-f54b-4671-9979-0e4a1c078041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab74e78077b4425f9331533e2fc8d3b4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:10.415848 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc4cef10-f54b-4671-9979-0e4a1c078041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab74e78077b4425f9331533e2fc8d3b4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:10.419176 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc4cef10-f54b-4671-9979-0e4a1c078041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab74e78077b4425f9331533e2fc8d3b4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:10.437802 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1107/2186] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:58:10 2022] DELETE /identity/v3/users/ab74e78077b4425f9331533e2fc8d3b4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:58:10.724693 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2264d-bf7f-462d-8395-5ebbe3fdd79c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:10.726383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-66f2264d-bf7f-462d-8395-5ebbe3fdd79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:10.741077 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2264d-bf7f-462d-8395-5ebbe3fdd79c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:10.802967 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddad981-f966-4765-849a-4322491adc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:10.803612 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddad981-f966-4765-849a-4322491adc77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:10.803895 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddad981-f966-4765-849a-4322491adc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:10.804173 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddad981-f966-4765-849a-4322491adc77 admin admin] PATH_INFO: `/v3/projects/5136f439eecf440c9649ac36861291e3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:10.805334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddad981-f966-4765-849a-4322491adc77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5136f439eecf440c9649ac36861291e3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:10.807274 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddad981-f966-4765-849a-4322491adc77 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:10.832877 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:10.865824 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8ddad981-f966-4765-849a-4322491adc77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5136f439eecf440c9649ac36861291e3', 'request_id': 'req-8ddad981-f966-4765-849a-4322491adc77'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:10.872301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8ddad981-f966-4765-849a-4322491adc77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5136f439eecf440c9649ac36861291e3', 'request_id': 'req-8ddad981-f966-4765-849a-4322491adc77'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:10.881610 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8ddad981-f966-4765-849a-4322491adc77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5136f439eecf440c9649ac36861291e3', 'request_id': 'req-8ddad981-f966-4765-849a-4322491adc77'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:10.893154 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8ddad981-f966-4765-849a-4322491adc77 admin admin] The token cache is being invalidate because project 5136f439eecf440c9649ac36861291e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:58:10.893433 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8ddad981-f966-4765-849a-4322491adc77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:10.894080 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8ddad981-f966-4765-849a-4322491adc77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:10.895696 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1080/2187] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:58:10 2022] DELETE /identity/v3/projects/5136f439eecf440c9649ac36861291e3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:10.900576 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4925e1e-f964-4a38-a99b-08b1cef1a4e0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:10.900863 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4925e1e-f964-4a38-a99b-08b1cef1a4e0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:10.901165 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4925e1e-f964-4a38-a99b-08b1cef1a4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:10.920610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f4925e1e-f964-4a38-a99b-08b1cef1a4e0 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:10.921841 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f4925e1e-f964-4a38-a99b-08b1cef1a4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:10.984800 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1108/2188] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:58:10.992901 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15ec37-3194-450d-90f9-1f2fb2e353eb None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:10.993209 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15ec37-3194-450d-90f9-1f2fb2e353eb None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:10.993488 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15ec37-3194-450d-90f9-1f2fb2e353eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:11.016462 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ef15ec37-3194-450d-90f9-1f2fb2e353eb None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:11.017703 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ef15ec37-3194-450d-90f9-1f2fb2e353eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:11.027891 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1081/2189] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:58:11.030279 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4925e1e-f964-4a38-a99b-08b1cef1a4e0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:11.040478 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4925e1e-f964-4a38-a99b-08b1cef1a4e0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:11.045832 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdba22-9eb0-49ae-a425-638f0c378907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:11.046461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdba22-9eb0-49ae-a425-638f0c378907 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:11.046742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdba22-9eb0-49ae-a425-638f0c378907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:11.047006 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdba22-9eb0-49ae-a425-638f0c378907 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:11.047657 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdba22-9eb0-49ae-a425-638f0c378907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:58:11.047955 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdba22-9eb0-49ae-a425-638f0c378907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:11.049592 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdba22-9eb0-49ae-a425-638f0c378907 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:11.067243 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1109/2190] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:58:11.072240 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15ec37-3194-450d-90f9-1f2fb2e353eb None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:11.081958 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15ec37-3194-450d-90f9-1f2fb2e353eb None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:11.086858 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f4ae5-0dce-407f-8fd4-a72853a5f25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:11.087527 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f4ae5-0dce-407f-8fd4-a72853a5f25e admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:11.087798 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f4ae5-0dce-407f-8fd4-a72853a5f25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:11.088069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f4ae5-0dce-407f-8fd4-a72853a5f25e admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:11.088756 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f4ae5-0dce-407f-8fd4-a72853a5f25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:11.090720 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f4ae5-0dce-407f-8fd4-a72853a5f25e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:11.120015 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1082/2191] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:58:11 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:58:11.124507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdba22-9eb0-49ae-a425-638f0c378907 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:11.135815 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdba22-9eb0-49ae-a425-638f0c378907 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:11.194897 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2a805-f446-474a-814d-6b3aab2c63a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:11.195529 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2a805-f446-474a-814d-6b3aab2c63a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:11.195803 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2a805-f446-474a-814d-6b3aab2c63a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:11.196075 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2a805-f446-474a-814d-6b3aab2c63a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:11.196841 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2a805-f446-474a-814d-6b3aab2c63a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:11.198650 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2a805-f446-474a-814d-6b3aab2c63a3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:11.206576 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:11.222626 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1110/2192] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:58:11 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:58:11.227159 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f4ae5-0dce-407f-8fd4-a72853a5f25e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:11.238063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f4ae5-0dce-407f-8fd4-a72853a5f25e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:11.242651 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135dafa-26bf-4ff0-8455-451d23f0c8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:11.243242 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135dafa-26bf-4ff0-8455-451d23f0c8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:11.243526 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135dafa-26bf-4ff0-8455-451d23f0c8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:11.243799 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135dafa-26bf-4ff0-8455-451d23f0c8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:11.244440 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135dafa-26bf-4ff0-8455-451d23f0c8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:11.246338 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135dafa-26bf-4ff0-8455-451d23f0c8e0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:11.257887 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1083/2193] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:58:11.262395 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2a805-f446-474a-814d-6b3aab2c63a3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:11.272738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2a805-f446-474a-814d-6b3aab2c63a3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:11.277464 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffcb17-1bf2-4954-b059-f333bb060465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:11.278057 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffcb17-1bf2-4954-b059-f333bb060465 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:11.278400 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffcb17-1bf2-4954-b059-f333bb060465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:11.278676 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffcb17-1bf2-4954-b059-f333bb060465 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:11.279312 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffcb17-1bf2-4954-b059-f333bb060465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:11.281171 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffcb17-1bf2-4954-b059-f333bb060465 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:11.292247 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1111/2194] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:58:11.297150 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135dafa-26bf-4ff0-8455-451d23f0c8e0 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:11.308913 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135dafa-26bf-4ff0-8455-451d23f0c8e0 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:11.314775 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f84cec-c006-4f37-876d-798b396baaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:11.315428 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f84cec-c006-4f37-876d-798b396baaa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:11.315708 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f84cec-c006-4f37-876d-798b396baaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:11.315984 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f84cec-c006-4f37-876d-798b396baaa0 admin admin] PATH_INFO: `/v3/projects/3228f1015ed7465798035d231e09fc59/users/5be47a493f8b4618bed5ccdf2adf3072/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:11.331308 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f84cec-c006-4f37-876d-798b396baaa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3228f1015ed7465798035d231e09fc59, user_id=5be47a493f8b4618bed5ccdf2adf3072, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:11.334058 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f84cec-c006-4f37-876d-798b396baaa0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:11.348304 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1084/2195] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:58:11 2022] PUT /identity/v3/projects/3228f1015ed7465798035d231e09fc59/users/5be47a493f8b4618bed5ccdf2adf3072/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:58:11.361443 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b5873-a240-4881-ae67-bcab930789b6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:11.361650 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b5873-a240-4881-ae67-bcab930789b6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:11.361953 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b5873-a240-4881-ae67-bcab930789b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:11.391788 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d50b5873-a240-4881-ae67-bcab930789b6 None None] MFA Rules not processed for user `5be47a493f8b4618bed5ccdf2adf3072`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:11.393140 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d50b5873-a240-4881-ae67-bcab930789b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:11.512791 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1112/2196] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:11.513931 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f84cec-c006-4f37-876d-798b396baaa0 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:11.586058 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f84cec-c006-4f37-876d-798b396baaa0 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:11.595872 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9b5c8-826f-4beb-81cb-807d1e43d95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:11.596494 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9b5c8-826f-4beb-81cb-807d1e43d95d admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:11.596772 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9b5c8-826f-4beb-81cb-807d1e43d95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:11.597084 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9b5c8-826f-4beb-81cb-807d1e43d95d admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:11.597758 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9b5c8-826f-4beb-81cb-807d1e43d95d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:11.599806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9b5c8-826f-4beb-81cb-807d1e43d95d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:11.634344 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1085/2197] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:58:11 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:58:11.635524 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b5873-a240-4881-ae67-bcab930789b6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:11.647066 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b5873-a240-4881-ae67-bcab930789b6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:11.718042 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6aaadf-9e5c-492c-90a3-beb2666e8f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:11.718645 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6aaadf-9e5c-492c-90a3-beb2666e8f5c admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:11.718922 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6aaadf-9e5c-492c-90a3-beb2666e8f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:11.719195 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6aaadf-9e5c-492c-90a3-beb2666e8f5c admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:11.719811 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6aaadf-9e5c-492c-90a3-beb2666e8f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:11.721803 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6aaadf-9e5c-492c-90a3-beb2666e8f5c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:11.744730 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1113/2198] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:58:11 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:58:11.749897 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9b5c8-826f-4beb-81cb-807d1e43d95d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:11.761369 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9b5c8-826f-4beb-81cb-807d1e43d95d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:11.766735 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe442a-c8e9-422e-b60a-5a2731f008b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:11.767415 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe442a-c8e9-422e-b60a-5a2731f008b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:11.767698 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe442a-c8e9-422e-b60a-5a2731f008b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:11.767973 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe442a-c8e9-422e-b60a-5a2731f008b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:11.768617 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe442a-c8e9-422e-b60a-5a2731f008b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:11.770288 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe442a-c8e9-422e-b60a-5a2731f008b2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:11.781879 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1086/2199] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:58:11.786187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6aaadf-9e5c-492c-90a3-beb2666e8f5c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:11.797208 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6aaadf-9e5c-492c-90a3-beb2666e8f5c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:11.802879 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ef6c6-3b74-4258-84c8-9c812123b9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:11.803531 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ef6c6-3b74-4258-84c8-9c812123b9bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:11.803808 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ef6c6-3b74-4258-84c8-9c812123b9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:11.804085 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ef6c6-3b74-4258-84c8-9c812123b9bc admin admin] PATH_INFO: `/v3/projects/365f2d07d1b74deea6e5a73ba347242c/users/a5f4b381b2cf4c5187fd0f97ef31f0dc/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:11.820341 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ef6c6-3b74-4258-84c8-9c812123b9bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=365f2d07d1b74deea6e5a73ba347242c, user_id=a5f4b381b2cf4c5187fd0f97ef31f0dc, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:11.823091 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ef6c6-3b74-4258-84c8-9c812123b9bc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:11.836232 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1114/2200] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:58:11 2022] PUT /identity/v3/projects/365f2d07d1b74deea6e5a73ba347242c/users/a5f4b381b2cf4c5187fd0f97ef31f0dc/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:58:11.840860 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe442a-c8e9-422e-b60a-5a2731f008b2 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:11.851451 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe442a-c8e9-422e-b60a-5a2731f008b2 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:11.871623 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:11.936925 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c35d67-cdc0-482e-9d41-927cccac6b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:11.937636 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c35d67-cdc0-482e-9d41-927cccac6b3c admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:11.937915 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c35d67-cdc0-482e-9d41-927cccac6b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:11.938227 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c35d67-cdc0-482e-9d41-927cccac6b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:11.938881 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c35d67-cdc0-482e-9d41-927cccac6b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:11.940507 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c35d67-cdc0-482e-9d41-927cccac6b3c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:11.951964 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1087/2201] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:58:11.956028 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ef6c6-3b74-4258-84c8-9c812123b9bc admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:11.971393 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ef6c6-3b74-4258-84c8-9c812123b9bc admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:11.984417 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db9f05-886e-452d-88d5-f02769436755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:11.985260 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db9f05-886e-452d-88d5-f02769436755 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:11.985562 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db9f05-886e-452d-88d5-f02769436755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:11.985925 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db9f05-886e-452d-88d5-f02769436755 admin admin] PATH_INFO: `/v3/projects/365f2d07d1b74deea6e5a73ba347242c/users/a5f4b381b2cf4c5187fd0f97ef31f0dc/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:12.002187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db9f05-886e-452d-88d5-f02769436755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=365f2d07d1b74deea6e5a73ba347242c, user_id=a5f4b381b2cf4c5187fd0f97ef31f0dc, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:12.006204 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db9f05-886e-452d-88d5-f02769436755 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:12.025979 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1115/2202] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:58:11 2022] PUT /identity/v3/projects/365f2d07d1b74deea6e5a73ba347242c/users/a5f4b381b2cf4c5187fd0f97ef31f0dc/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:12.036637 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e817af2-a264-432d-abfd-630abe4dbd45 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:12.036921 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e817af2-a264-432d-abfd-630abe4dbd45 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:12.037222 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e817af2-a264-432d-abfd-630abe4dbd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:12.084637 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-1e817af2-a264-432d-abfd-630abe4dbd45 None None] MFA Rules not processed for user `a5f4b381b2cf4c5187fd0f97ef31f0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:12.085917 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1e817af2-a264-432d-abfd-630abe4dbd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:12.155911 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1088/2203] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:12.167800 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db9f05-886e-452d-88d5-f02769436755 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:12.169458 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-99db9f05-886e-452d-88d5-f02769436755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:12.195861 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:12.234352 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db9f05-886e-452d-88d5-f02769436755 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:12.238412 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f4dee-6621-4c94-b2a2-d8d982c349ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:12.239029 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f4dee-6621-4c94-b2a2-d8d982c349ec service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:12.239311 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f4dee-6621-4c94-b2a2-d8d982c349ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:12.239584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f4dee-6621-4c94-b2a2-d8d982c349ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:12.301142 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f4dee-6621-4c94-b2a2-d8d982c349ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:12.302585 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f4dee-6621-4c94-b2a2-d8d982c349ec service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:12.312321 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1116/2204] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:13.754648 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e817af2-a264-432d-abfd-630abe4dbd45 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:13.767014 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e817af2-a264-432d-abfd-630abe4dbd45 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:13.771040 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cb243-4130-4dc6-8697-26da86c5e5c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:13.771833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cb243-4130-4dc6-8697-26da86c5e5c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:13.772246 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cb243-4130-4dc6-8697-26da86c5e5c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:13.772704 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cb243-4130-4dc6-8697-26da86c5e5c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:13.786692 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cb243-4130-4dc6-8697-26da86c5e5c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:13.788428 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cb243-4130-4dc6-8697-26da86c5e5c4 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:13.815927 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1089/2205] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:14.579673 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104de82-039e-4f73-99bb-2d56b37a0687 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:14.580166 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104de82-039e-4f73-99bb-2d56b37a0687 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:14.580277 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104de82-039e-4f73-99bb-2d56b37a0687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:14.610879 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7104de82-039e-4f73-99bb-2d56b37a0687 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:14.612695 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7104de82-039e-4f73-99bb-2d56b37a0687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:14.685317 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1117/2206] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Oct 2 00:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:14.768004 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cb243-4130-4dc6-8697-26da86c5e5c4 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:14.769526 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-405cb243-4130-4dc6-8697-26da86c5e5c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:14.842983 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cb243-4130-4dc6-8697-26da86c5e5c4 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:14.848381 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb385a6c-da17-48c1-9a19-98e396cdaf43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:14.849009 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb385a6c-da17-48c1-9a19-98e396cdaf43 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:14.849288 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb385a6c-da17-48c1-9a19-98e396cdaf43 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:14.849575 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb385a6c-da17-48c1-9a19-98e396cdaf43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:14.859009 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb385a6c-da17-48c1-9a19-98e396cdaf43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:14.860687 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb385a6c-da17-48c1-9a19-98e396cdaf43 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:14.870898 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1090/2207] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:16.152321 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1446941-6f20-4641-a45e-cf1e81cc9165 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:16.152778 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1446941-6f20-4641-a45e-cf1e81cc9165 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:16.152888 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1446941-6f20-4641-a45e-cf1e81cc9165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:16.178961 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c1446941-6f20-4641-a45e-cf1e81cc9165 None None] MFA Rules not processed for user `5aa9341fc87840bc99378f1def51167b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:16.180175 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c1446941-6f20-4641-a45e-cf1e81cc9165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:16.243649 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1118/2208] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:58:17.818942 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb385a6c-da17-48c1-9a19-98e396cdaf43 service nova] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:17.830356 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb385a6c-da17-48c1-9a19-98e396cdaf43 service nova] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:17.835430 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa6564-1665-4bba-8321-21a0760ad956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:17.836072 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa6564-1665-4bba-8321-21a0760ad956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:17.836526 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa6564-1665-4bba-8321-21a0760ad956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:17.836801 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa6564-1665-4bba-8321-21a0760ad956 admin admin] PATH_INFO: `/v3/users/5be47a493f8b4618bed5ccdf2adf3072` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:17.838077 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa6564-1665-4bba-8321-21a0760ad956 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5be47a493f8b4618bed5ccdf2adf3072)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:17.840080 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa6564-1665-4bba-8321-21a0760ad956 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:17.847021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:17.901456 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-44fa6564-1665-4bba-8321-21a0760ad956 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5be47a493f8b4618bed5ccdf2adf3072'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:17.902143 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-44fa6564-1665-4bba-8321-21a0760ad956 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5be47a493f8b4618bed5ccdf2adf3072'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:17.911379 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-44fa6564-1665-4bba-8321-21a0760ad956 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5be47a493f8b4618bed5ccdf2adf3072'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:17.912301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-44fa6564-1665-4bba-8321-21a0760ad956 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5be47a493f8b4618bed5ccdf2adf3072'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:17.922529 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-44fa6564-1665-4bba-8321-21a0760ad956 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5be47a493f8b4618bed5ccdf2adf3072'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:17.944545 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1091/2209] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:58:17 2022] DELETE /identity/v3/users/5be47a493f8b4618bed5ccdf2adf3072 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:58:17.951114 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e94032-89ba-466d-af05-71d52379ef2f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:17.952365 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e94032-89ba-466d-af05-71d52379ef2f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:17.952365 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e94032-89ba-466d-af05-71d52379ef2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:17.977027 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c0e94032-89ba-466d-af05-71d52379ef2f None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:17.978260 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c0e94032-89ba-466d-af05-71d52379ef2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:17.995641 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:18.084698 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1119/2210] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:18.101135 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa6564-1665-4bba-8321-21a0760ad956 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:18.103092 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-44fa6564-1665-4bba-8321-21a0760ad956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:18.202246 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa6564-1665-4bba-8321-21a0760ad956 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:18.208513 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949efa2-e99d-45e8-aea3-4ee1340ce04f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:18.209204 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949efa2-e99d-45e8-aea3-4ee1340ce04f service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:18.209485 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949efa2-e99d-45e8-aea3-4ee1340ce04f service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:18.209946 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949efa2-e99d-45e8-aea3-4ee1340ce04f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:18.223215 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949efa2-e99d-45e8-aea3-4ee1340ce04f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:18.225015 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949efa2-e99d-45e8-aea3-4ee1340ce04f service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:18.237475 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1092/2211] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:18.666619 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cf084-8248-48df-9223-efa853987e47 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:18.667289 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cf084-8248-48df-9223-efa853987e47 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:18.668264 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cf084-8248-48df-9223-efa853987e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:18.726467 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-160cf084-8248-48df-9223-efa853987e47 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:18.730961 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-160cf084-8248-48df-9223-efa853987e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:18.754762 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1120/2212] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Oct 2 00:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:18.782333 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949efa2-e99d-45e8-aea3-4ee1340ce04f service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:18.786951 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d949efa2-e99d-45e8-aea3-4ee1340ce04f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:18.841614 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cf084-8248-48df-9223-efa853987e47 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:18.844178 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-160cf084-8248-48df-9223-efa853987e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:18.870775 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cf084-8248-48df-9223-efa853987e47 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:18.881485 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd469cf-ee01-482c-b550-a65fa5fdebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:18.882445 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd469cf-ee01-482c-b550-a65fa5fdebde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:18.882731 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd469cf-ee01-482c-b550-a65fa5fdebde admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:18.883055 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd469cf-ee01-482c-b550-a65fa5fdebde admin admin] PATH_INFO: `/v3/projects/3228f1015ed7465798035d231e09fc59` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:18.884430 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd469cf-ee01-482c-b550-a65fa5fdebde admin admin] RBAC: Authorizing `identity:delete_project(project_id=3228f1015ed7465798035d231e09fc59)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:18.886988 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd469cf-ee01-482c-b550-a65fa5fdebde admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:18.947261 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949efa2-e99d-45e8-aea3-4ee1340ce04f service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:18.953198 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd56288-88a2-41c8-90b1-2079f185bba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:18.953885 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd56288-88a2-41c8-90b1-2079f185bba8 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:18.954167 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd56288-88a2-41c8-90b1-2079f185bba8 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:18.954535 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd56288-88a2-41c8-90b1-2079f185bba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:18.966700 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd56288-88a2-41c8-90b1-2079f185bba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:18.973054 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd56288-88a2-41c8-90b1-2079f185bba8 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:18.991415 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1093/2213] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:58:19.008971 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dcd469cf-ee01-482c-b550-a65fa5fdebde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3228f1015ed7465798035d231e09fc59', 'request_id': 'req-dcd469cf-ee01-482c-b550-a65fa5fdebde'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:19.016680 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dcd469cf-ee01-482c-b550-a65fa5fdebde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3228f1015ed7465798035d231e09fc59', 'request_id': 'req-dcd469cf-ee01-482c-b550-a65fa5fdebde'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:19.031536 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dcd469cf-ee01-482c-b550-a65fa5fdebde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3228f1015ed7465798035d231e09fc59', 'request_id': 'req-dcd469cf-ee01-482c-b550-a65fa5fdebde'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:19.048290 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dcd469cf-ee01-482c-b550-a65fa5fdebde admin admin] The token cache is being invalidate because project 3228f1015ed7465798035d231e09fc59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:58:19.048690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dcd469cf-ee01-482c-b550-a65fa5fdebde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:19.049619 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dcd469cf-ee01-482c-b550-a65fa5fdebde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:19.051468 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1121/2214] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:58:18 2022] DELETE /identity/v3/projects/3228f1015ed7465798035d231e09fc59 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:58:19.056221 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd56288-88a2-41c8-90b1-2079f185bba8 service nova] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:19.072316 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd56288-88a2-41c8-90b1-2079f185bba8 service nova] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:19.086367 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:19.159854 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6ada7-9266-42b4-8e56-23cb423b5530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:19.160462 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6ada7-9266-42b4-8e56-23cb423b5530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:19.160770 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6ada7-9266-42b4-8e56-23cb423b5530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:19.161222 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6ada7-9266-42b4-8e56-23cb423b5530 admin admin] PATH_INFO: `/v3/users/a5f4b381b2cf4c5187fd0f97ef31f0dc` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:19.162683 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6ada7-9266-42b4-8e56-23cb423b5530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f4b381b2cf4c5187fd0f97ef31f0dc)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:19.164931 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6ada7-9266-42b4-8e56-23cb423b5530 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:19.249349 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f2e6ada7-9266-42b4-8e56-23cb423b5530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f4b381b2cf4c5187fd0f97ef31f0dc'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:19.257094 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f2e6ada7-9266-42b4-8e56-23cb423b5530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f4b381b2cf4c5187fd0f97ef31f0dc'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:19.270765 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f2e6ada7-9266-42b4-8e56-23cb423b5530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f4b381b2cf4c5187fd0f97ef31f0dc'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:19.271833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f2e6ada7-9266-42b4-8e56-23cb423b5530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f4b381b2cf4c5187fd0f97ef31f0dc'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:19.284215 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f2e6ada7-9266-42b4-8e56-23cb423b5530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f4b381b2cf4c5187fd0f97ef31f0dc'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:19.309545 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1094/2215] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:58:19 2022] DELETE /identity/v3/users/a5f4b381b2cf4c5187fd0f97ef31f0dc => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:19.738191 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd469cf-ee01-482c-b550-a65fa5fdebde admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:19.739753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dcd469cf-ee01-482c-b550-a65fa5fdebde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:19.780591 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd469cf-ee01-482c-b550-a65fa5fdebde admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:19.858101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801bee8-a2d3-4f6f-8af5-75aadff9f570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:19.858822 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801bee8-a2d3-4f6f-8af5-75aadff9f570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:19.859106 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801bee8-a2d3-4f6f-8af5-75aadff9f570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:19.859384 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801bee8-a2d3-4f6f-8af5-75aadff9f570 admin admin] PATH_INFO: `/v3/projects/365f2d07d1b74deea6e5a73ba347242c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:19.860654 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801bee8-a2d3-4f6f-8af5-75aadff9f570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=365f2d07d1b74deea6e5a73ba347242c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:19.862742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801bee8-a2d3-4f6f-8af5-75aadff9f570 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:19.921198 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:19.930877 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6801bee8-a2d3-4f6f-8af5-75aadff9f570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '365f2d07d1b74deea6e5a73ba347242c', 'request_id': 'req-6801bee8-a2d3-4f6f-8af5-75aadff9f570'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:19.938905 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6801bee8-a2d3-4f6f-8af5-75aadff9f570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '365f2d07d1b74deea6e5a73ba347242c', 'request_id': 'req-6801bee8-a2d3-4f6f-8af5-75aadff9f570'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:19.947964 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6801bee8-a2d3-4f6f-8af5-75aadff9f570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '365f2d07d1b74deea6e5a73ba347242c', 'request_id': 'req-6801bee8-a2d3-4f6f-8af5-75aadff9f570'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:19.967715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6801bee8-a2d3-4f6f-8af5-75aadff9f570 admin admin] The token cache is being invalidate because project 365f2d07d1b74deea6e5a73ba347242c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:58:19.968002 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6801bee8-a2d3-4f6f-8af5-75aadff9f570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:19.968663 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6801bee8-a2d3-4f6f-8af5-75aadff9f570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:19.970230 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1122/2216] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:58:19 2022] DELETE /identity/v3/projects/365f2d07d1b74deea6e5a73ba347242c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:19.976062 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ae488-6070-48d9-9fb1-438d525a06e8 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:19.976570 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ae488-6070-48d9-9fb1-438d525a06e8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:19.976570 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ae488-6070-48d9-9fb1-438d525a06e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:19.999030 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-449ae488-6070-48d9-9fb1-438d525a06e8 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:20.000244 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-449ae488-6070-48d9-9fb1-438d525a06e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:20.070505 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1095/2217] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:20.080334 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba5833-47d6-420b-be4f-031859892428 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:20.080969 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba5833-47d6-420b-be4f-031859892428 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:20.080969 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba5833-47d6-420b-be4f-031859892428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:20.100576 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-53ba5833-47d6-420b-be4f-031859892428 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:20.101933 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-53ba5833-47d6-420b-be4f-031859892428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:20.111750 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1123/2218] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:20.116035 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ae488-6070-48d9-9fb1-438d525a06e8 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:20.126776 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ae488-6070-48d9-9fb1-438d525a06e8 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:20.131267 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff0989-542f-4318-a357-12f00eb9c544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:20.131866 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff0989-542f-4318-a357-12f00eb9c544 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:20.132159 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff0989-542f-4318-a357-12f00eb9c544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:20.132418 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff0989-542f-4318-a357-12f00eb9c544 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:20.133098 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff0989-542f-4318-a357-12f00eb9c544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:58:20.133400 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff0989-542f-4318-a357-12f00eb9c544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:20.135059 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff0989-542f-4318-a357-12f00eb9c544 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:20.147085 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1096/2219] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:58:20.151491 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba5833-47d6-420b-be4f-031859892428 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:20.161001 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba5833-47d6-420b-be4f-031859892428 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:20.166155 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e13988-48d4-4ff1-ab11-3971c04a81e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:20.166784 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e13988-48d4-4ff1-ab11-3971c04a81e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:20.167058 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e13988-48d4-4ff1-ab11-3971c04a81e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:20.167329 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e13988-48d4-4ff1-ab11-3971c04a81e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:20.167949 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e13988-48d4-4ff1-ab11-3971c04a81e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:20.170465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e13988-48d4-4ff1-ab11-3971c04a81e9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:20.199929 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1124/2220] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:58:20 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:58:20.204417 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff0989-542f-4318-a357-12f00eb9c544 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:20.215643 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff0989-542f-4318-a357-12f00eb9c544 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:20.233543 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:20.277964 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf3268-329e-4446-ba53-ab5ee1b5d676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:20.278677 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf3268-329e-4446-ba53-ab5ee1b5d676 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:20.278975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf3268-329e-4446-ba53-ab5ee1b5d676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:20.279302 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf3268-329e-4446-ba53-ab5ee1b5d676 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:20.279946 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf3268-329e-4446-ba53-ab5ee1b5d676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:20.281933 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf3268-329e-4446-ba53-ab5ee1b5d676 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:20.311308 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1097/2221] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:58:20 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:58:20.313350 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e13988-48d4-4ff1-ab11-3971c04a81e9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:20.325402 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e13988-48d4-4ff1-ab11-3971c04a81e9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:20.330494 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab8fc6-829c-4441-933b-69c91efc455f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:20.331101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab8fc6-829c-4441-933b-69c91efc455f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:20.331380 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab8fc6-829c-4441-933b-69c91efc455f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:20.331656 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab8fc6-829c-4441-933b-69c91efc455f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:20.332297 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab8fc6-829c-4441-933b-69c91efc455f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:20.333949 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab8fc6-829c-4441-933b-69c91efc455f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:20.345153 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1125/2222] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:58:20.349151 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf3268-329e-4446-ba53-ab5ee1b5d676 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:20.360604 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf3268-329e-4446-ba53-ab5ee1b5d676 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:20.365573 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2880fe-05d5-41d6-8df0-dcc20a158525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:20.366305 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2880fe-05d5-41d6-8df0-dcc20a158525 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:20.366662 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2880fe-05d5-41d6-8df0-dcc20a158525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:20.367034 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2880fe-05d5-41d6-8df0-dcc20a158525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:20.367971 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2880fe-05d5-41d6-8df0-dcc20a158525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:20.369765 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2880fe-05d5-41d6-8df0-dcc20a158525 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:20.383734 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1098/2223] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:58:20.390985 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab8fc6-829c-4441-933b-69c91efc455f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:20.403454 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab8fc6-829c-4441-933b-69c91efc455f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:20.408696 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7eecc-65bb-4d1c-8527-e4cf381221f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:20.409397 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7eecc-65bb-4d1c-8527-e4cf381221f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:20.409710 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7eecc-65bb-4d1c-8527-e4cf381221f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:20.409991 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7eecc-65bb-4d1c-8527-e4cf381221f7 admin admin] PATH_INFO: `/v3/projects/e6e1e630d082449a8edb97d40d5e0770/users/b4c4c3c3350a4c258a0aa813fc4d815b/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:20.427205 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7eecc-65bb-4d1c-8527-e4cf381221f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e1e630d082449a8edb97d40d5e0770, user_id=b4c4c3c3350a4c258a0aa813fc4d815b, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:20.430160 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7eecc-65bb-4d1c-8527-e4cf381221f7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:20.447442 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1126/2224] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:58:20 2022] PUT /identity/v3/projects/e6e1e630d082449a8edb97d40d5e0770/users/b4c4c3c3350a4c258a0aa813fc4d815b/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:58:20.458772 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa37c4c-77e3-4b49-9028-e1c73e201575 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:20.459069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa37c4c-77e3-4b49-9028-e1c73e201575 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:20.459338 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa37c4c-77e3-4b49-9028-e1c73e201575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:20.491180 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-afa37c4c-77e3-4b49-9028-e1c73e201575 None None] MFA Rules not processed for user `b4c4c3c3350a4c258a0aa813fc4d815b`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:20.492474 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-afa37c4c-77e3-4b49-9028-e1c73e201575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:20.595460 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7eecc-65bb-4d1c-8527-e4cf381221f7 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:20.597099 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1099/2225] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:20.675109 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7eecc-65bb-4d1c-8527-e4cf381221f7 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:20.681063 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647720b-b2b8-4d23-bd26-c70a575e5dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:20.681758 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647720b-b2b8-4d23-bd26-c70a575e5dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:20.682014 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647720b-b2b8-4d23-bd26-c70a575e5dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:20.682243 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647720b-b2b8-4d23-bd26-c70a575e5dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:20.683005 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647720b-b2b8-4d23-bd26-c70a575e5dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:20.684979 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647720b-b2b8-4d23-bd26-c70a575e5dc7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:20.728989 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1127/2226] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:58:20 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:58:20.733113 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa37c4c-77e3-4b49-9028-e1c73e201575 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:20.744897 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa37c4c-77e3-4b49-9028-e1c73e201575 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:20.809565 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c539a06-9bcb-497c-be0b-b94b20e619bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:20.810171 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c539a06-9bcb-497c-be0b-b94b20e619bd admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:20.812549 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c539a06-9bcb-497c-be0b-b94b20e619bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:20.812549 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c539a06-9bcb-497c-be0b-b94b20e619bd admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:20.813414 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c539a06-9bcb-497c-be0b-b94b20e619bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:20.815136 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c539a06-9bcb-497c-be0b-b94b20e619bd admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:20.838170 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1100/2227] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:58:20 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:58:20.842404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647720b-b2b8-4d23-bd26-c70a575e5dc7 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:20.853375 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647720b-b2b8-4d23-bd26-c70a575e5dc7 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:20.860606 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2076bdc-ef6c-4ecb-b6e6-a95192e00000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:20.861248 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2076bdc-ef6c-4ecb-b6e6-a95192e00000 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:20.861529 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2076bdc-ef6c-4ecb-b6e6-a95192e00000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:20.862339 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2076bdc-ef6c-4ecb-b6e6-a95192e00000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:20.862436 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2076bdc-ef6c-4ecb-b6e6-a95192e00000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:20.864022 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2076bdc-ef6c-4ecb-b6e6-a95192e00000 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:20.876489 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1128/2228] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:58:20.880785 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c539a06-9bcb-497c-be0b-b94b20e619bd admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:20.891579 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c539a06-9bcb-497c-be0b-b94b20e619bd admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:20.896199 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89dfbc0-be16-462e-acf4-34010a60b8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:20.896963 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dfbc0-be16-462e-acf4-34010a60b8c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:20.897254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dfbc0-be16-462e-acf4-34010a60b8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:20.897524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dfbc0-be16-462e-acf4-34010a60b8c6 admin admin] PATH_INFO: `/v3/projects/675d145376054f0e8c690eea7a437405/users/4121a7aaa54c4ca4b28e15bebed9a0bb/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:20.912663 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89dfbc0-be16-462e-acf4-34010a60b8c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=675d145376054f0e8c690eea7a437405, user_id=4121a7aaa54c4ca4b28e15bebed9a0bb, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:20.915388 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89dfbc0-be16-462e-acf4-34010a60b8c6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:20.917567 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:20.929276 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1101/2229] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:58:20 2022] PUT /identity/v3/projects/675d145376054f0e8c690eea7a437405/users/4121a7aaa54c4ca4b28e15bebed9a0bb/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:20.933442 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2076bdc-ef6c-4ecb-b6e6-a95192e00000 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:20.944604 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2076bdc-ef6c-4ecb-b6e6-a95192e00000 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:20.978894 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:21.004766 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d491b77-e91c-4b32-9da9-807275569ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:21.005404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d491b77-e91c-4b32-9da9-807275569ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:21.005687 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d491b77-e91c-4b32-9da9-807275569ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:21.005961 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d491b77-e91c-4b32-9da9-807275569ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:21.006599 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d491b77-e91c-4b32-9da9-807275569ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:21.008202 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d491b77-e91c-4b32-9da9-807275569ae4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:21.018266 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1129/2230] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 00:58:21.022448 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89dfbc0-be16-462e-acf4-34010a60b8c6 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:21.032931 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89dfbc0-be16-462e-acf4-34010a60b8c6 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:21.037522 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f35f6-11ef-46cd-b44a-0abd9d502d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:21.038162 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f35f6-11ef-46cd-b44a-0abd9d502d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:21.038438 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f35f6-11ef-46cd-b44a-0abd9d502d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:21.038707 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f35f6-11ef-46cd-b44a-0abd9d502d02 admin admin] PATH_INFO: `/v3/projects/675d145376054f0e8c690eea7a437405/users/4121a7aaa54c4ca4b28e15bebed9a0bb/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:21.040646 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f35f6-11ef-46cd-b44a-0abd9d502d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=675d145376054f0e8c690eea7a437405, user_id=4121a7aaa54c4ca4b28e15bebed9a0bb, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:21.043320 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f35f6-11ef-46cd-b44a-0abd9d502d02 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:21.054157 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1102/2231] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:58:21 2022] PUT /identity/v3/projects/675d145376054f0e8c690eea7a437405/users/4121a7aaa54c4ca4b28e15bebed9a0bb/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:21.066242 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5a245-f7ae-4d27-90f2-c91a98996349 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:21.066559 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5a245-f7ae-4d27-90f2-c91a98996349 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:21.066872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5a245-f7ae-4d27-90f2-c91a98996349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:21.096744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-77d5a245-f7ae-4d27-90f2-c91a98996349 None None] MFA Rules not processed for user `4121a7aaa54c4ca4b28e15bebed9a0bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:21.097922 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-77d5a245-f7ae-4d27-90f2-c91a98996349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:21.196045 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1130/2232] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:21.210614 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f35f6-11ef-46cd-b44a-0abd9d502d02 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:21.212721 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-294f35f6-11ef-46cd-b44a-0abd9d502d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:21.293727 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f35f6-11ef-46cd-b44a-0abd9d502d02 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:21.298379 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07d57a-c9ab-4b61-ba19-e7063914b92f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:21.299124 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07d57a-c9ab-4b61-ba19-e7063914b92f service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:21.299480 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07d57a-c9ab-4b61-ba19-e7063914b92f service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:21.299764 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07d57a-c9ab-4b61-ba19-e7063914b92f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:21.309735 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07d57a-c9ab-4b61-ba19-e7063914b92f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:21.311683 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07d57a-c9ab-4b61-ba19-e7063914b92f service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:21.321465 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1103/2233] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:21.433565 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5a245-f7ae-4d27-90f2-c91a98996349 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:21.455180 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5a245-f7ae-4d27-90f2-c91a98996349 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:21.459779 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4c29a-f352-493d-a6c0-facab310c371 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:21.459946 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4c29a-f352-493d-a6c0-facab310c371 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:21.460236 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4c29a-f352-493d-a6c0-facab310c371 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:21.460517 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4c29a-f352-493d-a6c0-facab310c371 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:21.524627 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4c29a-f352-493d-a6c0-facab310c371 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:21.526101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4c29a-f352-493d-a6c0-facab310c371 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:21.537141 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1131/2234] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:23.004788 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fca8f-7bec-4e9a-884d-7bfdaeb41739 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:23.005774 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fca8f-7bec-4e9a-884d-7bfdaeb41739 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:23.006129 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fca8f-7bec-4e9a-884d-7bfdaeb41739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:23.040519 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-387fca8f-7bec-4e9a-884d-7bfdaeb41739 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:23.042007 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-387fca8f-7bec-4e9a-884d-7bfdaeb41739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:23.195051 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1104/2235] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Oct 2 00:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:23.227989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4c29a-f352-493d-a6c0-facab310c371 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:23.229574 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-18f4c29a-f352-493d-a6c0-facab310c371 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:23.308034 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:23.354929 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4c29a-f352-493d-a6c0-facab310c371 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:23.373795 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc3092-e573-4acb-802d-4c68f932ac93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:23.374837 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc3092-e573-4acb-802d-4c68f932ac93 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:23.375130 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc3092-e573-4acb-802d-4c68f932ac93 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:23.375408 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc3092-e573-4acb-802d-4c68f932ac93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:23.396167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc3092-e573-4acb-802d-4c68f932ac93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:23.399638 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc3092-e573-4acb-802d-4c68f932ac93 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:23.427501 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1132/2236] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:24.257467 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fca8f-7bec-4e9a-884d-7bfdaeb41739 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:24.276390 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fca8f-7bec-4e9a-884d-7bfdaeb41739 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:24.285318 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7d0e6-bf81-4d70-9e87-4f8f4060b1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:24.286312 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7d0e6-bf81-4d70-9e87-4f8f4060b1e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:24.286589 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7d0e6-bf81-4d70-9e87-4f8f4060b1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:24.286880 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7d0e6-bf81-4d70-9e87-4f8f4060b1e9 admin admin] PATH_INFO: `/v3/users/b4c4c3c3350a4c258a0aa813fc4d815b` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:24.288067 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7d0e6-bf81-4d70-9e87-4f8f4060b1e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4c4c3c3350a4c258a0aa813fc4d815b)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:24.290322 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7d0e6-bf81-4d70-9e87-4f8f4060b1e9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:24.353263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-91c7d0e6-bf81-4d70-9e87-4f8f4060b1e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4c4c3c3350a4c258a0aa813fc4d815b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:24.354043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-91c7d0e6-bf81-4d70-9e87-4f8f4060b1e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4c4c3c3350a4c258a0aa813fc4d815b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:24.365614 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-91c7d0e6-bf81-4d70-9e87-4f8f4060b1e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4c4c3c3350a4c258a0aa813fc4d815b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:24.366433 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-91c7d0e6-bf81-4d70-9e87-4f8f4060b1e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4c4c3c3350a4c258a0aa813fc4d815b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:24.375601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-91c7d0e6-bf81-4d70-9e87-4f8f4060b1e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4c4c3c3350a4c258a0aa813fc4d815b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:24.414816 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:24.428386 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1105/2237] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:58:24 2022] DELETE /identity/v3/users/b4c4c3c3350a4c258a0aa813fc4d815b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:24.433732 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ecc64-a9e8-4291-8f84-c484bc8dd364 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:24.434219 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ecc64-a9e8-4291-8f84-c484bc8dd364 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:24.434328 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ecc64-a9e8-4291-8f84-c484bc8dd364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:24.461423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-958ecc64-a9e8-4291-8f84-c484bc8dd364 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:24.462658 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-958ecc64-a9e8-4291-8f84-c484bc8dd364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:24.540897 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1133/2238] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:58:24.552722 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7d0e6-bf81-4d70-9e87-4f8f4060b1e9 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:24.554295 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-91c7d0e6-bf81-4d70-9e87-4f8f4060b1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:24.635470 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7d0e6-bf81-4d70-9e87-4f8f4060b1e9 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:24.640837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506aee9-e459-45d3-b0fa-787d2fa691a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:24.641320 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506aee9-e459-45d3-b0fa-787d2fa691a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:24.641712 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506aee9-e459-45d3-b0fa-787d2fa691a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:24.642046 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506aee9-e459-45d3-b0fa-787d2fa691a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:24.664258 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506aee9-e459-45d3-b0fa-787d2fa691a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:24.664258 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506aee9-e459-45d3-b0fa-787d2fa691a6 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:24.668716 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1106/2239] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:24.995127 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ecc64-a9e8-4291-8f84-c484bc8dd364 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:24.996843 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-958ecc64-a9e8-4291-8f84-c484bc8dd364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:25.010616 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ecc64-a9e8-4291-8f84-c484bc8dd364 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:25.015964 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19645689-7c3c-4732-96bf-1771cf4eccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:25.016869 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19645689-7c3c-4732-96bf-1771cf4eccd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:25.017415 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19645689-7c3c-4732-96bf-1771cf4eccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:25.017690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19645689-7c3c-4732-96bf-1771cf4eccd7 admin admin] PATH_INFO: `/v3/projects/e6e1e630d082449a8edb97d40d5e0770` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:25.019119 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19645689-7c3c-4732-96bf-1771cf4eccd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e1e630d082449a8edb97d40d5e0770)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:25.021835 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19645689-7c3c-4732-96bf-1771cf4eccd7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:25.087738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-19645689-7c3c-4732-96bf-1771cf4eccd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e1e630d082449a8edb97d40d5e0770', 'request_id': 'req-19645689-7c3c-4732-96bf-1771cf4eccd7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:25.095690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-19645689-7c3c-4732-96bf-1771cf4eccd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e1e630d082449a8edb97d40d5e0770', 'request_id': 'req-19645689-7c3c-4732-96bf-1771cf4eccd7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:25.104505 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-19645689-7c3c-4732-96bf-1771cf4eccd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e1e630d082449a8edb97d40d5e0770', 'request_id': 'req-19645689-7c3c-4732-96bf-1771cf4eccd7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:25.116429 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-19645689-7c3c-4732-96bf-1771cf4eccd7 admin admin] The token cache is being invalidate because project e6e1e630d082449a8edb97d40d5e0770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:58:25.116725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-19645689-7c3c-4732-96bf-1771cf4eccd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:25.117398 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-19645689-7c3c-4732-96bf-1771cf4eccd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:25.118924 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1134/2240] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:58:24 2022] DELETE /identity/v3/projects/e6e1e630d082449a8edb97d40d5e0770 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:25.123513 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506aee9-e459-45d3-b0fa-787d2fa691a6 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:25.133012 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506aee9-e459-45d3-b0fa-787d2fa691a6 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:25.202923 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13156277-152d-4849-b7ba-16542d9abf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:25.203862 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13156277-152d-4849-b7ba-16542d9abf22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:25.204311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13156277-152d-4849-b7ba-16542d9abf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:25.204778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13156277-152d-4849-b7ba-16542d9abf22 admin admin] PATH_INFO: `/v3/users/4121a7aaa54c4ca4b28e15bebed9a0bb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:25.206384 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13156277-152d-4849-b7ba-16542d9abf22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4121a7aaa54c4ca4b28e15bebed9a0bb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:25.208419 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13156277-152d-4849-b7ba-16542d9abf22 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:25.265858 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-13156277-152d-4849-b7ba-16542d9abf22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4121a7aaa54c4ca4b28e15bebed9a0bb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:25.266980 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-13156277-152d-4849-b7ba-16542d9abf22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4121a7aaa54c4ca4b28e15bebed9a0bb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:25.277225 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-13156277-152d-4849-b7ba-16542d9abf22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4121a7aaa54c4ca4b28e15bebed9a0bb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:25.278181 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-13156277-152d-4849-b7ba-16542d9abf22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4121a7aaa54c4ca4b28e15bebed9a0bb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:25.290628 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-13156277-152d-4849-b7ba-16542d9abf22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4121a7aaa54c4ca4b28e15bebed9a0bb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:25.311262 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1107/2241] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:58:25 2022] DELETE /identity/v3/users/4121a7aaa54c4ca4b28e15bebed9a0bb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:25.671606 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19645689-7c3c-4732-96bf-1771cf4eccd7 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:25.673101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-19645689-7c3c-4732-96bf-1771cf4eccd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:25.690346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19645689-7c3c-4732-96bf-1771cf4eccd7 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:25.753587 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156f158-6f8c-4b60-bdd9-f22ad9549fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:25.754217 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156f158-6f8c-4b60-bdd9-f22ad9549fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:25.754498 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156f158-6f8c-4b60-bdd9-f22ad9549fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:25.754770 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156f158-6f8c-4b60-bdd9-f22ad9549fd0 admin admin] PATH_INFO: `/v3/projects/675d145376054f0e8c690eea7a437405` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:25.755895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156f158-6f8c-4b60-bdd9-f22ad9549fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=675d145376054f0e8c690eea7a437405)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:25.757865 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156f158-6f8c-4b60-bdd9-f22ad9549fd0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:25.766757 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:25.809136 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7156f158-6f8c-4b60-bdd9-f22ad9549fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '675d145376054f0e8c690eea7a437405', 'request_id': 'req-7156f158-6f8c-4b60-bdd9-f22ad9549fd0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:25.815910 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7156f158-6f8c-4b60-bdd9-f22ad9549fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '675d145376054f0e8c690eea7a437405', 'request_id': 'req-7156f158-6f8c-4b60-bdd9-f22ad9549fd0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:25.823382 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7156f158-6f8c-4b60-bdd9-f22ad9549fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '675d145376054f0e8c690eea7a437405', 'request_id': 'req-7156f158-6f8c-4b60-bdd9-f22ad9549fd0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:25.834848 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7156f158-6f8c-4b60-bdd9-f22ad9549fd0 admin admin] The token cache is being invalidate because project 675d145376054f0e8c690eea7a437405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:58:25.835132 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7156f158-6f8c-4b60-bdd9-f22ad9549fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:25.835770 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7156f158-6f8c-4b60-bdd9-f22ad9549fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:25.837282 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1135/2242] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:58:25 2022] DELETE /identity/v3/projects/675d145376054f0e8c690eea7a437405 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:25.842613 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592a6d4-6b79-43de-9365-666390395932 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:25.842903 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592a6d4-6b79-43de-9365-666390395932 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:25.843177 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592a6d4-6b79-43de-9365-666390395932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:25.863784 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-9592a6d4-6b79-43de-9365-666390395932 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:25.865110 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9592a6d4-6b79-43de-9365-666390395932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:25.879909 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:25.934056 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1108/2243] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:25.943936 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868929d-3d0d-4c6e-b1a1-88af365a2740 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:25.944215 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868929d-3d0d-4c6e-b1a1-88af365a2740 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:25.944486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868929d-3d0d-4c6e-b1a1-88af365a2740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:25.964709 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3868929d-3d0d-4c6e-b1a1-88af365a2740 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:25.965945 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3868929d-3d0d-4c6e-b1a1-88af365a2740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:25.974997 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1136/2244] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:25.979357 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592a6d4-6b79-43de-9365-666390395932 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:25.989648 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592a6d4-6b79-43de-9365-666390395932 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:25.994129 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8cbbc-4254-4f06-8cb2-9b649f7eeca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:25.994720 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8cbbc-4254-4f06-8cb2-9b649f7eeca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:25.994996 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8cbbc-4254-4f06-8cb2-9b649f7eeca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:25.995263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8cbbc-4254-4f06-8cb2-9b649f7eeca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:25.996157 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8cbbc-4254-4f06-8cb2-9b649f7eeca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:58:25.996456 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8cbbc-4254-4f06-8cb2-9b649f7eeca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:25.998736 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8cbbc-4254-4f06-8cb2-9b649f7eeca5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:26.010332 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1109/2245] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:58:26.014763 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868929d-3d0d-4c6e-b1a1-88af365a2740 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:26.024140 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868929d-3d0d-4c6e-b1a1-88af365a2740 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:26.030360 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252132cc-6164-4d16-9fb9-5f13aabe353b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:26.031285 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252132cc-6164-4d16-9fb9-5f13aabe353b admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:26.031633 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252132cc-6164-4d16-9fb9-5f13aabe353b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:26.031910 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252132cc-6164-4d16-9fb9-5f13aabe353b admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:26.032713 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252132cc-6164-4d16-9fb9-5f13aabe353b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:26.035093 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252132cc-6164-4d16-9fb9-5f13aabe353b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:26.070511 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1137/2246] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:58:26 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:58:26.073755 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8cbbc-4254-4f06-8cb2-9b649f7eeca5 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:26.084139 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8cbbc-4254-4f06-8cb2-9b649f7eeca5 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:26.151356 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26112688-bc1f-4b35-a21c-dda5852034b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:26.151966 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26112688-bc1f-4b35-a21c-dda5852034b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:26.152365 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26112688-bc1f-4b35-a21c-dda5852034b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:26.152665 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26112688-bc1f-4b35-a21c-dda5852034b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:26.153433 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26112688-bc1f-4b35-a21c-dda5852034b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:26.156088 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26112688-bc1f-4b35-a21c-dda5852034b9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:26.183793 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1110/2247] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:58:26 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:58:26.188717 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252132cc-6164-4d16-9fb9-5f13aabe353b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:26.199323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252132cc-6164-4d16-9fb9-5f13aabe353b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:26.204484 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ada4f8-3906-4cb2-8706-053e92356132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:26.206444 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ada4f8-3906-4cb2-8706-053e92356132 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:26.206648 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ada4f8-3906-4cb2-8706-053e92356132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:26.206996 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ada4f8-3906-4cb2-8706-053e92356132 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:26.207769 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ada4f8-3906-4cb2-8706-053e92356132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:26.209511 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ada4f8-3906-4cb2-8706-053e92356132 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:26.221097 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1138/2248] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:58:26.224975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26112688-bc1f-4b35-a21c-dda5852034b9 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:26.245083 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26112688-bc1f-4b35-a21c-dda5852034b9 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:26.258585 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265aa90-f1fb-406b-86da-f8e4f9e73fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:26.259224 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265aa90-f1fb-406b-86da-f8e4f9e73fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:26.259513 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265aa90-f1fb-406b-86da-f8e4f9e73fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:26.259907 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265aa90-f1fb-406b-86da-f8e4f9e73fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:26.260594 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265aa90-f1fb-406b-86da-f8e4f9e73fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:26.263497 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265aa90-f1fb-406b-86da-f8e4f9e73fa9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:26.278614 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1111/2249] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:58:26.283162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ada4f8-3906-4cb2-8706-053e92356132 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:26.294139 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ada4f8-3906-4cb2-8706-053e92356132 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:26.300043 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ca37a-624d-4de0-b3dd-c31b6970f877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:26.300835 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ca37a-624d-4de0-b3dd-c31b6970f877 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:26.301203 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ca37a-624d-4de0-b3dd-c31b6970f877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:26.301539 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ca37a-624d-4de0-b3dd-c31b6970f877 admin admin] PATH_INFO: `/v3/projects/5ee6dd6553cc44119372aa90d736bea2/users/e620db835bac4a9f9f0807751f17c43b/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:26.328209 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ca37a-624d-4de0-b3dd-c31b6970f877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee6dd6553cc44119372aa90d736bea2, user_id=e620db835bac4a9f9f0807751f17c43b, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:26.331881 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ca37a-624d-4de0-b3dd-c31b6970f877 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:26.348243 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1139/2250] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:58:26 2022] PUT /identity/v3/projects/5ee6dd6553cc44119372aa90d736bea2/users/e620db835bac4a9f9f0807751f17c43b/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:26.358690 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850887d-41e2-4a75-938e-b77bff8219b4 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:26.359106 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850887d-41e2-4a75-938e-b77bff8219b4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:26.359472 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850887d-41e2-4a75-938e-b77bff8219b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:26.410931 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-0850887d-41e2-4a75-938e-b77bff8219b4 None None] MFA Rules not processed for user `e620db835bac4a9f9f0807751f17c43b`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:26.414948 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0850887d-41e2-4a75-938e-b77bff8219b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:26.545767 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1112/2251] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:58:26.550331 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ca37a-624d-4de0-b3dd-c31b6970f877 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:26.673927 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ca37a-624d-4de0-b3dd-c31b6970f877 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:26.686611 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616d43a-b481-4519-84f5-53c52a7b7a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:26.687389 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616d43a-b481-4519-84f5-53c52a7b7a2a admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:26.687668 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616d43a-b481-4519-84f5-53c52a7b7a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:26.688502 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616d43a-b481-4519-84f5-53c52a7b7a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:26.689210 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616d43a-b481-4519-84f5-53c52a7b7a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:26.691778 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616d43a-b481-4519-84f5-53c52a7b7a2a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:26.734320 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1140/2252] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:58:26 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:58:26.745544 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850887d-41e2-4a75-938e-b77bff8219b4 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:26.766767 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850887d-41e2-4a75-938e-b77bff8219b4 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:26.782010 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:26.927497 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1bb73-7547-4af4-ae77-2d1d71d0e979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:26.928211 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1bb73-7547-4af4-ae77-2d1d71d0e979 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:26.928553 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1bb73-7547-4af4-ae77-2d1d71d0e979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:26.928867 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1bb73-7547-4af4-ae77-2d1d71d0e979 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:26.930195 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1bb73-7547-4af4-ae77-2d1d71d0e979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:26.934054 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1bb73-7547-4af4-ae77-2d1d71d0e979 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:26.989839 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1113/2253] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:58:26 2022] POST /identity/v3/users => generated 300 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:58:26.993829 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616d43a-b481-4519-84f5-53c52a7b7a2a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:27.013003 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616d43a-b481-4519-84f5-53c52a7b7a2a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:27.026846 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd68ff2-82d3-434a-b25c-ad3211f465ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:27.027870 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd68ff2-82d3-434a-b25c-ad3211f465ac admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:27.028364 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd68ff2-82d3-434a-b25c-ad3211f465ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:27.029126 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd68ff2-82d3-434a-b25c-ad3211f465ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:27.030517 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd68ff2-82d3-434a-b25c-ad3211f465ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:27.032549 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd68ff2-82d3-434a-b25c-ad3211f465ac admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:27.047854 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1141/2254] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:58:27.052418 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1bb73-7547-4af4-ae77-2d1d71d0e979 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:27.068239 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1bb73-7547-4af4-ae77-2d1d71d0e979 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:27.075473 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137993f-1875-44f6-92b9-735bdb2f7b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:27.076820 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137993f-1875-44f6-92b9-735bdb2f7b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:27.077385 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137993f-1875-44f6-92b9-735bdb2f7b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:27.077791 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137993f-1875-44f6-92b9-735bdb2f7b2c admin admin] PATH_INFO: `/v3/projects/0292f4f92b704c0b9787102348f088de/users/942fc2477482463991d6d3a6288d3f0f/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:27.103384 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137993f-1875-44f6-92b9-735bdb2f7b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0292f4f92b704c0b9787102348f088de, user_id=942fc2477482463991d6d3a6288d3f0f, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:27.109229 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137993f-1875-44f6-92b9-735bdb2f7b2c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:27.132020 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1114/2255] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:58:27 2022] PUT /identity/v3/projects/0292f4f92b704c0b9787102348f088de/users/942fc2477482463991d6d3a6288d3f0f/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:27.136374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd68ff2-82d3-434a-b25c-ad3211f465ac admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:27.146872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd68ff2-82d3-434a-b25c-ad3211f465ac admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:27.150568 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:27.181215 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0c916-b33e-46c9-968b-d908a4b5a2ec None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:27.181963 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0c916-b33e-46c9-968b-d908a4b5a2ec None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:27.182244 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0c916-b33e-46c9-968b-d908a4b5a2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:27.202552 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-eed0c916-b33e-46c9-968b-d908a4b5a2ec None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:27.203856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-eed0c916-b33e-46c9-968b-d908a4b5a2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:27.211436 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a2217-292e-41e3-8bed-086aceb98bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:27.211923 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a2217-292e-41e3-8bed-086aceb98bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:27.212304 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a2217-292e-41e3-8bed-086aceb98bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:27.212682 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a2217-292e-41e3-8bed-086aceb98bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:27.213476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a2217-292e-41e3-8bed-086aceb98bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:27.215205 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a2217-292e-41e3-8bed-086aceb98bb4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:27.229805 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1142/2256] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:58:27.230819 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a2217-292e-41e3-8bed-086aceb98bb4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:27.242239 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a2217-292e-41e3-8bed-086aceb98bb4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:27.249047 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bd0d2-7c8d-41de-98e9-0b725b98e276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:27.249739 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bd0d2-7c8d-41de-98e9-0b725b98e276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:27.250031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bd0d2-7c8d-41de-98e9-0b725b98e276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:27.250315 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bd0d2-7c8d-41de-98e9-0b725b98e276 admin admin] PATH_INFO: `/v3/projects/0292f4f92b704c0b9787102348f088de/users/942fc2477482463991d6d3a6288d3f0f/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:27.252308 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bd0d2-7c8d-41de-98e9-0b725b98e276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0292f4f92b704c0b9787102348f088de, user_id=942fc2477482463991d6d3a6288d3f0f, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:27.255684 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bd0d2-7c8d-41de-98e9-0b725b98e276 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:27.270984 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1143/2257] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:58:27 2022] PUT /identity/v3/projects/0292f4f92b704c0b9787102348f088de/users/942fc2477482463991d6d3a6288d3f0f/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:58:27.281644 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15453dc-f83c-40be-a1a2-e55dc120030c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:27.281931 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15453dc-f83c-40be-a1a2-e55dc120030c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:27.282210 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15453dc-f83c-40be-a1a2-e55dc120030c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:27.301176 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1115/2258] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Oct 2 00:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:58:27.315735 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e15453dc-f83c-40be-a1a2-e55dc120030c None None] MFA Rules not processed for user `942fc2477482463991d6d3a6288d3f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:27.316993 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e15453dc-f83c-40be-a1a2-e55dc120030c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:27.362333 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0c916-b33e-46c9-968b-d908a4b5a2ec None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:27.363783 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-eed0c916-b33e-46c9-968b-d908a4b5a2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:27.445241 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1144/2259] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:27 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:27.459251 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15453dc-f83c-40be-a1a2-e55dc120030c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:27.460788 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e15453dc-f83c-40be-a1a2-e55dc120030c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:27.497671 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0c916-b33e-46c9-968b-d908a4b5a2ec None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:27.513051 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:27.533139 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15453dc-f83c-40be-a1a2-e55dc120030c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:27.536793 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc196436-5aa1-4c6b-80da-1e14fa7a9a02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:27.537442 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc196436-5aa1-4c6b-80da-1e14fa7a9a02 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:27.537726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc196436-5aa1-4c6b-80da-1e14fa7a9a02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:27.538004 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc196436-5aa1-4c6b-80da-1e14fa7a9a02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:27.548146 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc196436-5aa1-4c6b-80da-1e14fa7a9a02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:27.549844 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc196436-5aa1-4c6b-80da-1e14fa7a9a02 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:27.559834 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1145/2260] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:27 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:27.571669 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d3f6f-9fbb-4089-a8f0-f39b120911f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:27.572286 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d3f6f-9fbb-4089-a8f0-f39b120911f5 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:27.572561 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d3f6f-9fbb-4089-a8f0-f39b120911f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:27.572830 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d3f6f-9fbb-4089-a8f0-f39b120911f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:27.642444 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d3f6f-9fbb-4089-a8f0-f39b120911f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:27.644047 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d3f6f-9fbb-4089-a8f0-f39b120911f5 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:27.656618 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1116/2261] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:27.703060 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc196436-5aa1-4c6b-80da-1e14fa7a9a02 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:27.714150 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc196436-5aa1-4c6b-80da-1e14fa7a9a02 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:27.719567 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcf703-1ec5-4b9a-8bb3-ec74fc5ac9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:27.720341 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcf703-1ec5-4b9a-8bb3-ec74fc5ac9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:27.720625 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcf703-1ec5-4b9a-8bb3-ec74fc5ac9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:27.720905 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcf703-1ec5-4b9a-8bb3-ec74fc5ac9eb admin admin] PATH_INFO: `/v3/users/e620db835bac4a9f9f0807751f17c43b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:27.722096 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcf703-1ec5-4b9a-8bb3-ec74fc5ac9eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e620db835bac4a9f9f0807751f17c43b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:27.724005 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcf703-1ec5-4b9a-8bb3-ec74fc5ac9eb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:27.738081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:27.773482 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-78bcf703-1ec5-4b9a-8bb3-ec74fc5ac9eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e620db835bac4a9f9f0807751f17c43b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:27.774170 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-78bcf703-1ec5-4b9a-8bb3-ec74fc5ac9eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e620db835bac4a9f9f0807751f17c43b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:27.787389 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-78bcf703-1ec5-4b9a-8bb3-ec74fc5ac9eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e620db835bac4a9f9f0807751f17c43b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:27.795563 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-78bcf703-1ec5-4b9a-8bb3-ec74fc5ac9eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e620db835bac4a9f9f0807751f17c43b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:27.796267 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-78bcf703-1ec5-4b9a-8bb3-ec74fc5ac9eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e620db835bac4a9f9f0807751f17c43b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:27.811531 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1146/2262] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:58:27 2022] DELETE /identity/v3/users/e620db835bac4a9f9f0807751f17c43b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:27.816099 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013a680-3efd-4983-b46f-a011eb5c1f44 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:27.816446 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013a680-3efd-4983-b46f-a011eb5c1f44 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:27.816795 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013a680-3efd-4983-b46f-a011eb5c1f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:27.837829 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5013a680-3efd-4983-b46f-a011eb5c1f44 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:27.839032 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5013a680-3efd-4983-b46f-a011eb5c1f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:27.909515 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1117/2263] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:58:27.916211 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcf703-1ec5-4b9a-8bb3-ec74fc5ac9eb admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:27.922373 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-78bcf703-1ec5-4b9a-8bb3-ec74fc5ac9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:27.994996 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcf703-1ec5-4b9a-8bb3-ec74fc5ac9eb admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:28.000663 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d43b5-6500-4497-ac74-c75e87e91e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:28.001334 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d43b5-6500-4497-ac74-c75e87e91e50 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:28.001610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d43b5-6500-4497-ac74-c75e87e91e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:28.001878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d43b5-6500-4497-ac74-c75e87e91e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:28.011881 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d43b5-6500-4497-ac74-c75e87e91e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:28.013990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d43b5-6500-4497-ac74-c75e87e91e50 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:28.024802 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1147/2264] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:28.468092 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013a680-3efd-4983-b46f-a011eb5c1f44 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:28.470814 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5013a680-3efd-4983-b46f-a011eb5c1f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:28.487069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013a680-3efd-4983-b46f-a011eb5c1f44 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:28.492299 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd1f0d-8834-48dc-a38b-a4f710ea6910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:28.494415 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd1f0d-8834-48dc-a38b-a4f710ea6910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:28.494415 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd1f0d-8834-48dc-a38b-a4f710ea6910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:28.494684 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd1f0d-8834-48dc-a38b-a4f710ea6910 admin admin] PATH_INFO: `/v3/projects/5ee6dd6553cc44119372aa90d736bea2` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:28.497152 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd1f0d-8834-48dc-a38b-a4f710ea6910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee6dd6553cc44119372aa90d736bea2)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:28.499791 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd1f0d-8834-48dc-a38b-a4f710ea6910 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:28.567964 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:28.570672 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-35fd1f0d-8834-48dc-a38b-a4f710ea6910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee6dd6553cc44119372aa90d736bea2', 'request_id': 'req-35fd1f0d-8834-48dc-a38b-a4f710ea6910'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:28.582927 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-35fd1f0d-8834-48dc-a38b-a4f710ea6910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee6dd6553cc44119372aa90d736bea2', 'request_id': 'req-35fd1f0d-8834-48dc-a38b-a4f710ea6910'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:28.595576 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-35fd1f0d-8834-48dc-a38b-a4f710ea6910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee6dd6553cc44119372aa90d736bea2', 'request_id': 'req-35fd1f0d-8834-48dc-a38b-a4f710ea6910'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:28.611944 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-35fd1f0d-8834-48dc-a38b-a4f710ea6910 admin admin] The token cache is being invalidate because project 5ee6dd6553cc44119372aa90d736bea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:58:28.612262 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-35fd1f0d-8834-48dc-a38b-a4f710ea6910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:28.612977 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-35fd1f0d-8834-48dc-a38b-a4f710ea6910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:28.614835 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1118/2265] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:58:28 2022] DELETE /identity/v3/projects/5ee6dd6553cc44119372aa90d736bea2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:28.619441 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d43b5-6500-4497-ac74-c75e87e91e50 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:28.631215 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d43b5-6500-4497-ac74-c75e87e91e50 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:28.711723 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1edf66-8df1-42a1-9c81-cd69b275e823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:28.712333 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1edf66-8df1-42a1-9c81-cd69b275e823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:28.712542 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1edf66-8df1-42a1-9c81-cd69b275e823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:28.712810 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1edf66-8df1-42a1-9c81-cd69b275e823 admin admin] PATH_INFO: `/v3/users/942fc2477482463991d6d3a6288d3f0f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:28.713962 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1edf66-8df1-42a1-9c81-cd69b275e823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=942fc2477482463991d6d3a6288d3f0f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:28.715859 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1edf66-8df1-42a1-9c81-cd69b275e823 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:28.758938 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:28.770536 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9c1edf66-8df1-42a1-9c81-cd69b275e823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '942fc2477482463991d6d3a6288d3f0f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:28.772381 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9c1edf66-8df1-42a1-9c81-cd69b275e823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '942fc2477482463991d6d3a6288d3f0f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:28.786660 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9c1edf66-8df1-42a1-9c81-cd69b275e823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '942fc2477482463991d6d3a6288d3f0f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:28.794292 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9c1edf66-8df1-42a1-9c81-cd69b275e823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '942fc2477482463991d6d3a6288d3f0f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:28.795540 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9c1edf66-8df1-42a1-9c81-cd69b275e823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '942fc2477482463991d6d3a6288d3f0f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:28.811756 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1148/2266] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:58:28 2022] DELETE /identity/v3/users/942fc2477482463991d6d3a6288d3f0f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:58:29.175370 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd1f0d-8834-48dc-a38b-a4f710ea6910 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:29.177540 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-35fd1f0d-8834-48dc-a38b-a4f710ea6910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:29.197463 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd1f0d-8834-48dc-a38b-a4f710ea6910 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:29.269590 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72428b5b-cd24-4d0d-b3e7-187ded4eca90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:29.270312 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72428b5b-cd24-4d0d-b3e7-187ded4eca90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:29.270772 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72428b5b-cd24-4d0d-b3e7-187ded4eca90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:29.270970 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72428b5b-cd24-4d0d-b3e7-187ded4eca90 admin admin] PATH_INFO: `/v3/projects/0292f4f92b704c0b9787102348f088de` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:29.272148 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72428b5b-cd24-4d0d-b3e7-187ded4eca90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0292f4f92b704c0b9787102348f088de)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:29.274250 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72428b5b-cd24-4d0d-b3e7-187ded4eca90 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:29.324904 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-72428b5b-cd24-4d0d-b3e7-187ded4eca90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0292f4f92b704c0b9787102348f088de', 'request_id': 'req-72428b5b-cd24-4d0d-b3e7-187ded4eca90'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:29.333196 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-72428b5b-cd24-4d0d-b3e7-187ded4eca90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0292f4f92b704c0b9787102348f088de', 'request_id': 'req-72428b5b-cd24-4d0d-b3e7-187ded4eca90'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:29.345850 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-72428b5b-cd24-4d0d-b3e7-187ded4eca90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0292f4f92b704c0b9787102348f088de', 'request_id': 'req-72428b5b-cd24-4d0d-b3e7-187ded4eca90'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:29.360081 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-72428b5b-cd24-4d0d-b3e7-187ded4eca90 admin admin] The token cache is being invalidate because project 0292f4f92b704c0b9787102348f088de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:58:29.360279 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-72428b5b-cd24-4d0d-b3e7-187ded4eca90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:29.360907 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-72428b5b-cd24-4d0d-b3e7-187ded4eca90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:29.362488 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1119/2267] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:58:29 2022] DELETE /identity/v3/projects/0292f4f92b704c0b9787102348f088de => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:29.367547 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8b707-5461-417a-a626-7a92d74b8994 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:29.367867 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8b707-5461-417a-a626-7a92d74b8994 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:29.368259 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8b707-5461-417a-a626-7a92d74b8994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:29.391187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4cd8b707-5461-417a-a626-7a92d74b8994 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:29.392394 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4cd8b707-5461-417a-a626-7a92d74b8994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:29.464142 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1149/2268] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:29.472490 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40af713-1918-4c72-9f2a-0ccebc64c871 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:29.472958 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40af713-1918-4c72-9f2a-0ccebc64c871 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:29.473047 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40af713-1918-4c72-9f2a-0ccebc64c871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:29.507383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e40af713-1918-4c72-9f2a-0ccebc64c871 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:29.508837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e40af713-1918-4c72-9f2a-0ccebc64c871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:29.519047 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1120/2269] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:29.525208 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8b707-5461-417a-a626-7a92d74b8994 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:29.535057 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8b707-5461-417a-a626-7a92d74b8994 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:29.540781 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aba1eb-0fbe-4247-9929-59794f30b3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:29.541673 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aba1eb-0fbe-4247-9929-59794f30b3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:29.542019 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aba1eb-0fbe-4247-9929-59794f30b3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:29.542500 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aba1eb-0fbe-4247-9929-59794f30b3e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:29.543268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aba1eb-0fbe-4247-9929-59794f30b3e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:58:29.543693 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aba1eb-0fbe-4247-9929-59794f30b3e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:29.545964 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aba1eb-0fbe-4247-9929-59794f30b3e9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:29.560087 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1150/2270] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:58:29.564442 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40af713-1918-4c72-9f2a-0ccebc64c871 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:29.573651 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40af713-1918-4c72-9f2a-0ccebc64c871 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:29.578470 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dfe05-9162-423f-b9da-31bf4631712c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:29.579063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dfe05-9162-423f-b9da-31bf4631712c admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:29.579337 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dfe05-9162-423f-b9da-31bf4631712c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:29.579604 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dfe05-9162-423f-b9da-31bf4631712c admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:29.580240 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892dfe05-9162-423f-b9da-31bf4631712c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:29.582387 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892dfe05-9162-423f-b9da-31bf4631712c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:29.616359 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1121/2271] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:58:29 2022] POST /identity/v3/projects => generated 361 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:58:29.620979 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aba1eb-0fbe-4247-9929-59794f30b3e9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:29.632199 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aba1eb-0fbe-4247-9929-59794f30b3e9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:29.698208 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eadcdc-12b2-4c90-9013-723bbfd9e546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:29.698567 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eadcdc-12b2-4c90-9013-723bbfd9e546 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:29.698846 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eadcdc-12b2-4c90-9013-723bbfd9e546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:29.699122 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eadcdc-12b2-4c90-9013-723bbfd9e546 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:29.699781 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eadcdc-12b2-4c90-9013-723bbfd9e546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:29.704168 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eadcdc-12b2-4c90-9013-723bbfd9e546 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:29.736374 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1151/2272] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:58:29 2022] POST /identity/v3/users => generated 281 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:58:29.740405 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dfe05-9162-423f-b9da-31bf4631712c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:29.752708 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dfe05-9162-423f-b9da-31bf4631712c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:29.758474 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08320df3-589d-4588-9a68-5aa2646e2188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:29.759078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08320df3-589d-4588-9a68-5aa2646e2188 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:29.759355 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08320df3-589d-4588-9a68-5aa2646e2188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:29.759625 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08320df3-589d-4588-9a68-5aa2646e2188 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:29.760270 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08320df3-589d-4588-9a68-5aa2646e2188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:29.761891 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08320df3-589d-4588-9a68-5aa2646e2188 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:29.774366 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1122/2273] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:58:29.779350 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eadcdc-12b2-4c90-9013-723bbfd9e546 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:29.790190 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eadcdc-12b2-4c90-9013-723bbfd9e546 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:29.797012 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d06742-1a21-4ad9-b441-45e8257cebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:29.797672 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d06742-1a21-4ad9-b441-45e8257cebd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:29.797954 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d06742-1a21-4ad9-b441-45e8257cebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:29.798327 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d06742-1a21-4ad9-b441-45e8257cebd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:29.799014 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d06742-1a21-4ad9-b441-45e8257cebd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:29.800641 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d06742-1a21-4ad9-b441-45e8257cebd3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:29.815438 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1152/2274] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:58:29.816695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08320df3-589d-4588-9a68-5aa2646e2188 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:29.829289 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08320df3-589d-4588-9a68-5aa2646e2188 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:29.835902 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff4331-8210-465a-b481-1bedc8536e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:29.836693 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff4331-8210-465a-b481-1bedc8536e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:29.837151 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff4331-8210-465a-b481-1bedc8536e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:29.837292 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff4331-8210-465a-b481-1bedc8536e27 admin admin] PATH_INFO: `/v3/projects/3f736e563a8d4f03b253d25aecde394e/users/b2a402b0611847e09a7f6b1b552e1f61/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:29.861374 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff4331-8210-465a-b481-1bedc8536e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f736e563a8d4f03b253d25aecde394e, user_id=b2a402b0611847e09a7f6b1b552e1f61, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:29.864090 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff4331-8210-465a-b481-1bedc8536e27 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:29.874062 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:29.879380 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1123/2275] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:58:29 2022] PUT /identity/v3/projects/3f736e563a8d4f03b253d25aecde394e/users/b2a402b0611847e09a7f6b1b552e1f61/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:29.890095 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec56ab5-6715-41d0-9e85-a5581502f916 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:29.890414 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec56ab5-6715-41d0-9e85-a5581502f916 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:29.890697 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec56ab5-6715-41d0-9e85-a5581502f916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:29.919994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5ec56ab5-6715-41d0-9e85-a5581502f916 None None] MFA Rules not processed for user `b2a402b0611847e09a7f6b1b552e1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:29.921351 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5ec56ab5-6715-41d0-9e85-a5581502f916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:29.926466 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:29.999375 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1153/2276] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:30.036218 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff4331-8210-465a-b481-1bedc8536e27 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:30.038042 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d3ff4331-8210-465a-b481-1bedc8536e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:30.100890 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff4331-8210-465a-b481-1bedc8536e27 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:30.107881 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa149f02-5071-4031-a63e-0e65a3989398 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:30.108691 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa149f02-5071-4031-a63e-0e65a3989398 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:30.108995 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa149f02-5071-4031-a63e-0e65a3989398 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:30.109344 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa149f02-5071-4031-a63e-0e65a3989398 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:30.119152 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa149f02-5071-4031-a63e-0e65a3989398 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:30.120626 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa149f02-5071-4031-a63e-0e65a3989398 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:30.130411 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1124/2277] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:30.146377 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec56ab5-6715-41d0-9e85-a5581502f916 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:30.217323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec56ab5-6715-41d0-9e85-a5581502f916 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:30.222583 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cdc61-531b-45ea-8476-6d75114f7730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:30.223251 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cdc61-531b-45ea-8476-6d75114f7730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:30.223532 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cdc61-531b-45ea-8476-6d75114f7730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:30.223805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cdc61-531b-45ea-8476-6d75114f7730 admin admin] PATH_INFO: `/v3/users/b2a402b0611847e09a7f6b1b552e1f61` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:30.224983 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cdc61-531b-45ea-8476-6d75114f7730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2a402b0611847e09a7f6b1b552e1f61)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:30.226913 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cdc61-531b-45ea-8476-6d75114f7730 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:30.281141 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d63cdc61-531b-45ea-8476-6d75114f7730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2a402b0611847e09a7f6b1b552e1f61'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:30.281779 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d63cdc61-531b-45ea-8476-6d75114f7730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2a402b0611847e09a7f6b1b552e1f61'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:30.296336 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d63cdc61-531b-45ea-8476-6d75114f7730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2a402b0611847e09a7f6b1b552e1f61'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:30.304186 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d63cdc61-531b-45ea-8476-6d75114f7730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2a402b0611847e09a7f6b1b552e1f61'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:30.304916 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d63cdc61-531b-45ea-8476-6d75114f7730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2a402b0611847e09a7f6b1b552e1f61'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:30.318630 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1154/2278] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:58:30 2022] DELETE /identity/v3/users/b2a402b0611847e09a7f6b1b552e1f61 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:58:30.324732 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dc034-29ad-42c8-91a7-6ee7150cab2e None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:30.325055 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dc034-29ad-42c8-91a7-6ee7150cab2e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:30.325336 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dc034-29ad-42c8-91a7-6ee7150cab2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:30.347568 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-910dc034-29ad-42c8-91a7-6ee7150cab2e None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:30.348786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-910dc034-29ad-42c8-91a7-6ee7150cab2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:30.426860 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1125/2279] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:58:30.436962 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cdc61-531b-45ea-8476-6d75114f7730 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:30.438425 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d63cdc61-531b-45ea-8476-6d75114f7730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:30.470687 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:30.500896 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cdc61-531b-45ea-8476-6d75114f7730 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:30.504712 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c874849-3a64-4364-a547-87f660a57d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:30.505454 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c874849-3a64-4364-a547-87f660a57d9f service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:30.505886 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c874849-3a64-4364-a547-87f660a57d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:30.506152 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c874849-3a64-4364-a547-87f660a57d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:30.521529 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c874849-3a64-4364-a547-87f660a57d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:30.523049 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c874849-3a64-4364-a547-87f660a57d9f service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:30.534182 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1155/2280] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:30.843169 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dc034-29ad-42c8-91a7-6ee7150cab2e None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:30.845209 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-910dc034-29ad-42c8-91a7-6ee7150cab2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:30.870185 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dc034-29ad-42c8-91a7-6ee7150cab2e None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:30.884804 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ea1fd-5486-4370-b099-8f97ee3d083d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:30.885488 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ea1fd-5486-4370-b099-8f97ee3d083d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:30.885764 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ea1fd-5486-4370-b099-8f97ee3d083d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:30.886034 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ea1fd-5486-4370-b099-8f97ee3d083d admin admin] PATH_INFO: `/v3/projects/3f736e563a8d4f03b253d25aecde394e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:30.887625 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ea1fd-5486-4370-b099-8f97ee3d083d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f736e563a8d4f03b253d25aecde394e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:30.892585 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ea1fd-5486-4370-b099-8f97ee3d083d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:30.966612 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e75ea1fd-5486-4370-b099-8f97ee3d083d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f736e563a8d4f03b253d25aecde394e', 'request_id': 'req-e75ea1fd-5486-4370-b099-8f97ee3d083d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:30.973423 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e75ea1fd-5486-4370-b099-8f97ee3d083d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f736e563a8d4f03b253d25aecde394e', 'request_id': 'req-e75ea1fd-5486-4370-b099-8f97ee3d083d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:30.982683 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e75ea1fd-5486-4370-b099-8f97ee3d083d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f736e563a8d4f03b253d25aecde394e', 'request_id': 'req-e75ea1fd-5486-4370-b099-8f97ee3d083d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:30.994041 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e75ea1fd-5486-4370-b099-8f97ee3d083d admin admin] The token cache is being invalidate because project 3f736e563a8d4f03b253d25aecde394e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:58:30.994334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e75ea1fd-5486-4370-b099-8f97ee3d083d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:30.995001 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e75ea1fd-5486-4370-b099-8f97ee3d083d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:30.996742 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1126/2281] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:58:30 2022] DELETE /identity/v3/projects/3f736e563a8d4f03b253d25aecde394e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:31.002412 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00b56f-1c56-449b-bade-f3b894bb56a2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:31.002998 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00b56f-1c56-449b-bade-f3b894bb56a2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:31.003151 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00b56f-1c56-449b-bade-f3b894bb56a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:31.028198 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-fe00b56f-1c56-449b-bade-f3b894bb56a2 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:31.030025 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fe00b56f-1c56-449b-bade-f3b894bb56a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:31.099020 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1156/2282] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:31.108501 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03769c-1be8-42f9-8e73-17ce18df1c51 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:31.108866 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03769c-1be8-42f9-8e73-17ce18df1c51 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:31.109234 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03769c-1be8-42f9-8e73-17ce18df1c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:31.131821 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-df03769c-1be8-42f9-8e73-17ce18df1c51 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:31.133201 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-df03769c-1be8-42f9-8e73-17ce18df1c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:31.141705 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1127/2283] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:31.146182 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00b56f-1c56-449b-bade-f3b894bb56a2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:31.157042 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00b56f-1c56-449b-bade-f3b894bb56a2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:31.166319 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31333d-a949-4075-893d-aff261ef4ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:31.166975 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31333d-a949-4075-893d-aff261ef4ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:31.167256 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31333d-a949-4075-893d-aff261ef4ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:31.167530 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31333d-a949-4075-893d-aff261ef4ec6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:31.168228 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31333d-a949-4075-893d-aff261ef4ec6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:58:31.168532 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31333d-a949-4075-893d-aff261ef4ec6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:31.171002 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31333d-a949-4075-893d-aff261ef4ec6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:31.187133 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1157/2284] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:58:31.188222 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03769c-1be8-42f9-8e73-17ce18df1c51 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:31.197594 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03769c-1be8-42f9-8e73-17ce18df1c51 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:31.202808 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ea0b0-f30f-44a6-a6dd-ae217be8137e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:31.203410 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ea0b0-f30f-44a6-a6dd-ae217be8137e admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:31.203693 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ea0b0-f30f-44a6-a6dd-ae217be8137e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:31.203964 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ea0b0-f30f-44a6-a6dd-ae217be8137e admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:31.204599 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ea0b0-f30f-44a6-a6dd-ae217be8137e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:31.206598 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ea0b0-f30f-44a6-a6dd-ae217be8137e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:31.236517 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:31.248305 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1128/2285] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:58:31 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:58:31.252275 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31333d-a949-4075-893d-aff261ef4ec6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:31.264025 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31333d-a949-4075-893d-aff261ef4ec6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:31.333709 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a121c9d-0137-4310-aa60-b0d28ceb1d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:31.334237 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a121c9d-0137-4310-aa60-b0d28ceb1d36 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:31.334513 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a121c9d-0137-4310-aa60-b0d28ceb1d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:31.334785 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a121c9d-0137-4310-aa60-b0d28ceb1d36 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:31.335410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a121c9d-0137-4310-aa60-b0d28ceb1d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:31.337359 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a121c9d-0137-4310-aa60-b0d28ceb1d36 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:31.367495 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1158/2286] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:58:31 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:58:31.371885 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ea0b0-f30f-44a6-a6dd-ae217be8137e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:31.383694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ea0b0-f30f-44a6-a6dd-ae217be8137e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:31.389522 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd7f72-8171-413c-b101-959d0be73a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:31.390228 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd7f72-8171-413c-b101-959d0be73a99 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:31.390570 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd7f72-8171-413c-b101-959d0be73a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:31.390911 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd7f72-8171-413c-b101-959d0be73a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:31.391787 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd7f72-8171-413c-b101-959d0be73a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:31.393546 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd7f72-8171-413c-b101-959d0be73a99 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:31.405611 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1129/2287] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 00:58:31.409636 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a121c9d-0137-4310-aa60-b0d28ceb1d36 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:31.421454 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a121c9d-0137-4310-aa60-b0d28ceb1d36 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:31.425659 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb3bab-d559-4dcf-9cba-dd90c8beb65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:31.426450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb3bab-d559-4dcf-9cba-dd90c8beb65b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:31.426709 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb3bab-d559-4dcf-9cba-dd90c8beb65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:31.427224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb3bab-d559-4dcf-9cba-dd90c8beb65b admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:31.427993 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb3bab-d559-4dcf-9cba-dd90c8beb65b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:31.429658 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb3bab-d559-4dcf-9cba-dd90c8beb65b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:31.443867 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1159/2288] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 00:58:31.450337 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd7f72-8171-413c-b101-959d0be73a99 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:31.461708 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd7f72-8171-413c-b101-959d0be73a99 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:31.473608 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a08193-5926-4c79-9a69-c8b57fd97674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:31.474406 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a08193-5926-4c79-9a69-c8b57fd97674 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:31.474799 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a08193-5926-4c79-9a69-c8b57fd97674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:31.475163 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a08193-5926-4c79-9a69-c8b57fd97674 admin admin] PATH_INFO: `/v3/projects/886127b1d28e4eccbe1946a232a7975d/users/7458b6120d0a47de905b7fe604e5a35a/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:31.492483 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a08193-5926-4c79-9a69-c8b57fd97674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=886127b1d28e4eccbe1946a232a7975d, user_id=7458b6120d0a47de905b7fe604e5a35a, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:31.495511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a08193-5926-4c79-9a69-c8b57fd97674 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:31.510089 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1130/2289] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:58:31 2022] PUT /identity/v3/projects/886127b1d28e4eccbe1946a232a7975d/users/7458b6120d0a47de905b7fe604e5a35a/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:58:31.522166 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f733d-1e83-4f71-8c7c-c53945bf3a8b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:31.522594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f733d-1e83-4f71-8c7c-c53945bf3a8b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:31.522965 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f733d-1e83-4f71-8c7c-c53945bf3a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:31.556514 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1f8f733d-1e83-4f71-8c7c-c53945bf3a8b None None] MFA Rules not processed for user `7458b6120d0a47de905b7fe604e5a35a`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:31.557801 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1f8f733d-1e83-4f71-8c7c-c53945bf3a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:31.587489 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:31.632352 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1160/2290] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:31.645301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a08193-5926-4c79-9a69-c8b57fd97674 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:31.647250 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b0a08193-5926-4c79-9a69-c8b57fd97674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:31.705903 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a08193-5926-4c79-9a69-c8b57fd97674 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:31.709598 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6deb9a-49c6-4c7f-ba86-f3828ac646ec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2920ad41c61b401299ca5ae1714b4031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:31.710203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6deb9a-49c6-4c7f-ba86-f3828ac646ec service glance] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:31.710485 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6deb9a-49c6-4c7f-ba86-f3828ac646ec service glance] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:31.710757 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6deb9a-49c6-4c7f-ba86-f3828ac646ec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:31.719635 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6deb9a-49c6-4c7f-ba86-f3828ac646ec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:31.721111 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6deb9a-49c6-4c7f-ba86-f3828ac646ec service glance] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:31.730050 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1131/2291] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:34.381093 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a12e6-4f66-47a5-904e-70bda52aaa73 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:34.381582 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a12e6-4f66-47a5-904e-70bda52aaa73 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:34.381678 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a12e6-4f66-47a5-904e-70bda52aaa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:34.405897 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d38a12e6-4f66-47a5-904e-70bda52aaa73 None None] MFA Rules not processed for user `5ff136440ace420997181fbf11999496`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:34.407128 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d38a12e6-4f66-47a5-904e-70bda52aaa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:34.498052 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1161/2292] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:34.512730 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd461ba5-280f-4bc1-b084-7d71b08a5cab None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:34.513270 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd461ba5-280f-4bc1-b084-7d71b08a5cab None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:34.513558 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd461ba5-280f-4bc1-b084-7d71b08a5cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:34.541246 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-bd461ba5-280f-4bc1-b084-7d71b08a5cab None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:34.542570 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-bd461ba5-280f-4bc1-b084-7d71b08a5cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:34.611945 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1132/2293] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Oct 2 00:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:34.789938 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a12e6-4f66-47a5-904e-70bda52aaa73 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:34.791423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d38a12e6-4f66-47a5-904e-70bda52aaa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:34.872261 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a12e6-4f66-47a5-904e-70bda52aaa73 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:34.878288 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abf827-d7a9-4807-b698-c544e7541e2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:34.878898 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abf827-d7a9-4807-b698-c544e7541e2b service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:34.879225 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abf827-d7a9-4807-b698-c544e7541e2b service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:34.879453 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abf827-d7a9-4807-b698-c544e7541e2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:34.889060 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abf827-d7a9-4807-b698-c544e7541e2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:34.890650 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abf827-d7a9-4807-b698-c544e7541e2b service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:34.900281 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1162/2294] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:37.642566 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce580c-db6e-4ad9-bfa4-f72767160c4b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:37.642566 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce580c-db6e-4ad9-bfa4-f72767160c4b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:37.642566 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce580c-db6e-4ad9-bfa4-f72767160c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:37.664991 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-64ce580c-db6e-4ad9-bfa4-f72767160c4b None None] MFA Rules not processed for user `42dcae7ba3c241eb8d7d0894aadb467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:37.666129 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-64ce580c-db6e-4ad9-bfa4-f72767160c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:37.736330 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1133/2295] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Oct 2 00:58:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:37.787425 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abf827-d7a9-4807-b698-c544e7541e2b service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:37.789354 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-27abf827-d7a9-4807-b698-c544e7541e2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:37.854686 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:37.874568 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abf827-d7a9-4807-b698-c544e7541e2b service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:37.883622 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38958c92-5d5b-423b-8c86-ed425208bc78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784579d2ddf4cc99fe0e1d109e5cdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:37.884253 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38958c92-5d5b-423b-8c86-ed425208bc78 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:37.884673 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38958c92-5d5b-423b-8c86-ed425208bc78 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:37.884851 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38958c92-5d5b-423b-8c86-ed425208bc78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:37.894696 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38958c92-5d5b-423b-8c86-ed425208bc78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:37.896357 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38958c92-5d5b-423b-8c86-ed425208bc78 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:37.906315 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1163/2296] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Oct 2 00:58:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 00:58:38.792853 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fa5fe-8623-4eaf-a940-f48b66bca7e7 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:38.793462 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fa5fe-8623-4eaf-a940-f48b66bca7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:38.793462 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fa5fe-8623-4eaf-a940-f48b66bca7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:38.842534 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-356fa5fe-8623-4eaf-a940-f48b66bca7e7 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:38.843879 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-356fa5fe-8623-4eaf-a940-f48b66bca7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:38.854551 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1134/2297] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Oct 2 00:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:38.926617 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38958c92-5d5b-423b-8c86-ed425208bc78 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:38.947492 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38958c92-5d5b-423b-8c86-ed425208bc78 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:38.956062 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd852a13-92df-43a0-a6ff-2c85519b3e2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:38.961247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd852a13-92df-43a0-a6ff-2c85519b3e2c service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:38.961526 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd852a13-92df-43a0-a6ff-2c85519b3e2c service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:38.961797 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd852a13-92df-43a0-a6ff-2c85519b3e2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:38.974717 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd852a13-92df-43a0-a6ff-2c85519b3e2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:38.976326 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd852a13-92df-43a0-a6ff-2c85519b3e2c service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:38.989259 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1164/2298] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:48.818264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:48.983187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=13 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:50.083699 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9e6c2-1df8-417b-b1ae-c4b5290cef07 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:50.084314 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9e6c2-1df8-417b-b1ae-c4b5290cef07 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:50.084314 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9e6c2-1df8-417b-b1ae-c4b5290cef07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:50.104477 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-98a9e6c2-1df8-417b-b1ae-c4b5290cef07 None None] MFA Rules not processed for user `42dcae7ba3c241eb8d7d0894aadb467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:50.105826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-98a9e6c2-1df8-417b-b1ae-c4b5290cef07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:50.113220 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1135/2299] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Oct 2 00:58:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:50.126997 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd852a13-92df-43a0-a6ff-2c85519b3e2c service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:50.140053 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd852a13-92df-43a0-a6ff-2c85519b3e2c service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:50.146039 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407a3b8-8495-41ef-8ee8-4b920d506e2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784579d2ddf4cc99fe0e1d109e5cdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:50.146949 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407a3b8-8495-41ef-8ee8-4b920d506e2b service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:50.147236 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407a3b8-8495-41ef-8ee8-4b920d506e2b service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:50.147497 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407a3b8-8495-41ef-8ee8-4b920d506e2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:50.157267 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407a3b8-8495-41ef-8ee8-4b920d506e2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:50.158916 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407a3b8-8495-41ef-8ee8-4b920d506e2b service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:50.167673 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1165/2300] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Oct 2 00:58:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 00:58:56.403133 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9e6c2-1df8-417b-b1ae-c4b5290cef07 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:56.404641 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-98a9e6c2-1df8-417b-b1ae-c4b5290cef07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:56.419608 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9e6c2-1df8-417b-b1ae-c4b5290cef07 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:56.426533 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ed8df-e7ba-40b3-9380-0e7f68bdf02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:56.427185 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ed8df-e7ba-40b3-9380-0e7f68bdf02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:56.427467 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ed8df-e7ba-40b3-9380-0e7f68bdf02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:56.427743 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ed8df-e7ba-40b3-9380-0e7f68bdf02e admin admin] PATH_INFO: `/v3/users/afe52fa0ef4240d5beae29fdab4d5615` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:56.428999 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ed8df-e7ba-40b3-9380-0e7f68bdf02e admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe52fa0ef4240d5beae29fdab4d5615)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:56.430947 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ed8df-e7ba-40b3-9380-0e7f68bdf02e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:56.489184 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b86ed8df-e7ba-40b3-9380-0e7f68bdf02e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe52fa0ef4240d5beae29fdab4d5615'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:56.490207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b86ed8df-e7ba-40b3-9380-0e7f68bdf02e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe52fa0ef4240d5beae29fdab4d5615'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:56.502714 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b86ed8df-e7ba-40b3-9380-0e7f68bdf02e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe52fa0ef4240d5beae29fdab4d5615'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:56.503261 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b86ed8df-e7ba-40b3-9380-0e7f68bdf02e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe52fa0ef4240d5beae29fdab4d5615'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:56.515328 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b86ed8df-e7ba-40b3-9380-0e7f68bdf02e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe52fa0ef4240d5beae29fdab4d5615'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:56.536047 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1136/2301] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:58:56 2022] DELETE /identity/v3/users/afe52fa0ef4240d5beae29fdab4d5615 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:56.541627 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ca579-4e9c-489e-9ac5-08df548f5b2e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:56.542156 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ca579-4e9c-489e-9ac5-08df548f5b2e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:56.542156 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ca579-4e9c-489e-9ac5-08df548f5b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:56.563679 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c40ca579-4e9c-489e-9ac5-08df548f5b2e None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:56.565415 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c40ca579-4e9c-489e-9ac5-08df548f5b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:56.644823 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1166/2302] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:56.655598 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ed8df-e7ba-40b3-9380-0e7f68bdf02e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:56.657120 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b86ed8df-e7ba-40b3-9380-0e7f68bdf02e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:56.748977 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ed8df-e7ba-40b3-9380-0e7f68bdf02e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:56.756778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924b1b1-b95b-482d-96e6-1b2924a562ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:56.759537 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924b1b1-b95b-482d-96e6-1b2924a562ac service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:56.760255 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924b1b1-b95b-482d-96e6-1b2924a562ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:56.761144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924b1b1-b95b-482d-96e6-1b2924a562ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:56.794089 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924b1b1-b95b-482d-96e6-1b2924a562ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:56.798824 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924b1b1-b95b-482d-96e6-1b2924a562ac service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:56.835260 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1137/2303] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:57.382596 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ca579-4e9c-489e-9ac5-08df548f5b2e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:57.384476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c40ca579-4e9c-489e-9ac5-08df548f5b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:57.428288 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ca579-4e9c-489e-9ac5-08df548f5b2e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:57.435749 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c836b6f-95ac-4205-9939-84c13d745059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:57.436562 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c836b6f-95ac-4205-9939-84c13d745059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:57.436844 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c836b6f-95ac-4205-9939-84c13d745059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:57.437223 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c836b6f-95ac-4205-9939-84c13d745059 admin admin] PATH_INFO: `/v3/projects/8296510529f6454ca56e4548bdad725d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:57.438930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c836b6f-95ac-4205-9939-84c13d745059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8296510529f6454ca56e4548bdad725d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:57.446845 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c836b6f-95ac-4205-9939-84c13d745059 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:57.561857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3c836b6f-95ac-4205-9939-84c13d745059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8296510529f6454ca56e4548bdad725d', 'request_id': 'req-3c836b6f-95ac-4205-9939-84c13d745059'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:57.570382 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3c836b6f-95ac-4205-9939-84c13d745059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8296510529f6454ca56e4548bdad725d', 'request_id': 'req-3c836b6f-95ac-4205-9939-84c13d745059'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:57.579365 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3c836b6f-95ac-4205-9939-84c13d745059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8296510529f6454ca56e4548bdad725d', 'request_id': 'req-3c836b6f-95ac-4205-9939-84c13d745059'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:57.608270 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3c836b6f-95ac-4205-9939-84c13d745059 admin admin] The token cache is being invalidate because project 8296510529f6454ca56e4548bdad725d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:58:57.608521 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3c836b6f-95ac-4205-9939-84c13d745059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:57.610053 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3c836b6f-95ac-4205-9939-84c13d745059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:58:57.612060 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1167/2304] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:58:57 2022] DELETE /identity/v3/projects/8296510529f6454ca56e4548bdad725d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:58:57.617827 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45940835-b218-463f-9c4f-3c45b04034d4 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:57.618426 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45940835-b218-463f-9c4f-3c45b04034d4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:57.618426 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45940835-b218-463f-9c4f-3c45b04034d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:57.648898 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-45940835-b218-463f-9c4f-3c45b04034d4 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:57.650195 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-45940835-b218-463f-9c4f-3c45b04034d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:57.737899 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1138/2305] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:57.745604 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e0198-5b0f-48eb-9881-c5dac08adc7d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:57.745895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e0198-5b0f-48eb-9881-c5dac08adc7d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:57.746746 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e0198-5b0f-48eb-9881-c5dac08adc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:57.772142 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-477e0198-5b0f-48eb-9881-c5dac08adc7d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:57.773395 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-477e0198-5b0f-48eb-9881-c5dac08adc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:57.782941 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1168/2306] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:57.788117 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45940835-b218-463f-9c4f-3c45b04034d4 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:57.800631 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45940835-b218-463f-9c4f-3c45b04034d4 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:57.808293 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b312c-c71c-467a-b14c-630fe8c9d147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:57.810648 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b312c-c71c-467a-b14c-630fe8c9d147 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:57.811112 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b312c-c71c-467a-b14c-630fe8c9d147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:57.811542 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b312c-c71c-467a-b14c-630fe8c9d147 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:57.812386 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b312c-c71c-467a-b14c-630fe8c9d147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:58:57.812859 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b312c-c71c-467a-b14c-630fe8c9d147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:57.814774 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b312c-c71c-467a-b14c-630fe8c9d147 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:57.818310 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:57.879866 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e0198-5b0f-48eb-9881-c5dac08adc7d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:57.896644 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1139/2307] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:58:57.906588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e0198-5b0f-48eb-9881-c5dac08adc7d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:57.916478 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a716b21-3d70-47f8-bebb-503d2d6632ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:57.917665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a716b21-3d70-47f8-bebb-503d2d6632ce admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:57.919169 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a716b21-3d70-47f8-bebb-503d2d6632ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:57.919904 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a716b21-3d70-47f8-bebb-503d2d6632ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:57.920787 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a716b21-3d70-47f8-bebb-503d2d6632ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:57.925142 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a716b21-3d70-47f8-bebb-503d2d6632ce admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:57.990264 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1169/2308] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:58:57 2022] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:58:57.995740 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b312c-c71c-467a-b14c-630fe8c9d147 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:58.018948 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b312c-c71c-467a-b14c-630fe8c9d147 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:58.187417 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde408c-f694-4b5b-a593-619ceba92722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:58.188044 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde408c-f694-4b5b-a593-619ceba92722 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:58.188325 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde408c-f694-4b5b-a593-619ceba92722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:58.188592 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde408c-f694-4b5b-a593-619ceba92722 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:58.189275 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde408c-f694-4b5b-a593-619ceba92722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:58.191458 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde408c-f694-4b5b-a593-619ceba92722 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:58.222333 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1140/2309] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:58:57 2022] POST /identity/v3/users => generated 296 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:58:58.223670 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a716b21-3d70-47f8-bebb-503d2d6632ce admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:58.239950 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a716b21-3d70-47f8-bebb-503d2d6632ce admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:58.245708 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92b1a5-d660-461f-910e-b7be578aa291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:58.247375 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92b1a5-d660-461f-910e-b7be578aa291 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:58.248000 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92b1a5-d660-461f-910e-b7be578aa291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:58.248475 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92b1a5-d660-461f-910e-b7be578aa291 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:58.249411 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92b1a5-d660-461f-910e-b7be578aa291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:58.251250 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92b1a5-d660-461f-910e-b7be578aa291 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:58.263564 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1170/2310] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 00:58:58.267965 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde408c-f694-4b5b-a593-619ceba92722 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:58.281501 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde408c-f694-4b5b-a593-619ceba92722 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:58.287534 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26957ac9-32ce-4b92-85cf-b29d26a87f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:58.288651 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26957ac9-32ce-4b92-85cf-b29d26a87f54 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:58.289173 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26957ac9-32ce-4b92-85cf-b29d26a87f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:58.290445 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26957ac9-32ce-4b92-85cf-b29d26a87f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:58.291320 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26957ac9-32ce-4b92-85cf-b29d26a87f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:58.300564 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26957ac9-32ce-4b92-85cf-b29d26a87f54 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:58.356990 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1141/2311] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:58:58.364611 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92b1a5-d660-461f-910e-b7be578aa291 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:58.378326 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92b1a5-d660-461f-910e-b7be578aa291 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:58.385542 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee2e8d-47a1-49ca-91d5-0a82454a3a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:58.386660 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee2e8d-47a1-49ca-91d5-0a82454a3a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:58.387310 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee2e8d-47a1-49ca-91d5-0a82454a3a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:58.387950 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee2e8d-47a1-49ca-91d5-0a82454a3a0a admin admin] PATH_INFO: `/v3/projects/051e5e468e564313a4f34edbc6828329/users/ca4ca1601fc14f6bb7239d51cac39c90/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:58.412829 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee2e8d-47a1-49ca-91d5-0a82454a3a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=051e5e468e564313a4f34edbc6828329, user_id=ca4ca1601fc14f6bb7239d51cac39c90, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:58.423730 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee2e8d-47a1-49ca-91d5-0a82454a3a0a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:58.497063 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1171/2312] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:58:58 2022] PUT /identity/v3/projects/051e5e468e564313a4f34edbc6828329/users/ca4ca1601fc14f6bb7239d51cac39c90/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:58:58.501130 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0530400-534f-4c8f-99b9-fb0e0845b965 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:58.501507 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0530400-534f-4c8f-99b9-fb0e0845b965 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:58.501853 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0530400-534f-4c8f-99b9-fb0e0845b965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:58.602355 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d0530400-534f-4c8f-99b9-fb0e0845b965 None None] MFA Rules not processed for user `ca4ca1601fc14f6bb7239d51cac39c90`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:58.603667 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d0530400-534f-4c8f-99b9-fb0e0845b965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:58.801851 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1142/2313] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:58:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:58.809535 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee2e8d-47a1-49ca-91d5-0a82454a3a0a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:58.812186 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5cee2e8d-47a1-49ca-91d5-0a82454a3a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:58.855028 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:58.992270 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee2e8d-47a1-49ca-91d5-0a82454a3a0a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:59.006657 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f0f26-268c-4d5d-810d-0d1469c55400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:59.009036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f0f26-268c-4d5d-810d-0d1469c55400 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:59.011077 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f0f26-268c-4d5d-810d-0d1469c55400 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:59.011407 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f0f26-268c-4d5d-810d-0d1469c55400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:59.031055 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f0f26-268c-4d5d-810d-0d1469c55400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:59.032342 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f0f26-268c-4d5d-810d-0d1469c55400 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:59.066406 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1172/2314] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:59:00.962956 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c83d07-88e7-4353-9846-386ebd48d96f None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:00.963890 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c83d07-88e7-4353-9846-386ebd48d96f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:00.964560 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c83d07-88e7-4353-9846-386ebd48d96f None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:00.968479 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1143/2315] 10.222.0.26 () {54 vars in 921 bytes} [Sun Oct 2 00:59:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:59:00.975338 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfdaa0-1e17-406b-b607-0afd90bed3fa None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:00.976142 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfdaa0-1e17-406b-b607-0afd90bed3fa None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:00.976142 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfdaa0-1e17-406b-b607-0afd90bed3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:01.053759 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-eccfdaa0-1e17-406b-b607-0afd90bed3fa None None] MFA Rules not processed for user `81e0396b7ba341ce8d02b1a149786d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:01.057476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-eccfdaa0-1e17-406b-b607-0afd90bed3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:01.271746 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1173/2316] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Oct 2 00:59:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:59:01.295797 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c83d07-88e7-4353-9846-386ebd48d96f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:01.297838 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-12c83d07-88e7-4353-9846-386ebd48d96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:01.378739 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c83d07-88e7-4353-9846-386ebd48d96f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:01.382604 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0edf8e-3907-4df4-9d19-7301897496ac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2920ad41c61b401299ca5ae1714b4031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:01.383271 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0edf8e-3907-4df4-9d19-7301897496ac service glance] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:01.383563 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0edf8e-3907-4df4-9d19-7301897496ac service glance] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:01.383841 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0edf8e-3907-4df4-9d19-7301897496ac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:01.395236 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0edf8e-3907-4df4-9d19-7301897496ac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:01.396688 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0edf8e-3907-4df4-9d19-7301897496ac service glance] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:01.408562 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1144/2317] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:59:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:59:01.490868 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bae4a-207b-4c09-b85e-31b7f558c06e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:01.491188 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bae4a-207b-4c09-b85e-31b7f558c06e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:01.491463 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bae4a-207b-4c09-b85e-31b7f558c06e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:01.492802 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1174/2318] 10.222.0.26 () {54 vars in 921 bytes} [Sun Oct 2 00:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:59:01.498826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b62054-5e4e-456e-b91d-aafdea6abbc3 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:01.499109 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b62054-5e4e-456e-b91d-aafdea6abbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:01.499400 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b62054-5e4e-456e-b91d-aafdea6abbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:01.513835 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:01.520030 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-29b62054-5e4e-456e-b91d-aafdea6abbc3 None None] MFA Rules not processed for user `5100db0c968c406fa89e117877604c50`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:01.521503 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-29b62054-5e4e-456e-b91d-aafdea6abbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:01.599537 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1145/2319] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Oct 2 00:59:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:01.614194 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bae4a-207b-4c09-b85e-31b7f558c06e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:01.616081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e77bae4a-207b-4c09-b85e-31b7f558c06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:01.632686 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bae4a-207b-4c09-b85e-31b7f558c06e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:01.638095 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0d70b-617a-4404-81ef-a13adf2cdd8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:01.639086 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0d70b-617a-4404-81ef-a13adf2cdd8e service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:01.639371 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0d70b-617a-4404-81ef-a13adf2cdd8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:01.639698 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0d70b-617a-4404-81ef-a13adf2cdd8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:01.649897 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0d70b-617a-4404-81ef-a13adf2cdd8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:01.651920 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0d70b-617a-4404-81ef-a13adf2cdd8e service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:01.670859 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1175/2320] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:59:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:59:01.811524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca91006-a166-4268-8ce0-a66e9f828c4d None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:01.811844 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca91006-a166-4268-8ce0-a66e9f828c4d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:01.812123 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca91006-a166-4268-8ce0-a66e9f828c4d None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:01.813824 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1146/2321] 10.222.0.26 () {54 vars in 921 bytes} [Sun Oct 2 00:59:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:59:01.836827 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ec3a4-bc4d-4f39-a9f2-318b3884a26d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:01.837410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ec3a4-bc4d-4f39-a9f2-318b3884a26d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:01.837694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ec3a4-bc4d-4f39-a9f2-318b3884a26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:01.872086 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bc1ec3a4-bc4d-4f39-a9f2-318b3884a26d None None] MFA Rules not processed for user `81e0396b7ba341ce8d02b1a149786d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:01.873862 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bc1ec3a4-bc4d-4f39-a9f2-318b3884a26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:01.886455 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1176/2322] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Oct 2 00:59:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:59:01.899644 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca91006-a166-4268-8ce0-a66e9f828c4d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:01.912212 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca91006-a166-4268-8ce0-a66e9f828c4d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:01.916982 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c2ea0-2394-4fc2-8da5-e0948456b0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:01.917582 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c2ea0-2394-4fc2-8da5-e0948456b0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:01.917890 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c2ea0-2394-4fc2-8da5-e0948456b0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:01.918203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c2ea0-2394-4fc2-8da5-e0948456b0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:01.931976 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c2ea0-2394-4fc2-8da5-e0948456b0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:01.934141 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c2ea0-2394-4fc2-8da5-e0948456b0e5 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:01.947947 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1147/2323] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:59:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:59:02.377217 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ec3a4-bc4d-4f39-a9f2-318b3884a26d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:02.382918 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bc1ec3a4-bc4d-4f39-a9f2-318b3884a26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:02.493240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ec3a4-bc4d-4f39-a9f2-318b3884a26d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:02.499109 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dde528-3666-477e-86db-e73205c3aa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:02.499796 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dde528-3666-477e-86db-e73205c3aa4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:02.500078 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dde528-3666-477e-86db-e73205c3aa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:02.500350 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dde528-3666-477e-86db-e73205c3aa4b admin admin] PATH_INFO: `/v3/users/7458b6120d0a47de905b7fe604e5a35a` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:02.501724 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dde528-3666-477e-86db-e73205c3aa4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7458b6120d0a47de905b7fe604e5a35a)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:02.503858 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dde528-3666-477e-86db-e73205c3aa4b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:02.539130 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:02.609541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-84dde528-3666-477e-86db-e73205c3aa4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7458b6120d0a47de905b7fe604e5a35a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:02.610313 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-84dde528-3666-477e-86db-e73205c3aa4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7458b6120d0a47de905b7fe604e5a35a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:02.649857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-84dde528-3666-477e-86db-e73205c3aa4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7458b6120d0a47de905b7fe604e5a35a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:02.660301 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-84dde528-3666-477e-86db-e73205c3aa4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7458b6120d0a47de905b7fe604e5a35a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:02.661052 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-84dde528-3666-477e-86db-e73205c3aa4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7458b6120d0a47de905b7fe604e5a35a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:02.694184 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1177/2324] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:59:02 2022] DELETE /identity/v3/users/7458b6120d0a47de905b7fe604e5a35a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:59:02.695464 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b86bf-a57d-41eb-bcdc-efeacc68ded5 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:02.696312 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b86bf-a57d-41eb-bcdc-efeacc68ded5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:02.696772 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b86bf-a57d-41eb-bcdc-efeacc68ded5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:02.747238 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-2b3b86bf-a57d-41eb-bcdc-efeacc68ded5 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:02.749102 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2b3b86bf-a57d-41eb-bcdc-efeacc68ded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:02.904486 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1148/2325] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:02.916490 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dde528-3666-477e-86db-e73205c3aa4b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:02.918492 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-84dde528-3666-477e-86db-e73205c3aa4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:03.096205 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dde528-3666-477e-86db-e73205c3aa4b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:03.100539 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa13da-972d-440c-b8c6-5d3772391fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:03.101179 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa13da-972d-440c-b8c6-5d3772391fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:03.101497 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa13da-972d-440c-b8c6-5d3772391fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:03.103303 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa13da-972d-440c-b8c6-5d3772391fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:03.125176 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa13da-972d-440c-b8c6-5d3772391fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:03.127042 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa13da-972d-440c-b8c6-5d3772391fb5 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:03.149320 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1178/2326] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:59:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:59:03.546002 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b86bf-a57d-41eb-bcdc-efeacc68ded5 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:03.547769 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2b3b86bf-a57d-41eb-bcdc-efeacc68ded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:03.567203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b86bf-a57d-41eb-bcdc-efeacc68ded5 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:03.579272 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f84e88-3b59-4acd-8484-85a8eafb42ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:03.580115 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f84e88-3b59-4acd-8484-85a8eafb42ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:03.580395 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f84e88-3b59-4acd-8484-85a8eafb42ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:03.580730 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f84e88-3b59-4acd-8484-85a8eafb42ed admin admin] PATH_INFO: `/v3/projects/886127b1d28e4eccbe1946a232a7975d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:03.582141 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f84e88-3b59-4acd-8484-85a8eafb42ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=886127b1d28e4eccbe1946a232a7975d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:03.585264 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f84e88-3b59-4acd-8484-85a8eafb42ed admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:03.701530 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-64f84e88-3b59-4acd-8484-85a8eafb42ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '886127b1d28e4eccbe1946a232a7975d', 'request_id': 'req-64f84e88-3b59-4acd-8484-85a8eafb42ed'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:03.715416 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-64f84e88-3b59-4acd-8484-85a8eafb42ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '886127b1d28e4eccbe1946a232a7975d', 'request_id': 'req-64f84e88-3b59-4acd-8484-85a8eafb42ed'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:03.738522 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-64f84e88-3b59-4acd-8484-85a8eafb42ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '886127b1d28e4eccbe1946a232a7975d', 'request_id': 'req-64f84e88-3b59-4acd-8484-85a8eafb42ed'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:03.786459 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-64f84e88-3b59-4acd-8484-85a8eafb42ed admin admin] The token cache is being invalidate because project 886127b1d28e4eccbe1946a232a7975d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:59:03.787745 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-64f84e88-3b59-4acd-8484-85a8eafb42ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:03.791615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-64f84e88-3b59-4acd-8484-85a8eafb42ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:03.797298 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1149/2327] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:59:03 2022] DELETE /identity/v3/projects/886127b1d28e4eccbe1946a232a7975d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:59:03.802439 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc0e6-28fc-48a0-b49e-ebbd994930d1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:03.803466 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc0e6-28fc-48a0-b49e-ebbd994930d1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:03.803951 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc0e6-28fc-48a0-b49e-ebbd994930d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:03.846926 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f48dc0e6-28fc-48a0-b49e-ebbd994930d1 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:03.848171 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f48dc0e6-28fc-48a0-b49e-ebbd994930d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:03.943364 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1179/2328] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:03.952495 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29740d-17a7-4b97-ab43-8289f3d51c5b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:03.953157 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29740d-17a7-4b97-ab43-8289f3d51c5b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:03.953567 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29740d-17a7-4b97-ab43-8289f3d51c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:03.987798 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ce29740d-17a7-4b97-ab43-8289f3d51c5b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:03.989166 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ce29740d-17a7-4b97-ab43-8289f3d51c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:04.002175 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1150/2329] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:04.006745 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dc0e6-28fc-48a0-b49e-ebbd994930d1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:04.021235 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dc0e6-28fc-48a0-b49e-ebbd994930d1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:04.028250 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3ed22-9070-4f75-8868-91395955f6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:04.029367 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3ed22-9070-4f75-8868-91395955f6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:04.030235 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3ed22-9070-4f75-8868-91395955f6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:04.030666 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3ed22-9070-4f75-8868-91395955f6d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:04.031642 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3ed22-9070-4f75-8868-91395955f6d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:59:04.032282 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3ed22-9070-4f75-8868-91395955f6d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:04.034253 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3ed22-9070-4f75-8868-91395955f6d8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:04.057854 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1180/2330] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:59:04.089585 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29740d-17a7-4b97-ab43-8289f3d51c5b None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:04.109493 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29740d-17a7-4b97-ab43-8289f3d51c5b None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:04.117317 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b3f16-a0fd-49ef-9dd7-982c0f31bb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:04.118213 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b3f16-a0fd-49ef-9dd7-982c0f31bb2d admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:04.118670 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b3f16-a0fd-49ef-9dd7-982c0f31bb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:04.119707 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b3f16-a0fd-49ef-9dd7-982c0f31bb2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:04.121601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b3f16-a0fd-49ef-9dd7-982c0f31bb2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:04.123768 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b3f16-a0fd-49ef-9dd7-982c0f31bb2d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:04.151828 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:04.162085 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1151/2331] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:59:04 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:59:04.173554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3ed22-9070-4f75-8868-91395955f6d8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:04.187379 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3ed22-9070-4f75-8868-91395955f6d8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:04.257012 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:04.324316 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5bba6-a91c-4569-bec7-e96f209220e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:04.325318 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5bba6-a91c-4569-bec7-e96f209220e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:04.325668 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5bba6-a91c-4569-bec7-e96f209220e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:04.326014 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5bba6-a91c-4569-bec7-e96f209220e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:04.326775 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5bba6-a91c-4569-bec7-e96f209220e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:04.334286 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5bba6-a91c-4569-bec7-e96f209220e3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:04.380678 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1181/2332] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:59:04 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:59:04.385290 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b3f16-a0fd-49ef-9dd7-982c0f31bb2d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:04.417922 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b3f16-a0fd-49ef-9dd7-982c0f31bb2d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:04.430929 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5616f23-4b69-4a71-b5d0-34d9ebcab691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:04.431931 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5616f23-4b69-4a71-b5d0-34d9ebcab691 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:04.432315 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5616f23-4b69-4a71-b5d0-34d9ebcab691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:04.432863 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5616f23-4b69-4a71-b5d0-34d9ebcab691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:04.435011 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5616f23-4b69-4a71-b5d0-34d9ebcab691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:04.437194 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5616f23-4b69-4a71-b5d0-34d9ebcab691 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:04.457948 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1152/2333] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:59:04.458634 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5bba6-a91c-4569-bec7-e96f209220e3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:04.472961 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5bba6-a91c-4569-bec7-e96f209220e3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:04.479726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0db742-d221-43af-a6cc-c0b73f641567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:04.480830 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0db742-d221-43af-a6cc-c0b73f641567 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:04.481313 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0db742-d221-43af-a6cc-c0b73f641567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:04.481689 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0db742-d221-43af-a6cc-c0b73f641567 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:04.482485 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0db742-d221-43af-a6cc-c0b73f641567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:04.484420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0db742-d221-43af-a6cc-c0b73f641567 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:04.514978 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5616f23-4b69-4a71-b5d0-34d9ebcab691 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:04.523374 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1182/2334] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 00:59:04.536901 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5616f23-4b69-4a71-b5d0-34d9ebcab691 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:04.550142 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b9b07-285e-4a8e-89b8-8951cf6ba833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:04.551008 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b9b07-285e-4a8e-89b8-8951cf6ba833 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:04.551369 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b9b07-285e-4a8e-89b8-8951cf6ba833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:04.551678 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b9b07-285e-4a8e-89b8-8951cf6ba833 admin admin] PATH_INFO: `/v3/projects/dbf4aeeacf5d4401884d7bc03bfd8504/users/8b62ce29aeca49bf96d2ca5767e5d15a/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:04.580522 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b9b07-285e-4a8e-89b8-8951cf6ba833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbf4aeeacf5d4401884d7bc03bfd8504, user_id=8b62ce29aeca49bf96d2ca5767e5d15a, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:04.584713 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b9b07-285e-4a8e-89b8-8951cf6ba833 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:04.601016 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1153/2335] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:59:04 2022] PUT /identity/v3/projects/dbf4aeeacf5d4401884d7bc03bfd8504/users/8b62ce29aeca49bf96d2ca5767e5d15a/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:59:04.613993 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cf7d1-b7f6-4ae9-b6d2-dc212179f7bf None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:04.614373 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cf7d1-b7f6-4ae9-b6d2-dc212179f7bf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:04.614874 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cf7d1-b7f6-4ae9-b6d2-dc212179f7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:04.649457 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-693cf7d1-b7f6-4ae9-b6d2-dc212179f7bf None None] MFA Rules not processed for user `8b62ce29aeca49bf96d2ca5767e5d15a`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:04.650736 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-693cf7d1-b7f6-4ae9-b6d2-dc212179f7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:04.739171 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1183/2336] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:59:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:04.752090 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b9b07-285e-4a8e-89b8-8951cf6ba833 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:04.754472 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3a0b9b07-285e-4a8e-89b8-8951cf6ba833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:04.833142 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b9b07-285e-4a8e-89b8-8951cf6ba833 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:04.837571 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a180d7-76f5-41bf-b293-bf96adb984a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:04.838786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a180d7-76f5-41bf-b293-bf96adb984a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:04.839069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a180d7-76f5-41bf-b293-bf96adb984a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:04.839335 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a180d7-76f5-41bf-b293-bf96adb984a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:04.855657 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a180d7-76f5-41bf-b293-bf96adb984a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:04.858470 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a180d7-76f5-41bf-b293-bf96adb984a5 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:04.908613 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1154/2337] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:59:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:59:05.614930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbea6e0-bb97-4960-ad3b-bd4bfaf62a05 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:05.616038 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbea6e0-bb97-4960-ad3b-bd4bfaf62a05 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:05.616661 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbea6e0-bb97-4960-ad3b-bd4bfaf62a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:05.680210 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-dfbea6e0-bb97-4960-ad3b-bd4bfaf62a05 None None] MFA Rules not processed for user `7abd8f370307422880a120981aa4b755`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:05.681672 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dfbea6e0-bb97-4960-ad3b-bd4bfaf62a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:05.836930 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1184/2338] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:59:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:06.726903 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61738c0b-6339-42a7-ad12-b432d7bc72de None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:06.728121 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61738c0b-6339-42a7-ad12-b432d7bc72de None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:06.728650 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61738c0b-6339-42a7-ad12-b432d7bc72de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:06.764420 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-61738c0b-6339-42a7-ad12-b432d7bc72de None None] MFA Rules not processed for user `8b62ce29aeca49bf96d2ca5767e5d15a`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:06.766304 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-61738c0b-6339-42a7-ad12-b432d7bc72de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:06.784007 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1155/2339] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:59:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:07.113613 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e243-856d-44b3-8842-8b0ba6ffd22a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:07.114206 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e243-856d-44b3-8842-8b0ba6ffd22a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:07.114206 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e243-856d-44b3-8842-8b0ba6ffd22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:07.135753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2899e243-856d-44b3-8842-8b0ba6ffd22a None None] MFA Rules not processed for user `42dcae7ba3c241eb8d7d0894aadb467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:07.136997 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2899e243-856d-44b3-8842-8b0ba6ffd22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:07.190975 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:07.226766 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1185/2340] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Oct 2 00:59:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:07.251093 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61738c0b-6339-42a7-ad12-b432d7bc72de None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:07.253576 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-61738c0b-6339-42a7-ad12-b432d7bc72de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:07.345182 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61738c0b-6339-42a7-ad12-b432d7bc72de None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:07.352184 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02427c88-e47c-4073-8d22-c7d008e00b62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784579d2ddf4cc99fe0e1d109e5cdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:07.353065 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02427c88-e47c-4073-8d22-c7d008e00b62 service swift] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:07.353531 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02427c88-e47c-4073-8d22-c7d008e00b62 service swift] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:07.353994 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02427c88-e47c-4073-8d22-c7d008e00b62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:07.365397 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02427c88-e47c-4073-8d22-c7d008e00b62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:07.367207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02427c88-e47c-4073-8d22-c7d008e00b62 service swift] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:07.382020 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1156/2341] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Oct 2 00:59:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 00:59:11.462339 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899e243-856d-44b3-8842-8b0ba6ffd22a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:11.465239 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2899e243-856d-44b3-8842-8b0ba6ffd22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:11.770240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899e243-856d-44b3-8842-8b0ba6ffd22a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:11.790302 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73142faf-528b-4164-9327-03b59cd478f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:11.791083 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73142faf-528b-4164-9327-03b59cd478f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:11.791367 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73142faf-528b-4164-9327-03b59cd478f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:11.791662 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73142faf-528b-4164-9327-03b59cd478f0 admin admin] PATH_INFO: `/v3/users/ca4ca1601fc14f6bb7239d51cac39c90` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:11.793499 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73142faf-528b-4164-9327-03b59cd478f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca4ca1601fc14f6bb7239d51cac39c90)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:11.803503 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73142faf-528b-4164-9327-03b59cd478f0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:11.953289 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-73142faf-528b-4164-9327-03b59cd478f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca4ca1601fc14f6bb7239d51cac39c90'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:11.955463 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-73142faf-528b-4164-9327-03b59cd478f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca4ca1601fc14f6bb7239d51cac39c90'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:11.992456 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-73142faf-528b-4164-9327-03b59cd478f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca4ca1601fc14f6bb7239d51cac39c90'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:12.008816 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-73142faf-528b-4164-9327-03b59cd478f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca4ca1601fc14f6bb7239d51cac39c90'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:12.009552 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-73142faf-528b-4164-9327-03b59cd478f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca4ca1601fc14f6bb7239d51cac39c90'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:12.032184 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1186/2342] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:59:11 2022] DELETE /identity/v3/users/ca4ca1601fc14f6bb7239d51cac39c90 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:59:12.036810 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87854d11-ffa0-4f16-a384-1e4d0c89969f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:12.037383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87854d11-ffa0-4f16-a384-1e4d0c89969f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:12.037383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87854d11-ffa0-4f16-a384-1e4d0c89969f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:12.062928 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-87854d11-ffa0-4f16-a384-1e4d0c89969f None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:12.064249 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-87854d11-ffa0-4f16-a384-1e4d0c89969f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:12.126829 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:12.158541 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1157/2343] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:12.168830 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73142faf-528b-4164-9327-03b59cd478f0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:12.171715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-73142faf-528b-4164-9327-03b59cd478f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:12.248635 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73142faf-528b-4164-9327-03b59cd478f0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:12.253587 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3faf20-da58-4731-ab3b-b2fd0463b439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:12.254558 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3faf20-da58-4731-ab3b-b2fd0463b439 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:12.255055 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3faf20-da58-4731-ab3b-b2fd0463b439 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:12.255541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3faf20-da58-4731-ab3b-b2fd0463b439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:12.268430 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3faf20-da58-4731-ab3b-b2fd0463b439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:12.270460 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3faf20-da58-4731-ab3b-b2fd0463b439 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:12.283933 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1187/2344] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:59:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:59:13.253708 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87854d11-ffa0-4f16-a384-1e4d0c89969f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:13.255809 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-87854d11-ffa0-4f16-a384-1e4d0c89969f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:13.282126 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87854d11-ffa0-4f16-a384-1e4d0c89969f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:13.298895 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018feee-bab2-458e-a39d-f9dd9f7935f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:13.310239 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018feee-bab2-458e-a39d-f9dd9f7935f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:13.312590 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018feee-bab2-458e-a39d-f9dd9f7935f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:13.313401 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018feee-bab2-458e-a39d-f9dd9f7935f8 admin admin] PATH_INFO: `/v3/projects/051e5e468e564313a4f34edbc6828329` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:13.333308 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018feee-bab2-458e-a39d-f9dd9f7935f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=051e5e468e564313a4f34edbc6828329)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:13.333308 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018feee-bab2-458e-a39d-f9dd9f7935f8 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:13.460326 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0018feee-bab2-458e-a39d-f9dd9f7935f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '051e5e468e564313a4f34edbc6828329', 'request_id': 'req-0018feee-bab2-458e-a39d-f9dd9f7935f8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:13.472842 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0018feee-bab2-458e-a39d-f9dd9f7935f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '051e5e468e564313a4f34edbc6828329', 'request_id': 'req-0018feee-bab2-458e-a39d-f9dd9f7935f8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:13.488083 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0018feee-bab2-458e-a39d-f9dd9f7935f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '051e5e468e564313a4f34edbc6828329', 'request_id': 'req-0018feee-bab2-458e-a39d-f9dd9f7935f8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:13.513988 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0018feee-bab2-458e-a39d-f9dd9f7935f8 admin admin] The token cache is being invalidate because project 051e5e468e564313a4f34edbc6828329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:59:13.516675 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0018feee-bab2-458e-a39d-f9dd9f7935f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:13.517404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0018feee-bab2-458e-a39d-f9dd9f7935f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:13.528974 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1158/2345] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:59:13 2022] DELETE /identity/v3/projects/051e5e468e564313a4f34edbc6828329 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:59:13.529320 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba5fba-00ae-43ae-a564-5fbeff06e1aa None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:13.529320 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba5fba-00ae-43ae-a564-5fbeff06e1aa None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:13.529320 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba5fba-00ae-43ae-a564-5fbeff06e1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:13.569187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5eba5fba-00ae-43ae-a564-5fbeff06e1aa None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:13.570366 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5eba5fba-00ae-43ae-a564-5fbeff06e1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:13.577537 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:13.676455 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018feee-bab2-458e-a39d-f9dd9f7935f8 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:13.678056 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0018feee-bab2-458e-a39d-f9dd9f7935f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:13.751643 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1188/2346] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:13.763452 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7815a0-c565-455b-a05e-e80ac5663375 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:13.766329 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7815a0-c565-455b-a05e-e80ac5663375 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:13.766883 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7815a0-c565-455b-a05e-e80ac5663375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:13.871115 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6e7815a0-c565-455b-a05e-e80ac5663375 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:13.873621 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6e7815a0-c565-455b-a05e-e80ac5663375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:13.924835 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1189/2347] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:13.926381 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7815a0-c565-455b-a05e-e80ac5663375 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:13.952479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7815a0-c565-455b-a05e-e80ac5663375 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:13.968243 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b6e80-fcd8-47ef-be9d-305e30d21709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:13.969648 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b6e80-fcd8-47ef-be9d-305e30d21709 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:13.970236 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b6e80-fcd8-47ef-be9d-305e30d21709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:13.970804 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b6e80-fcd8-47ef-be9d-305e30d21709 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:13.971724 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b6e80-fcd8-47ef-be9d-305e30d21709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:59:13.972374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b6e80-fcd8-47ef-be9d-305e30d21709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:13.978919 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b6e80-fcd8-47ef-be9d-305e30d21709 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:14.015419 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1190/2348] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 00:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:59:14.018400 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018feee-bab2-458e-a39d-f9dd9f7935f8 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:14.020627 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b6e80-fcd8-47ef-be9d-305e30d21709 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:14.045837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32f7cd-8f71-4a1e-9b85-0e2ce1823087 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78481cceebd4138b893eba7e51c9c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:14.052232 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32f7cd-8f71-4a1e-9b85-0e2ce1823087 service placement] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:14.052531 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32f7cd-8f71-4a1e-9b85-0e2ce1823087 service placement] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:14.052807 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32f7cd-8f71-4a1e-9b85-0e2ce1823087 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:14.059157 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b6e80-fcd8-47ef-be9d-305e30d21709 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:14.062201 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ff32f7cd-8f71-4a1e-9b85-0e2ce1823087 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:14.085612 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164183f-76c1-4932-b32b-5963a6bd6939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:14.086235 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164183f-76c1-4932-b32b-5963a6bd6939 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:14.086519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164183f-76c1-4932-b32b-5963a6bd6939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:14.086821 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164183f-76c1-4932-b32b-5963a6bd6939 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:14.087431 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164183f-76c1-4932-b32b-5963a6bd6939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:14.096190 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164183f-76c1-4932-b32b-5963a6bd6939 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:14.104083 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32f7cd-8f71-4a1e-9b85-0e2ce1823087 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:14.118005 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32f7cd-8f71-4a1e-9b85-0e2ce1823087 service placement] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:14.155623 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1159/2349] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:59:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:59:14.184064 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1191/2350] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 00:59:14 2022] POST /identity/v3/projects => generated 397 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:59:14.188251 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32f7cd-8f71-4a1e-9b85-0e2ce1823087 service placement] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:14.203906 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32f7cd-8f71-4a1e-9b85-0e2ce1823087 service placement] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:14.387501 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c0dfd-f6da-4b30-8112-196af02dd9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:14.388295 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c0dfd-f6da-4b30-8112-196af02dd9cf admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:14.388674 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c0dfd-f6da-4b30-8112-196af02dd9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:14.389096 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c0dfd-f6da-4b30-8112-196af02dd9cf admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:14.389918 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c0dfd-f6da-4b30-8112-196af02dd9cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:14.392479 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c0dfd-f6da-4b30-8112-196af02dd9cf admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:14.420801 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:14.446981 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1160/2351] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 00:59:14 2022] POST /identity/v3/users => generated 299 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:59:14.451684 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164183f-76c1-4932-b32b-5963a6bd6939 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:14.472737 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164183f-76c1-4932-b32b-5963a6bd6939 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:14.480621 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f001b5-d37b-4787-8fcf-c4dd3252b71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:14.482118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f001b5-d37b-4787-8fcf-c4dd3252b71d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:14.483872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f001b5-d37b-4787-8fcf-c4dd3252b71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:14.484389 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f001b5-d37b-4787-8fcf-c4dd3252b71d admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:14.486166 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f001b5-d37b-4787-8fcf-c4dd3252b71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:14.489213 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f001b5-d37b-4787-8fcf-c4dd3252b71d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:14.507054 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1192/2352] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:59:14.510349 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c0dfd-f6da-4b30-8112-196af02dd9cf admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:14.528205 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c0dfd-f6da-4b30-8112-196af02dd9cf admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:14.540522 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3160bbd-7b7b-400a-87eb-3e87be7f8228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:14.541744 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3160bbd-7b7b-400a-87eb-3e87be7f8228 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:14.543206 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3160bbd-7b7b-400a-87eb-3e87be7f8228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:14.543660 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3160bbd-7b7b-400a-87eb-3e87be7f8228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:14.544604 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3160bbd-7b7b-400a-87eb-3e87be7f8228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:14.547481 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3160bbd-7b7b-400a-87eb-3e87be7f8228 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:14.568419 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1161/2353] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 00:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 00:59:14.575547 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f001b5-d37b-4787-8fcf-c4dd3252b71d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:14.592696 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f001b5-d37b-4787-8fcf-c4dd3252b71d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:14.607536 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63342d3d-c908-4a32-afb8-c9221392bd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:14.608230 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63342d3d-c908-4a32-afb8-c9221392bd03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:14.608496 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63342d3d-c908-4a32-afb8-c9221392bd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:14.608764 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63342d3d-c908-4a32-afb8-c9221392bd03 admin admin] PATH_INFO: `/v3/projects/648a7346f21243eaae511bce6299a2e8/users/0f23f04ca5864ac092cdd5351abdd566/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:14.643402 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63342d3d-c908-4a32-afb8-c9221392bd03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=648a7346f21243eaae511bce6299a2e8, user_id=0f23f04ca5864ac092cdd5351abdd566, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:14.646131 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63342d3d-c908-4a32-afb8-c9221392bd03 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:14.686549 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1193/2354] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 00:59:14 2022] PUT /identity/v3/projects/648a7346f21243eaae511bce6299a2e8/users/0f23f04ca5864ac092cdd5351abdd566/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:59:14.687981 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6213d-629d-400f-8890-a1df2685caae None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:14.688778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6213d-629d-400f-8890-a1df2685caae None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:14.689090 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6213d-629d-400f-8890-a1df2685caae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:14.746218 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-fdd6213d-629d-400f-8890-a1df2685caae None None] MFA Rules not processed for user `0f23f04ca5864ac092cdd5351abdd566`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:14.751115 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fdd6213d-629d-400f-8890-a1df2685caae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:14.863483 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1162/2355] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:59:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:14.876543 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63342d3d-c908-4a32-afb8-c9221392bd03 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:14.878882 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-63342d3d-c908-4a32-afb8-c9221392bd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:14.995662 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63342d3d-c908-4a32-afb8-c9221392bd03 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:15.002000 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e6896-1bc7-4f61-a270-e14031479aa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:15.002697 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e6896-1bc7-4f61-a270-e14031479aa7 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:15.002981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e6896-1bc7-4f61-a270-e14031479aa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:15.003258 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e6896-1bc7-4f61-a270-e14031479aa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:15.015580 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e6896-1bc7-4f61-a270-e14031479aa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:15.017243 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e6896-1bc7-4f61-a270-e14031479aa7 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:15.044177 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1194/2356] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:59:14 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:59:17.077929 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89ff7b-8043-41d3-abb6-b94e96dc9746 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:17.078774 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89ff7b-8043-41d3-abb6-b94e96dc9746 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:17.079185 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89ff7b-8043-41d3-abb6-b94e96dc9746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:17.130918 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4a89ff7b-8043-41d3-abb6-b94e96dc9746 None None] MFA Rules not processed for user `42dcae7ba3c241eb8d7d0894aadb467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:17.132300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4a89ff7b-8043-41d3-abb6-b94e96dc9746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:17.277428 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1163/2357] 10.222.0.26 () {58 vars in 967 bytes} [Sun Oct 2 00:59:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:17.311254 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e6896-1bc7-4f61-a270-e14031479aa7 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:17.325756 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-774e6896-1bc7-4f61-a270-e14031479aa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:17.396120 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:17.479057 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e6896-1bc7-4f61-a270-e14031479aa7 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:17.503325 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b1973-4c3d-4a3d-be0b-4b65497f0979 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784579d2ddf4cc99fe0e1d109e5cdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:17.504305 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b1973-4c3d-4a3d-be0b-4b65497f0979 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:17.504755 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b1973-4c3d-4a3d-be0b-4b65497f0979 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:17.505229 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b1973-4c3d-4a3d-be0b-4b65497f0979 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:17.526036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b1973-4c3d-4a3d-be0b-4b65497f0979 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:17.528912 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b1973-4c3d-4a3d-be0b-4b65497f0979 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:17.547041 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1195/2358] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Oct 2 00:59:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 00:59:20.236665 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89ff7b-8043-41d3-abb6-b94e96dc9746 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:20.238755 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4a89ff7b-8043-41d3-abb6-b94e96dc9746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:20.315382 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89ff7b-8043-41d3-abb6-b94e96dc9746 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:20.320150 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d34a8e-4192-41e4-b418-2ad646f81d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:20.320794 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d34a8e-4192-41e4-b418-2ad646f81d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:20.321113 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d34a8e-4192-41e4-b418-2ad646f81d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:20.321390 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d34a8e-4192-41e4-b418-2ad646f81d1e admin admin] PATH_INFO: `/v3/users/5aa9341fc87840bc99378f1def51167b` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:20.322572 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d34a8e-4192-41e4-b418-2ad646f81d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aa9341fc87840bc99378f1def51167b)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:20.325209 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d34a8e-4192-41e4-b418-2ad646f81d1e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:20.346585 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:INSERT=2,keystone:SELECT=97,keystone:DELETE=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:20.381027 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-44d34a8e-4192-41e4-b418-2ad646f81d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aa9341fc87840bc99378f1def51167b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:20.381704 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-44d34a8e-4192-41e4-b418-2ad646f81d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aa9341fc87840bc99378f1def51167b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:20.390554 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-44d34a8e-4192-41e4-b418-2ad646f81d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aa9341fc87840bc99378f1def51167b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:20.391252 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-44d34a8e-4192-41e4-b418-2ad646f81d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aa9341fc87840bc99378f1def51167b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:20.398965 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-44d34a8e-4192-41e4-b418-2ad646f81d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aa9341fc87840bc99378f1def51167b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:20.440991 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1164/2359] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:59:20 2022] DELETE /identity/v3/users/5aa9341fc87840bc99378f1def51167b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:59:20.730327 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b1973-4c3d-4a3d-be0b-4b65497f0979 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:20.751409 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b1973-4c3d-4a3d-be0b-4b65497f0979 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:20.824443 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d532ab7-13ea-4e31-9fec-b84454f1626f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:20.826738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d532ab7-13ea-4e31-9fec-b84454f1626f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:20.826738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d532ab7-13ea-4e31-9fec-b84454f1626f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:20.826738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d532ab7-13ea-4e31-9fec-b84454f1626f admin admin] PATH_INFO: `/v3/projects/f7ef11453bfe47d7a1e8a8ec84144362` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:20.827394 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d532ab7-13ea-4e31-9fec-b84454f1626f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7ef11453bfe47d7a1e8a8ec84144362)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:20.829872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d532ab7-13ea-4e31-9fec-b84454f1626f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:20.895231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4d532ab7-13ea-4e31-9fec-b84454f1626f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7ef11453bfe47d7a1e8a8ec84144362', 'request_id': 'req-4d532ab7-13ea-4e31-9fec-b84454f1626f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:20.902809 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4d532ab7-13ea-4e31-9fec-b84454f1626f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7ef11453bfe47d7a1e8a8ec84144362', 'request_id': 'req-4d532ab7-13ea-4e31-9fec-b84454f1626f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:20.911761 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4d532ab7-13ea-4e31-9fec-b84454f1626f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7ef11453bfe47d7a1e8a8ec84144362', 'request_id': 'req-4d532ab7-13ea-4e31-9fec-b84454f1626f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:20.924631 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4d532ab7-13ea-4e31-9fec-b84454f1626f admin admin] The token cache is being invalidate because project f7ef11453bfe47d7a1e8a8ec84144362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:59:20.924923 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4d532ab7-13ea-4e31-9fec-b84454f1626f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:20.925595 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4d532ab7-13ea-4e31-9fec-b84454f1626f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:20.927258 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1196/2360] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:59:20 2022] DELETE /identity/v3/projects/f7ef11453bfe47d7a1e8a8ec84144362 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:59:20.979438 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d34a8e-4192-41e4-b418-2ad646f81d1e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:20.982555 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-44d34a8e-4192-41e4-b418-2ad646f81d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:20.998759 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d34a8e-4192-41e4-b418-2ad646f81d1e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:21.092044 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac70ad-f876-4b3c-833e-166c4830a507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:21.092698 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac70ad-f876-4b3c-833e-166c4830a507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:21.093036 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac70ad-f876-4b3c-833e-166c4830a507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:21.093406 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac70ad-f876-4b3c-833e-166c4830a507 admin admin] PATH_INFO: `/v3/users/0f23f04ca5864ac092cdd5351abdd566` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:21.094943 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac70ad-f876-4b3c-833e-166c4830a507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f23f04ca5864ac092cdd5351abdd566)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:21.097095 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac70ad-f876-4b3c-833e-166c4830a507 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:21.170031 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24ac70ad-f876-4b3c-833e-166c4830a507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f23f04ca5864ac092cdd5351abdd566'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:21.170672 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24ac70ad-f876-4b3c-833e-166c4830a507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f23f04ca5864ac092cdd5351abdd566'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:21.178244 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24ac70ad-f876-4b3c-833e-166c4830a507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f23f04ca5864ac092cdd5351abdd566'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:21.178902 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24ac70ad-f876-4b3c-833e-166c4830a507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f23f04ca5864ac092cdd5351abdd566'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:21.186197 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24ac70ad-f876-4b3c-833e-166c4830a507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f23f04ca5864ac092cdd5351abdd566'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:21.204073 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1165/2361] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:59:20 2022] DELETE /identity/v3/users/0f23f04ca5864ac092cdd5351abdd566 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:59:21.208526 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced292a-855c-4db3-9cfe-5a2b0692aece None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:21.208805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced292a-855c-4db3-9cfe-5a2b0692aece None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:21.209102 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced292a-855c-4db3-9cfe-5a2b0692aece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:21.228848 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9ced292a-855c-4db3-9cfe-5a2b0692aece None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:21.230184 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9ced292a-855c-4db3-9cfe-5a2b0692aece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:21.282091 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:21.293067 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1197/2362] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:59:21.302510 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac70ad-f876-4b3c-833e-166c4830a507 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:21.303916 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-24ac70ad-f876-4b3c-833e-166c4830a507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:21.318864 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:21.362550 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac70ad-f876-4b3c-833e-166c4830a507 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:21.366233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35237caf-159b-4899-a2aa-e9cf1f4ef77d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:21.366831 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35237caf-159b-4899-a2aa-e9cf1f4ef77d service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:21.367106 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35237caf-159b-4899-a2aa-e9cf1f4ef77d service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:21.367373 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35237caf-159b-4899-a2aa-e9cf1f4ef77d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:21.377126 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35237caf-159b-4899-a2aa-e9cf1f4ef77d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:21.378547 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35237caf-159b-4899-a2aa-e9cf1f4ef77d service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:21.388423 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1166/2363] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:59:22.038489 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced292a-855c-4db3-9cfe-5a2b0692aece None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:22.040008 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9ced292a-855c-4db3-9cfe-5a2b0692aece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:22.062793 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced292a-855c-4db3-9cfe-5a2b0692aece None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:22.070654 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ec293-17b6-4ebf-946f-da6ed2dfa722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:22.071433 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ec293-17b6-4ebf-946f-da6ed2dfa722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:22.071808 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ec293-17b6-4ebf-946f-da6ed2dfa722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:22.072144 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ec293-17b6-4ebf-946f-da6ed2dfa722 admin admin] PATH_INFO: `/v3/projects/648a7346f21243eaae511bce6299a2e8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:22.074974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ec293-17b6-4ebf-946f-da6ed2dfa722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=648a7346f21243eaae511bce6299a2e8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:22.077127 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ec293-17b6-4ebf-946f-da6ed2dfa722 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:22.165617 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-170ec293-17b6-4ebf-946f-da6ed2dfa722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '648a7346f21243eaae511bce6299a2e8', 'request_id': 'req-170ec293-17b6-4ebf-946f-da6ed2dfa722'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:22.176837 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-170ec293-17b6-4ebf-946f-da6ed2dfa722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '648a7346f21243eaae511bce6299a2e8', 'request_id': 'req-170ec293-17b6-4ebf-946f-da6ed2dfa722'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:22.189397 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-170ec293-17b6-4ebf-946f-da6ed2dfa722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '648a7346f21243eaae511bce6299a2e8', 'request_id': 'req-170ec293-17b6-4ebf-946f-da6ed2dfa722'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:22.208160 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-170ec293-17b6-4ebf-946f-da6ed2dfa722 admin admin] The token cache is being invalidate because project 648a7346f21243eaae511bce6299a2e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:59:22.208617 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-170ec293-17b6-4ebf-946f-da6ed2dfa722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:22.209616 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-170ec293-17b6-4ebf-946f-da6ed2dfa722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:22.218004 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1198/2364] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:59:22 2022] DELETE /identity/v3/projects/648a7346f21243eaae511bce6299a2e8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:59:28.440501 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86bdec-6c0a-48b1-a26d-8704f3ac1f91 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:28.441068 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86bdec-6c0a-48b1-a26d-8704f3ac1f91 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:28.441373 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86bdec-6c0a-48b1-a26d-8704f3ac1f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:28.463556 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5d86bdec-6c0a-48b1-a26d-8704f3ac1f91 None None] MFA Rules not processed for user `42dcae7ba3c241eb8d7d0894aadb467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:28.464866 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5d86bdec-6c0a-48b1-a26d-8704f3ac1f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:28.522301 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1167/2365] 10.222.0.26 () {58 vars in 967 bytes} [Sun Oct 2 00:59:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:28.534942 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ec293-17b6-4ebf-946f-da6ed2dfa722 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:28.536348 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-170ec293-17b6-4ebf-946f-da6ed2dfa722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:28.607218 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ec293-17b6-4ebf-946f-da6ed2dfa722 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:28.612664 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13131c-b9b9-4ce8-a695-0ffb1fb9ef61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784579d2ddf4cc99fe0e1d109e5cdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:28.613437 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13131c-b9b9-4ce8-a695-0ffb1fb9ef61 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:28.613718 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13131c-b9b9-4ce8-a695-0ffb1fb9ef61 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:28.613986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13131c-b9b9-4ce8-a695-0ffb1fb9ef61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:28.623069 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13131c-b9b9-4ce8-a695-0ffb1fb9ef61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:28.624640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13131c-b9b9-4ce8-a695-0ffb1fb9ef61 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:28.632698 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1199/2366] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Oct 2 00:59:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 00:59:34.960240 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fae5d8-8076-49ee-8bb2-cf5c24716f7c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:34.960803 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fae5d8-8076-49ee-8bb2-cf5c24716f7c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:34.960803 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fae5d8-8076-49ee-8bb2-cf5c24716f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:34.980548 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b6fae5d8-8076-49ee-8bb2-cf5c24716f7c None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:34.981785 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b6fae5d8-8076-49ee-8bb2-cf5c24716f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:35.046115 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1168/2367] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Oct 2 00:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:35.084337 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13131c-b9b9-4ce8-a695-0ffb1fb9ef61 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:35.085941 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0c13131c-b9b9-4ce8-a695-0ffb1fb9ef61 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:35.163473 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13131c-b9b9-4ce8-a695-0ffb1fb9ef61 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:35.170148 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828fcdd-9377-4ffc-8373-0b8d65ed22ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:35.170801 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828fcdd-9377-4ffc-8373-0b8d65ed22ea service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:35.171096 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828fcdd-9377-4ffc-8373-0b8d65ed22ea service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:35.171365 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828fcdd-9377-4ffc-8373-0b8d65ed22ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:35.177953 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:35.180801 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828fcdd-9377-4ffc-8373-0b8d65ed22ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:35.184031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828fcdd-9377-4ffc-8373-0b8d65ed22ea service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:35.195659 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1200/2368] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:59:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:59:39.223556 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156e8e7-ddc9-46ca-a365-02466f0c7800 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:39.224077 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156e8e7-ddc9-46ca-a365-02466f0c7800 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:39.224077 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156e8e7-ddc9-46ca-a365-02466f0c7800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:39.245556 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-9156e8e7-ddc9-46ca-a365-02466f0c7800 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:39.246763 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9156e8e7-ddc9-46ca-a365-02466f0c7800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:39.254515 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1169/2369] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Oct 2 00:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:39.275774 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828fcdd-9377-4ffc-8373-0b8d65ed22ea service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:39.287448 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828fcdd-9377-4ffc-8373-0b8d65ed22ea service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:39.293610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e448c5-39af-475a-a82f-4ec4d48ad788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:39.294247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e448c5-39af-475a-a82f-4ec4d48ad788 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:39.294543 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e448c5-39af-475a-a82f-4ec4d48ad788 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:39.294809 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e448c5-39af-475a-a82f-4ec4d48ad788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:39.303287 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e448c5-39af-475a-a82f-4ec4d48ad788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:39.304857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e448c5-39af-475a-a82f-4ec4d48ad788 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:39.315690 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1201/2370] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:59:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:59:39.759555 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c70545-09e7-4404-bed1-6b52ee51d381 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:39.759829 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c70545-09e7-4404-bed1-6b52ee51d381 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:39.760125 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c70545-09e7-4404-bed1-6b52ee51d381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:39.781550 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-35c70545-09e7-4404-bed1-6b52ee51d381 None None] MFA Rules not processed for user `42dcae7ba3c241eb8d7d0894aadb467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:39.783034 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-35c70545-09e7-4404-bed1-6b52ee51d381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:39.791656 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1170/2371] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Oct 2 00:59:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:39.814010 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e448c5-39af-475a-a82f-4ec4d48ad788 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:39.826507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e448c5-39af-475a-a82f-4ec4d48ad788 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:39.831689 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c77f58-b77d-4889-9623-382f4b5cbf0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784579d2ddf4cc99fe0e1d109e5cdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:39.832318 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c77f58-b77d-4889-9623-382f4b5cbf0a service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:39.832600 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c77f58-b77d-4889-9623-382f4b5cbf0a service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:39.832873 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c77f58-b77d-4889-9623-382f4b5cbf0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:39.842406 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c77f58-b77d-4889-9623-382f4b5cbf0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:39.844134 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c77f58-b77d-4889-9623-382f4b5cbf0a service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:39.852988 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1202/2372] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Oct 2 00:59:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 00:59:40.367275 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebd8d3-e3af-4ab0-8171-c996c2be66d5 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:40.367762 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebd8d3-e3af-4ab0-8171-c996c2be66d5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:40.367894 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebd8d3-e3af-4ab0-8171-c996c2be66d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:40.387951 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a1ebd8d3-e3af-4ab0-8171-c996c2be66d5 None None] MFA Rules not processed for user `42dcae7ba3c241eb8d7d0894aadb467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:40.389210 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a1ebd8d3-e3af-4ab0-8171-c996c2be66d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:40.396325 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1171/2373] 10.222.0.26 () {58 vars in 967 bytes} [Sun Oct 2 00:59:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:40.409271 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c77f58-b77d-4889-9623-382f4b5cbf0a service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:40.421357 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c77f58-b77d-4889-9623-382f4b5cbf0a service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:40.426294 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c09e5c-3bb0-4f0e-86bb-d44e2b014fe0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784579d2ddf4cc99fe0e1d109e5cdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:40.426881 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c09e5c-3bb0-4f0e-86bb-d44e2b014fe0 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:40.427154 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c09e5c-3bb0-4f0e-86bb-d44e2b014fe0 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:40.427420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c09e5c-3bb0-4f0e-86bb-d44e2b014fe0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:40.435427 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c09e5c-3bb0-4f0e-86bb-d44e2b014fe0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:40.437031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c09e5c-3bb0-4f0e-86bb-d44e2b014fe0 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:40.445908 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1203/2374] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Oct 2 00:59:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 00:59:40.682694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577c303-cd59-421b-a5d4-cc550fe7a604 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:40.682983 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577c303-cd59-421b-a5d4-cc550fe7a604 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:40.683261 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577c303-cd59-421b-a5d4-cc550fe7a604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:40.703139 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-9577c303-cd59-421b-a5d4-cc550fe7a604 None None] MFA Rules not processed for user `42dcae7ba3c241eb8d7d0894aadb467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:40.704353 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9577c303-cd59-421b-a5d4-cc550fe7a604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:40.711521 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1172/2375] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Oct 2 00:59:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:40.723918 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c09e5c-3bb0-4f0e-86bb-d44e2b014fe0 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:40.734694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c09e5c-3bb0-4f0e-86bb-d44e2b014fe0 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:40.739840 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40109ca2-c73f-48a5-bede-79cc1bc702d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784579d2ddf4cc99fe0e1d109e5cdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:40.740453 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40109ca2-c73f-48a5-bede-79cc1bc702d4 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:40.740723 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40109ca2-c73f-48a5-bede-79cc1bc702d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:40.741030 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40109ca2-c73f-48a5-bede-79cc1bc702d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:40.751403 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40109ca2-c73f-48a5-bede-79cc1bc702d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:40.753055 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40109ca2-c73f-48a5-bede-79cc1bc702d4 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:40.762579 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1204/2376] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Oct 2 00:59:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 00:59:41.101774 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed06c8-a74c-4eb4-bb3a-0a6c559b7b96 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:41.102187 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed06c8-a74c-4eb4-bb3a-0a6c559b7b96 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:41.102488 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed06c8-a74c-4eb4-bb3a-0a6c559b7b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:41.123329 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-47ed06c8-a74c-4eb4-bb3a-0a6c559b7b96 None None] MFA Rules not processed for user `42dcae7ba3c241eb8d7d0894aadb467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:41.124538 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-47ed06c8-a74c-4eb4-bb3a-0a6c559b7b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:41.132012 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1173/2377] 10.222.0.26 () {58 vars in 967 bytes} [Sun Oct 2 00:59:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:41.146842 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40109ca2-c73f-48a5-bede-79cc1bc702d4 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:41.157974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40109ca2-c73f-48a5-bede-79cc1bc702d4 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:41.162835 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751a6b6-b949-4ec8-8674-cc0a7abd373f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784579d2ddf4cc99fe0e1d109e5cdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:41.163424 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751a6b6-b949-4ec8-8674-cc0a7abd373f service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:41.163699 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751a6b6-b949-4ec8-8674-cc0a7abd373f service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:41.163967 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751a6b6-b949-4ec8-8674-cc0a7abd373f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:41.172405 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751a6b6-b949-4ec8-8674-cc0a7abd373f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:41.173999 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751a6b6-b949-4ec8-8674-cc0a7abd373f service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:41.182174 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1205/2378] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Oct 2 00:59:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 00:59:42.473881 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f3c55-59be-455f-9964-23fc74ad04de None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:42.474448 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f3c55-59be-455f-9964-23fc74ad04de None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:42.474448 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f3c55-59be-455f-9964-23fc74ad04de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:42.496333 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-257f3c55-59be-455f-9964-23fc74ad04de None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:42.497634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-257f3c55-59be-455f-9964-23fc74ad04de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:42.505722 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1174/2379] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Oct 2 00:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:42.534296 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751a6b6-b949-4ec8-8674-cc0a7abd373f service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:42.535805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6751a6b6-b949-4ec8-8674-cc0a7abd373f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:42.551862 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751a6b6-b949-4ec8-8674-cc0a7abd373f service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:42.558951 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f283f-9b47-4674-ba02-5de88a04baf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:42.559681 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f283f-9b47-4674-ba02-5de88a04baf6 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:42.560026 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f283f-9b47-4674-ba02-5de88a04baf6 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:42.560298 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f283f-9b47-4674-ba02-5de88a04baf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:42.570160 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f283f-9b47-4674-ba02-5de88a04baf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:42.572631 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f283f-9b47-4674-ba02-5de88a04baf6 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:42.582509 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1206/2380] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:59:43.339130 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f3c55-59be-455f-9964-23fc74ad04de None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:43.340547 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-257f3c55-59be-455f-9964-23fc74ad04de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:43.352512 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f3c55-59be-455f-9964-23fc74ad04de None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:43.357925 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04f8b0-9427-49aa-9849-56fd86e6de4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:43.358555 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04f8b0-9427-49aa-9849-56fd86e6de4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:43.358833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04f8b0-9427-49aa-9849-56fd86e6de4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:43.359107 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04f8b0-9427-49aa-9849-56fd86e6de4c admin admin] PATH_INFO: `/v3/users/8b62ce29aeca49bf96d2ca5767e5d15a` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:43.360234 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04f8b0-9427-49aa-9849-56fd86e6de4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b62ce29aeca49bf96d2ca5767e5d15a)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:43.362206 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04f8b0-9427-49aa-9849-56fd86e6de4c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:43.378782 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:43.418840 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2d04f8b0-9427-49aa-9849-56fd86e6de4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b62ce29aeca49bf96d2ca5767e5d15a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:43.419493 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2d04f8b0-9427-49aa-9849-56fd86e6de4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b62ce29aeca49bf96d2ca5767e5d15a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:43.428554 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2d04f8b0-9427-49aa-9849-56fd86e6de4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b62ce29aeca49bf96d2ca5767e5d15a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:43.429210 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2d04f8b0-9427-49aa-9849-56fd86e6de4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b62ce29aeca49bf96d2ca5767e5d15a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:43.437137 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2d04f8b0-9427-49aa-9849-56fd86e6de4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b62ce29aeca49bf96d2ca5767e5d15a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:43.461154 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1175/2381] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 00:59:43 2022] DELETE /identity/v3/users/8b62ce29aeca49bf96d2ca5767e5d15a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:59:43.469665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a8f09-27dc-418c-8514-b5f2a41ad043 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:43.469952 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a8f09-27dc-418c-8514-b5f2a41ad043 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:43.470227 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a8f09-27dc-418c-8514-b5f2a41ad043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:43.489554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d81a8f09-27dc-418c-8514-b5f2a41ad043 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:43.490851 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d81a8f09-27dc-418c-8514-b5f2a41ad043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:43.551202 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1207/2382] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 00:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:43.561574 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04f8b0-9427-49aa-9849-56fd86e6de4c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:43.563020 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2d04f8b0-9427-49aa-9849-56fd86e6de4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:43.623317 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04f8b0-9427-49aa-9849-56fd86e6de4c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:43.629305 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416d7c3-8955-464d-bd66-480712e60f7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:43.630348 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416d7c3-8955-464d-bd66-480712e60f7b service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:43.630842 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416d7c3-8955-464d-bd66-480712e60f7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:43.631337 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416d7c3-8955-464d-bd66-480712e60f7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:43.649651 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416d7c3-8955-464d-bd66-480712e60f7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:43.651726 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416d7c3-8955-464d-bd66-480712e60f7b service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:43.661849 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1176/2383] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:59:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:59:43.839836 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a8f09-27dc-418c-8514-b5f2a41ad043 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:43.841441 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d81a8f09-27dc-418c-8514-b5f2a41ad043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:43.854568 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a8f09-27dc-418c-8514-b5f2a41ad043 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:43.860103 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7219b-87b4-494f-84e9-df15e46dd44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:43.860781 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7219b-87b4-494f-84e9-df15e46dd44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:43.861219 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7219b-87b4-494f-84e9-df15e46dd44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:43.861381 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7219b-87b4-494f-84e9-df15e46dd44d admin admin] PATH_INFO: `/v3/projects/dbf4aeeacf5d4401884d7bc03bfd8504` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:43.863653 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7219b-87b4-494f-84e9-df15e46dd44d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbf4aeeacf5d4401884d7bc03bfd8504)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:43.865654 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7219b-87b4-494f-84e9-df15e46dd44d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:43.914551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c8a7219b-87b4-494f-84e9-df15e46dd44d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'request_id': 'req-c8a7219b-87b4-494f-84e9-df15e46dd44d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:43.921197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c8a7219b-87b4-494f-84e9-df15e46dd44d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'request_id': 'req-c8a7219b-87b4-494f-84e9-df15e46dd44d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:43.929010 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c8a7219b-87b4-494f-84e9-df15e46dd44d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbf4aeeacf5d4401884d7bc03bfd8504', 'request_id': 'req-c8a7219b-87b4-494f-84e9-df15e46dd44d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:43.936231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:43.940821 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c8a7219b-87b4-494f-84e9-df15e46dd44d admin admin] The token cache is being invalidate because project dbf4aeeacf5d4401884d7bc03bfd8504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:59:43.941170 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c8a7219b-87b4-494f-84e9-df15e46dd44d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:43.942029 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c8a7219b-87b4-494f-84e9-df15e46dd44d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:59:43.943837 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1208/2384] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 00:59:43 2022] DELETE /identity/v3/projects/dbf4aeeacf5d4401884d7bc03bfd8504 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:59:45.661639 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b9be8-9db5-4e62-b6f3-5e58951a30f5 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:45.662187 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b9be8-9db5-4e62-b6f3-5e58951a30f5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:45.662187 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b9be8-9db5-4e62-b6f3-5e58951a30f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:45.683359 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d55b9be8-9db5-4e62-b6f3-5e58951a30f5 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:45.684693 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d55b9be8-9db5-4e62-b6f3-5e58951a30f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:45.748736 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1177/2385] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Oct 2 00:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:45.776401 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7219b-87b4-494f-84e9-df15e46dd44d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:45.777932 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c8a7219b-87b4-494f-84e9-df15e46dd44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:45.853705 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7219b-87b4-494f-84e9-df15e46dd44d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:45.859295 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52add824-d35f-48ab-b0a6-871b289ddf7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:45.859932 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52add824-d35f-48ab-b0a6-871b289ddf7f service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:45.860214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52add824-d35f-48ab-b0a6-871b289ddf7f service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:45.860490 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52add824-d35f-48ab-b0a6-871b289ddf7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:45.868982 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52add824-d35f-48ab-b0a6-871b289ddf7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:45.870848 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52add824-d35f-48ab-b0a6-871b289ddf7f service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:45.880392 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1209/2386] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:59:48.826391 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72521a7b-5553-4256-b737-cea9f5b08571 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:48.827287 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72521a7b-5553-4256-b737-cea9f5b08571 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:48.827287 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72521a7b-5553-4256-b737-cea9f5b08571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:48.848592 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-72521a7b-5553-4256-b737-cea9f5b08571 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:48.849846 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-72521a7b-5553-4256-b737-cea9f5b08571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:48.859288 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1178/2387] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Oct 2 00:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:59:48.881663 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52add824-d35f-48ab-b0a6-871b289ddf7f service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:59:48.883503 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-52add824-d35f-48ab-b0a6-871b289ddf7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:48.900039 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52add824-d35f-48ab-b0a6-871b289ddf7f service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:59:48.905665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd923be-72ea-42b6-ab07-01bb30b2bce3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:59:48.906263 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd923be-72ea-42b6-ab07-01bb30b2bce3 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:48.906545 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd923be-72ea-42b6-ab07-01bb30b2bce3 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:48.906818 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd923be-72ea-42b6-ab07-01bb30b2bce3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:48.916415 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd923be-72ea-42b6-ab07-01bb30b2bce3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:59:48.918802 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd923be-72ea-42b6-ab07-01bb30b2bce3 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:59:48.929439 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1210/2388] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 00:59:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:59:58.843602 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=9,keystone:SELECT=76,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:58.925074 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=40 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:18.907266 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096f86b-b995-41fe-ae6b-6e33266fa02a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.907815 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096f86b-b995-41fe-ae6b-6e33266fa02a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.908113 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096f86b-b995-41fe-ae6b-6e33266fa02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.927941 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e096f86b-b995-41fe-ae6b-6e33266fa02a None None] MFA Rules not processed for user `5ff136440ace420997181fbf11999496`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:18.929207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e096f86b-b995-41fe-ae6b-6e33266fa02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:18.994568 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1179/2389] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:20.649133 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd923be-72ea-42b6-ab07-01bb30b2bce3 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:20.651245 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9dd923be-72ea-42b6-ab07-01bb30b2bce3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:20.666006 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd923be-72ea-42b6-ab07-01bb30b2bce3 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:20.671993 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df7ea6-df98-4abb-a546-0fe89dbcb9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:20.672746 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df7ea6-df98-4abb-a546-0fe89dbcb9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.673186 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df7ea6-df98-4abb-a546-0fe89dbcb9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.673529 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df7ea6-df98-4abb-a546-0fe89dbcb9ef admin admin] PATH_INFO: `/v3/users/7abd8f370307422880a120981aa4b755` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.675079 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df7ea6-df98-4abb-a546-0fe89dbcb9ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abd8f370307422880a120981aa4b755)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:20.677440 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df7ea6-df98-4abb-a546-0fe89dbcb9ef admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:20.732211 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9df7ea6-df98-4abb-a546-0fe89dbcb9ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abd8f370307422880a120981aa4b755'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:20.738018 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9df7ea6-df98-4abb-a546-0fe89dbcb9ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abd8f370307422880a120981aa4b755'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:20.755985 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9df7ea6-df98-4abb-a546-0fe89dbcb9ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abd8f370307422880a120981aa4b755'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:20.764422 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9df7ea6-df98-4abb-a546-0fe89dbcb9ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abd8f370307422880a120981aa4b755'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:20.765121 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9df7ea6-df98-4abb-a546-0fe89dbcb9ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abd8f370307422880a120981aa4b755'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:20.780051 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1211/2390] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:20 2022] DELETE /identity/v3/users/7abd8f370307422880a120981aa4b755 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:21.020986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096f86b-b995-41fe-ae6b-6e33266fa02a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.034833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096f86b-b995-41fe-ae6b-6e33266fa02a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.108243 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d24fdd-7d95-4a42-ba22-8f23b950dba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.108876 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d24fdd-7d95-4a42-ba22-8f23b950dba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.109228 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d24fdd-7d95-4a42-ba22-8f23b950dba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.109560 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d24fdd-7d95-4a42-ba22-8f23b950dba4 admin admin] PATH_INFO: `/v3/projects/c4bf24ea75824896bf7c33c3037e3654` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.110719 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d24fdd-7d95-4a42-ba22-8f23b950dba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4bf24ea75824896bf7c33c3037e3654)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.112640 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d24fdd-7d95-4a42-ba22-8f23b950dba4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.162964 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c5d24fdd-7d95-4a42-ba22-8f23b950dba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4bf24ea75824896bf7c33c3037e3654', 'request_id': 'req-c5d24fdd-7d95-4a42-ba22-8f23b950dba4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:21.172449 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c5d24fdd-7d95-4a42-ba22-8f23b950dba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4bf24ea75824896bf7c33c3037e3654', 'request_id': 'req-c5d24fdd-7d95-4a42-ba22-8f23b950dba4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:21.182862 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c5d24fdd-7d95-4a42-ba22-8f23b950dba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4bf24ea75824896bf7c33c3037e3654', 'request_id': 'req-c5d24fdd-7d95-4a42-ba22-8f23b950dba4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:21.194975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c5d24fdd-7d95-4a42-ba22-8f23b950dba4 admin admin] The token cache is being invalidate because project c4bf24ea75824896bf7c33c3037e3654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:21.195347 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c5d24fdd-7d95-4a42-ba22-8f23b950dba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:21.196056 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c5d24fdd-7d95-4a42-ba22-8f23b950dba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:21.197634 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1180/2391] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:21 2022] DELETE /identity/v3/projects/c4bf24ea75824896bf7c33c3037e3654 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:21.203244 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20533f64-24dd-4f17-befe-9329a74abe63 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.203827 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20533f64-24dd-4f17-befe-9329a74abe63 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.204198 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20533f64-24dd-4f17-befe-9329a74abe63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.224742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-20533f64-24dd-4f17-befe-9329a74abe63 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:21.226173 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-20533f64-24dd-4f17-befe-9329a74abe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:21.291536 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1212/2392] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:21.299784 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae36bcb-1332-4c8b-91d5-64207e1de7a1 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.300555 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae36bcb-1332-4c8b-91d5-64207e1de7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.300555 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae36bcb-1332-4c8b-91d5-64207e1de7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.321555 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8ae36bcb-1332-4c8b-91d5-64207e1de7a1 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:21.322773 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8ae36bcb-1332-4c8b-91d5-64207e1de7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:21.331772 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1181/2393] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:21.336120 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20533f64-24dd-4f17-befe-9329a74abe63 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.347082 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20533f64-24dd-4f17-befe-9329a74abe63 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.351915 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4084b-2a71-48f6-acfc-233634b6ce0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.352716 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4084b-2a71-48f6-acfc-233634b6ce0f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.353032 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4084b-2a71-48f6-acfc-233634b6ce0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.353305 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4084b-2a71-48f6-acfc-233634b6ce0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.353948 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4084b-2a71-48f6-acfc-233634b6ce0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:21.354246 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4084b-2a71-48f6-acfc-233634b6ce0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.355834 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4084b-2a71-48f6-acfc-233634b6ce0f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.368770 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1213/2394] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:21.373107 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae36bcb-1332-4c8b-91d5-64207e1de7a1 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.382747 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae36bcb-1332-4c8b-91d5-64207e1de7a1 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.387576 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaa722-eb2c-484a-a6e7-6df6f49d12f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.389073 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaa722-eb2c-484a-a6e7-6df6f49d12f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.389547 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaa722-eb2c-484a-a6e7-6df6f49d12f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.389981 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaa722-eb2c-484a-a6e7-6df6f49d12f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.390624 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccaa722-eb2c-484a-a6e7-6df6f49d12f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.392563 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccaa722-eb2c-484a-a6e7-6df6f49d12f0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.428626 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1182/2395] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:21 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:21.432686 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4084b-2a71-48f6-acfc-233634b6ce0f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.443912 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4084b-2a71-48f6-acfc-233634b6ce0f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.506071 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c5ae3-6c03-4422-8f91-82a1d59268da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.506684 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c5ae3-6c03-4422-8f91-82a1d59268da admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.506964 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c5ae3-6c03-4422-8f91-82a1d59268da admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.507236 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c5ae3-6c03-4422-8f91-82a1d59268da admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.507878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c5ae3-6c03-4422-8f91-82a1d59268da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.509884 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c5ae3-6c03-4422-8f91-82a1d59268da admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.520564 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:21.536808 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1214/2396] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:21 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:00:21.542270 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaa722-eb2c-484a-a6e7-6df6f49d12f0 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.555510 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaa722-eb2c-484a-a6e7-6df6f49d12f0 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.562807 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d4671-4d02-4bc3-ae12-e666b145fdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.563459 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d4671-4d02-4bc3-ae12-e666b145fdcc admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.563747 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d4671-4d02-4bc3-ae12-e666b145fdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.564024 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d4671-4d02-4bc3-ae12-e666b145fdcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.564766 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d4671-4d02-4bc3-ae12-e666b145fdcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.566421 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d4671-4d02-4bc3-ae12-e666b145fdcc admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.568068 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:21.580274 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1183/2397] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:21.584140 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c5ae3-6c03-4422-8f91-82a1d59268da admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.594275 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c5ae3-6c03-4422-8f91-82a1d59268da admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.599027 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d1275-2076-47fd-b317-53bffd15fbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.599633 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d1275-2076-47fd-b317-53bffd15fbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.599915 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d1275-2076-47fd-b317-53bffd15fbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.600190 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d1275-2076-47fd-b317-53bffd15fbd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.600853 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d1275-2076-47fd-b317-53bffd15fbd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.602496 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d1275-2076-47fd-b317-53bffd15fbd0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.616222 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1215/2398] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:21.617473 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d4671-4d02-4bc3-ae12-e666b145fdcc admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.628554 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d4671-4d02-4bc3-ae12-e666b145fdcc admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.633367 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23103d34-1136-4d24-a9a3-52dd697c146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.634032 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23103d34-1136-4d24-a9a3-52dd697c146f admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.634316 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23103d34-1136-4d24-a9a3-52dd697c146f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.634591 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23103d34-1136-4d24-a9a3-52dd697c146f admin admin] PATH_INFO: `/v3/projects/a79ddf414b9f4b0aa6a09cd54c747e08/users/9d9b96e5011b41fe8a496252e77f4be6/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.652047 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23103d34-1136-4d24-a9a3-52dd697c146f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79ddf414b9f4b0aa6a09cd54c747e08, user_id=9d9b96e5011b41fe8a496252e77f4be6, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.655021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23103d34-1136-4d24-a9a3-52dd697c146f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.670246 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1184/2399] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:21 2022] PUT /identity/v3/projects/a79ddf414b9f4b0aa6a09cd54c747e08/users/9d9b96e5011b41fe8a496252e77f4be6/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:21.675629 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d8ba0-b8e7-46d6-bef5-99ccbf609cd3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.675629 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d8ba0-b8e7-46d6-bef5-99ccbf609cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.676437 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d8ba0-b8e7-46d6-bef5-99ccbf609cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.697343 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d53d8ba0-b8e7-46d6-bef5-99ccbf609cd3 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:21.698572 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d53d8ba0-b8e7-46d6-bef5-99ccbf609cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:21.773106 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1216/2400] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:00:21.789766 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23103d34-1136-4d24-a9a3-52dd697c146f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.791659 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-23103d34-1136-4d24-a9a3-52dd697c146f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:21.835272 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a97ecf-e208-4cf8-a6f4-9089cd82017f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.835803 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a97ecf-e208-4cf8-a6f4-9089cd82017f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.836243 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a97ecf-e208-4cf8-a6f4-9089cd82017f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.857798 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-30a97ecf-e208-4cf8-a6f4-9089cd82017f None None] MFA Rules not processed for user `c21c29da391b4d78a063dbe50057b6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:21.859029 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-30a97ecf-e208-4cf8-a6f4-9089cd82017f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:21.871430 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23103d34-1136-4d24-a9a3-52dd697c146f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.876294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f1612-fd72-4055-b785-78a799d821dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.876910 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f1612-fd72-4055-b785-78a799d821dd service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.877221 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f1612-fd72-4055-b785-78a799d821dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.877501 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f1612-fd72-4055-b785-78a799d821dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.886986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f1612-fd72-4055-b785-78a799d821dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.888650 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f1612-fd72-4055-b785-78a799d821dd service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.899155 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1185/2401] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:21.920009 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1217/2402] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:00:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:00:27.581669 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055268b-0e01-4572-b8c0-ab9c2dc54389 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:27.582063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055268b-0e01-4572-b8c0-ab9c2dc54389 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:27.582227 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055268b-0e01-4572-b8c0-ab9c2dc54389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:27.647337 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6055268b-0e01-4572-b8c0-ab9c2dc54389 None None] MFA Rules not processed for user `9d9b96e5011b41fe8a496252e77f4be6`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:27.648787 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6055268b-0e01-4572-b8c0-ab9c2dc54389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:27.773558 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1186/2403] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:27.778412 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a97ecf-e208-4cf8-a6f4-9089cd82017f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:27.792343 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a97ecf-e208-4cf8-a6f4-9089cd82017f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:27.798371 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddb325-d2b8-4d7b-8700-0b0ce4ad9f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:27.799460 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddb325-d2b8-4d7b-8700-0b0ce4ad9f95 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:27.799742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddb325-d2b8-4d7b-8700-0b0ce4ad9f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:27.800013 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddb325-d2b8-4d7b-8700-0b0ce4ad9f95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:27.800657 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddb325-d2b8-4d7b-8700-0b0ce4ad9f95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:27.802669 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddb325-d2b8-4d7b-8700-0b0ce4ad9f95 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:27.835172 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1218/2404] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:27 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:27.839182 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055268b-0e01-4572-b8c0-ab9c2dc54389 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:27.853142 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055268b-0e01-4572-b8c0-ab9c2dc54389 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:27.921489 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee5f68-e4d1-4aee-a0c6-f08b83c6910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:27.922106 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee5f68-e4d1-4aee-a0c6-f08b83c6910a admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:27.922381 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee5f68-e4d1-4aee-a0c6-f08b83c6910a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:27.922652 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee5f68-e4d1-4aee-a0c6-f08b83c6910a admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:27.923282 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee5f68-e4d1-4aee-a0c6-f08b83c6910a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:27.925263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee5f68-e4d1-4aee-a0c6-f08b83c6910a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:27.936283 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:27.951528 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1187/2405] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:27 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:27.955639 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddb325-d2b8-4d7b-8700-0b0ce4ad9f95 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:27.966773 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddb325-d2b8-4d7b-8700-0b0ce4ad9f95 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:27.971606 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06741618-bd94-4ca1-8001-f13064fb1a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:27.972308 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06741618-bd94-4ca1-8001-f13064fb1a86 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:27.973272 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06741618-bd94-4ca1-8001-f13064fb1a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:27.973549 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06741618-bd94-4ca1-8001-f13064fb1a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:27.974196 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06741618-bd94-4ca1-8001-f13064fb1a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:27.975810 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06741618-bd94-4ca1-8001-f13064fb1a86 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:27.987157 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1219/2406] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:27.991334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee5f68-e4d1-4aee-a0c6-f08b83c6910a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:28.003918 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee5f68-e4d1-4aee-a0c6-f08b83c6910a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:28.009598 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8349e19-9dec-4478-86fa-b04f21e14f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:28.010477 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8349e19-9dec-4478-86fa-b04f21e14f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:28.010761 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8349e19-9dec-4478-86fa-b04f21e14f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:28.011032 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8349e19-9dec-4478-86fa-b04f21e14f09 admin admin] PATH_INFO: `/v3/projects/a4845cfa017b4ed6a620414d033e1362/users/694139f94dd34239ae244dcd83c1e7af/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:28.029945 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8349e19-9dec-4478-86fa-b04f21e14f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4845cfa017b4ed6a620414d033e1362, user_id=694139f94dd34239ae244dcd83c1e7af, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:28.033146 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8349e19-9dec-4478-86fa-b04f21e14f09 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:28.050998 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1188/2407] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:27 2022] PUT /identity/v3/projects/a4845cfa017b4ed6a620414d033e1362/users/694139f94dd34239ae244dcd83c1e7af/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:00:28.061594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06741618-bd94-4ca1-8001-f13064fb1a86 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:28.072240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06741618-bd94-4ca1-8001-f13064fb1a86 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:28.132247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:28.146395 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f80c8-82b4-495e-91b2-a746a4878ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:28.147197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f80c8-82b4-495e-91b2-a746a4878ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:28.147321 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f80c8-82b4-495e-91b2-a746a4878ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:28.147575 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f80c8-82b4-495e-91b2-a746a4878ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:28.148871 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f80c8-82b4-495e-91b2-a746a4878ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:28.150519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f80c8-82b4-495e-91b2-a746a4878ac4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:28.161759 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1220/2408] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:28.165939 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8349e19-9dec-4478-86fa-b04f21e14f09 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:28.177368 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8349e19-9dec-4478-86fa-b04f21e14f09 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:28.182049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ed424-9a8a-41a7-a30f-071b9a2ca652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:28.182707 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ed424-9a8a-41a7-a30f-071b9a2ca652 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:28.182988 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ed424-9a8a-41a7-a30f-071b9a2ca652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:28.183261 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ed424-9a8a-41a7-a30f-071b9a2ca652 admin admin] PATH_INFO: `/v3/projects/a4845cfa017b4ed6a620414d033e1362/users/694139f94dd34239ae244dcd83c1e7af/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:28.186039 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ed424-9a8a-41a7-a30f-071b9a2ca652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4845cfa017b4ed6a620414d033e1362, user_id=694139f94dd34239ae244dcd83c1e7af, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:28.188713 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ed424-9a8a-41a7-a30f-071b9a2ca652 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:28.199669 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1189/2409] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:28 2022] PUT /identity/v3/projects/a4845cfa017b4ed6a620414d033e1362/users/694139f94dd34239ae244dcd83c1e7af/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:34.545495 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bff184-2ee2-4834-bfa7-f5dbbddd22df None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:34.546387 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bff184-2ee2-4834-bfa7-f5dbbddd22df None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:34.546665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bff184-2ee2-4834-bfa7-f5dbbddd22df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:34.576392 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-60bff184-2ee2-4834-bfa7-f5dbbddd22df None None] MFA Rules not processed for user `694139f94dd34239ae244dcd83c1e7af`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:34.578198 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-60bff184-2ee2-4834-bfa7-f5dbbddd22df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:34.675365 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1221/2410] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:00:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:34.692109 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ed424-9a8a-41a7-a30f-071b9a2ca652 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:34.694464 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1f2ed424-9a8a-41a7-a30f-071b9a2ca652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:34.791608 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ed424-9a8a-41a7-a30f-071b9a2ca652 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:34.798128 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b314b-a729-4c7c-b7f7-3d9d82aeb2cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:34.798968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b314b-a729-4c7c-b7f7-3d9d82aeb2cb service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:34.799316 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b314b-a729-4c7c-b7f7-3d9d82aeb2cb service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:34.799692 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b314b-a729-4c7c-b7f7-3d9d82aeb2cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:34.878819 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b314b-a729-4c7c-b7f7-3d9d82aeb2cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:34.880565 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b314b-a729-4c7c-b7f7-3d9d82aeb2cb service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:34.892804 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1190/2411] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:35.385450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c699e66-2481-42c7-b277-df3dfac45910 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:35.385751 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c699e66-2481-42c7-b277-df3dfac45910 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:35.386026 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c699e66-2481-42c7-b277-df3dfac45910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:35.417791 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6c699e66-2481-42c7-b277-df3dfac45910 None None] MFA Rules not processed for user `1f392d3cac0149b09d4f83e83a930298`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:35.421505 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6c699e66-2481-42c7-b277-df3dfac45910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:35.520335 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1222/2412] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:00:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:36.323250 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051d0ca-da16-4b6d-b0b3-ca8fbae974f6 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:36.323811 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051d0ca-da16-4b6d-b0b3-ca8fbae974f6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:36.323811 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051d0ca-da16-4b6d-b0b3-ca8fbae974f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:36.359107 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-7051d0ca-da16-4b6d-b0b3-ca8fbae974f6 None None] MFA Rules not processed for user `9d9b96e5011b41fe8a496252e77f4be6`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:36.360352 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7051d0ca-da16-4b6d-b0b3-ca8fbae974f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:36.369974 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1191/2413] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:45.507986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=65 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:46.344711 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:INSERT=3,keystone:SELECT=76 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:01.691014 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c699e66-2481-42c7-b277-df3dfac45910 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:01.692486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6c699e66-2481-42c7-b277-df3dfac45910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:01.752160 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c699e66-2481-42c7-b277-df3dfac45910 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:01.756029 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e50fa-2191-45f1-b0d3-c11fc12243b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:01.756636 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e50fa-2191-45f1-b0d3-c11fc12243b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:01.756913 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e50fa-2191-45f1-b0d3-c11fc12243b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:01.757223 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e50fa-2191-45f1-b0d3-c11fc12243b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:01.767101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e50fa-2191-45f1-b0d3-c11fc12243b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:01.768533 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e50fa-2191-45f1-b0d3-c11fc12243b2 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:01.778612 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1223/2414] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:07.874100 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051d0ca-da16-4b6d-b0b3-ca8fbae974f6 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:07.883884 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051d0ca-da16-4b6d-b0b3-ca8fbae974f6 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:07.887494 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2163e-590a-45af-8be4-3ece7a9109f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:07.888091 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2163e-590a-45af-8be4-3ece7a9109f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:07.888407 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2163e-590a-45af-8be4-3ece7a9109f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:07.888680 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2163e-590a-45af-8be4-3ece7a9109f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:07.890431 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-87b2163e-590a-45af-8be4-3ece7a9109f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:07.904393 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2163e-590a-45af-8be4-3ece7a9109f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:07.905903 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2163e-590a-45af-8be4-3ece7a9109f6 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:07.917719 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1192/2415] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:09.110151 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e50fa-2191-45f1-b0d3-c11fc12243b2 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:09.119448 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e50fa-2191-45f1-b0d3-c11fc12243b2 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:09.126406 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57588c-0450-4a37-a97b-452e7faf14c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:09.127030 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57588c-0450-4a37-a97b-452e7faf14c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:09.127313 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57588c-0450-4a37-a97b-452e7faf14c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:09.127585 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57588c-0450-4a37-a97b-452e7faf14c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:09.129549 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ae57588c-0450-4a37-a97b-452e7faf14c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:09.147598 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57588c-0450-4a37-a97b-452e7faf14c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:09.149233 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57588c-0450-4a37-a97b-452e7faf14c7 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:09.164053 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1224/2416] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:01:17.911951 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=6 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:19.158256 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=32 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:25.390545 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2163e-590a-45af-8be4-3ece7a9109f6 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:25.404529 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2163e-590a-45af-8be4-3ece7a9109f6 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:25.408457 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad21ac-ce62-4c08-9e8a-8fc35834d5d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:25.409122 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad21ac-ce62-4c08-9e8a-8fc35834d5d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:25.409404 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad21ac-ce62-4c08-9e8a-8fc35834d5d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:25.409682 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad21ac-ce62-4c08-9e8a-8fc35834d5d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:25.411580 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-32ad21ac-ce62-4c08-9e8a-8fc35834d5d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:25.483834 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad21ac-ce62-4c08-9e8a-8fc35834d5d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:25.485415 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad21ac-ce62-4c08-9e8a-8fc35834d5d7 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:25.498001 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1193/2417] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:26.137044 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57588c-0450-4a37-a97b-452e7faf14c7 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:26.138486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ae57588c-0450-4a37-a97b-452e7faf14c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:26.159708 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57588c-0450-4a37-a97b-452e7faf14c7 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:26.168577 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721153e1-1ce2-4602-9628-9fbc83d04289 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:26.169244 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721153e1-1ce2-4602-9628-9fbc83d04289 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:26.169524 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721153e1-1ce2-4602-9628-9fbc83d04289 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:26.169797 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721153e1-1ce2-4602-9628-9fbc83d04289 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:26.171699 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-721153e1-1ce2-4602-9628-9fbc83d04289 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:26.246340 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721153e1-1ce2-4602-9628-9fbc83d04289 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:26.248084 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721153e1-1ce2-4602-9628-9fbc83d04289 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:26.259726 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1225/2418] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:29.273758 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad21ac-ce62-4c08-9e8a-8fc35834d5d7 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:29.275473 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-32ad21ac-ce62-4c08-9e8a-8fc35834d5d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:29.289579 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad21ac-ce62-4c08-9e8a-8fc35834d5d7 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:29.295984 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60cb30-be95-4625-b62a-b9bab9c5c879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:29.296829 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60cb30-be95-4625-b62a-b9bab9c5c879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:29.297178 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60cb30-be95-4625-b62a-b9bab9c5c879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:29.297456 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60cb30-be95-4625-b62a-b9bab9c5c879 admin admin] PATH_INFO: `/v3/users/5ff136440ace420997181fbf11999496` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:29.298745 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60cb30-be95-4625-b62a-b9bab9c5c879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ff136440ace420997181fbf11999496)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:29.301418 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60cb30-be95-4625-b62a-b9bab9c5c879 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:29.358927 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ea60cb30-be95-4625-b62a-b9bab9c5c879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ff136440ace420997181fbf11999496'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:29.359578 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ea60cb30-be95-4625-b62a-b9bab9c5c879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ff136440ace420997181fbf11999496'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:29.367805 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ea60cb30-be95-4625-b62a-b9bab9c5c879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ff136440ace420997181fbf11999496'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:29.368455 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ea60cb30-be95-4625-b62a-b9bab9c5c879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ff136440ace420997181fbf11999496'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:29.376967 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ea60cb30-be95-4625-b62a-b9bab9c5c879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ff136440ace420997181fbf11999496'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:29.394881 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1194/2419] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:29 2022] DELETE /identity/v3/users/5ff136440ace420997181fbf11999496 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:29.578623 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721153e1-1ce2-4602-9628-9fbc83d04289 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:29.589937 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721153e1-1ce2-4602-9628-9fbc83d04289 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:29.653901 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39205c64-58d9-4031-a851-e647d331d0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:29.654569 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39205c64-58d9-4031-a851-e647d331d0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:29.654854 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39205c64-58d9-4031-a851-e647d331d0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:29.655129 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39205c64-58d9-4031-a851-e647d331d0ff admin admin] PATH_INFO: `/v3/projects/9d154735aabe4f2b966f44f5d2ce92d6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:29.656285 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39205c64-58d9-4031-a851-e647d331d0ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d154735aabe4f2b966f44f5d2ce92d6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:29.658247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39205c64-58d9-4031-a851-e647d331d0ff admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:29.828453 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-39205c64-58d9-4031-a851-e647d331d0ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d154735aabe4f2b966f44f5d2ce92d6', 'request_id': 'req-39205c64-58d9-4031-a851-e647d331d0ff'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:29.834631 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-39205c64-58d9-4031-a851-e647d331d0ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d154735aabe4f2b966f44f5d2ce92d6', 'request_id': 'req-39205c64-58d9-4031-a851-e647d331d0ff'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:29.842439 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-39205c64-58d9-4031-a851-e647d331d0ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d154735aabe4f2b966f44f5d2ce92d6', 'request_id': 'req-39205c64-58d9-4031-a851-e647d331d0ff'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:29.852864 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-39205c64-58d9-4031-a851-e647d331d0ff admin admin] The token cache is being invalidate because project 9d154735aabe4f2b966f44f5d2ce92d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:29.853815 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-39205c64-58d9-4031-a851-e647d331d0ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:29.854448 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-39205c64-58d9-4031-a851-e647d331d0ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:29.857384 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1226/2420] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:29 2022] DELETE /identity/v3/projects/9d154735aabe4f2b966f44f5d2ce92d6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:29.862661 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a2a69-f747-4deb-a4e8-b83921d158d4 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:29.862946 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a2a69-f747-4deb-a4e8-b83921d158d4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:29.863246 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a2a69-f747-4deb-a4e8-b83921d158d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:29.884220 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-c55a2a69-f747-4deb-a4e8-b83921d158d4 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:29.885579 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c55a2a69-f747-4deb-a4e8-b83921d158d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:29.949094 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1195/2421] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:01:29.956819 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5962851-b7e6-4284-9d9c-31511bb90d9b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:29.957232 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5962851-b7e6-4284-9d9c-31511bb90d9b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:29.957578 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5962851-b7e6-4284-9d9c-31511bb90d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:29.981118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e5962851-b7e6-4284-9d9c-31511bb90d9b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:29.982354 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e5962851-b7e6-4284-9d9c-31511bb90d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:29.993527 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1227/2422] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:29.998228 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a2a69-f747-4deb-a4e8-b83921d158d4 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:30.010885 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a2a69-f747-4deb-a4e8-b83921d158d4 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:30.015712 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf7fd9-6dca-4523-aa1e-45f863e96abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:30.016644 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf7fd9-6dca-4523-aa1e-45f863e96abb admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:30.016955 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf7fd9-6dca-4523-aa1e-45f863e96abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:30.017238 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf7fd9-6dca-4523-aa1e-45f863e96abb admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:30.017900 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf7fd9-6dca-4523-aa1e-45f863e96abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:01:30.018198 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf7fd9-6dca-4523-aa1e-45f863e96abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:30.019823 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf7fd9-6dca-4523-aa1e-45f863e96abb admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:30.022006 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:30.040583 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1196/2423] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:01:30.046887 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5962851-b7e6-4284-9d9c-31511bb90d9b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:30.056869 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5962851-b7e6-4284-9d9c-31511bb90d9b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:30.063015 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c41682-e224-4fa4-afb7-b3a391b68b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:30.063696 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c41682-e224-4fa4-afb7-b3a391b68b6a admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:30.063977 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c41682-e224-4fa4-afb7-b3a391b68b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:30.064281 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c41682-e224-4fa4-afb7-b3a391b68b6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:30.064921 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c41682-e224-4fa4-afb7-b3a391b68b6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:30.066995 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c41682-e224-4fa4-afb7-b3a391b68b6a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:30.093155 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:30.100792 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1228/2424] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:30 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:30.107708 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf7fd9-6dca-4523-aa1e-45f863e96abb admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:30.119091 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf7fd9-6dca-4523-aa1e-45f863e96abb admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:30.201341 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519256e-33f1-47e8-8286-7f094a656ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:30.202053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519256e-33f1-47e8-8286-7f094a656ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:30.202348 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519256e-33f1-47e8-8286-7f094a656ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:30.202619 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519256e-33f1-47e8-8286-7f094a656ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:30.203380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519256e-33f1-47e8-8286-7f094a656ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:30.206041 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519256e-33f1-47e8-8286-7f094a656ed7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:30.229780 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1197/2425] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:30 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:01:30.234716 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c41682-e224-4fa4-afb7-b3a391b68b6a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:30.250231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c41682-e224-4fa4-afb7-b3a391b68b6a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:30.257551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496971c-33f9-4a33-a51c-0b3cec75bfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:30.258303 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496971c-33f9-4a33-a51c-0b3cec75bfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:30.258779 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496971c-33f9-4a33-a51c-0b3cec75bfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:30.259048 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496971c-33f9-4a33-a51c-0b3cec75bfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:30.260427 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496971c-33f9-4a33-a51c-0b3cec75bfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:30.262087 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496971c-33f9-4a33-a51c-0b3cec75bfc6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:30.275955 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1229/2426] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:01:30.280381 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519256e-33f1-47e8-8286-7f094a656ed7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:30.291799 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519256e-33f1-47e8-8286-7f094a656ed7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:30.297926 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a78f6-b545-494e-8633-6dd7a236d9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:30.298547 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a78f6-b545-494e-8633-6dd7a236d9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:30.298878 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a78f6-b545-494e-8633-6dd7a236d9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:30.299110 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a78f6-b545-494e-8633-6dd7a236d9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:30.299965 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a78f6-b545-494e-8633-6dd7a236d9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:30.301704 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a78f6-b545-494e-8633-6dd7a236d9c9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:30.313552 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1198/2427] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:30.319347 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496971c-33f9-4a33-a51c-0b3cec75bfc6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:30.332833 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496971c-33f9-4a33-a51c-0b3cec75bfc6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:30.340781 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535c349-31a5-495f-81d8-bc2212bfb7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:30.341750 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535c349-31a5-495f-81d8-bc2212bfb7bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:30.342203 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535c349-31a5-495f-81d8-bc2212bfb7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:30.342815 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535c349-31a5-495f-81d8-bc2212bfb7bf admin admin] PATH_INFO: `/v3/projects/3b55505c96e44c6790ae56842ac5269a/users/3fe1c1254c2b4d98942176ce0c0f2502/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:30.371606 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535c349-31a5-495f-81d8-bc2212bfb7bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b55505c96e44c6790ae56842ac5269a, user_id=3fe1c1254c2b4d98942176ce0c0f2502, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:30.375461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535c349-31a5-495f-81d8-bc2212bfb7bf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:30.393615 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1230/2428] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:30 2022] PUT /identity/v3/projects/3b55505c96e44c6790ae56842ac5269a/users/3fe1c1254c2b4d98942176ce0c0f2502/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:01:30.398772 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab2f23-774d-4077-837b-347fedc62261 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:30.399070 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab2f23-774d-4077-837b-347fedc62261 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:30.399347 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab2f23-774d-4077-837b-347fedc62261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:30.423441 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-85ab2f23-774d-4077-837b-347fedc62261 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:30.424711 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-85ab2f23-774d-4077-837b-347fedc62261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:30.489062 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1199/2429] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:30.499877 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535c349-31a5-495f-81d8-bc2212bfb7bf admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:30.501665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4535c349-31a5-495f-81d8-bc2212bfb7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:30.573406 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535c349-31a5-495f-81d8-bc2212bfb7bf admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:30.578111 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dac79-c841-4a48-b9b9-09d392d5969f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:30.578999 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dac79-c841-4a48-b9b9-09d392d5969f service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:30.579569 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dac79-c841-4a48-b9b9-09d392d5969f service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:30.579762 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dac79-c841-4a48-b9b9-09d392d5969f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:30.593552 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dac79-c841-4a48-b9b9-09d392d5969f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:30.595642 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dac79-c841-4a48-b9b9-09d392d5969f service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:30.612916 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1231/2430] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:34.906786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab2f23-774d-4077-837b-347fedc62261 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:34.911908 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-85ab2f23-774d-4077-837b-347fedc62261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:35.036038 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab2f23-774d-4077-837b-347fedc62261 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:35.047750 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05be87-9a5e-436b-8c3c-6cbe76108bdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:35.048809 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05be87-9a5e-436b-8c3c-6cbe76108bdc service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:35.049541 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05be87-9a5e-436b-8c3c-6cbe76108bdc service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:35.050030 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05be87-9a5e-436b-8c3c-6cbe76108bdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:35.053530 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8d05be87-9a5e-436b-8c3c-6cbe76108bdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:35.072815 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:35.187798 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05be87-9a5e-436b-8c3c-6cbe76108bdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:35.191068 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05be87-9a5e-436b-8c3c-6cbe76108bdc service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:35.209617 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1200/2431] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:01:35.979479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6339a-fb37-46d9-83a9-dbc98dbc4e38 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:35.980028 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6339a-fb37-46d9-83a9-dbc98dbc4e38 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:35.980125 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6339a-fb37-46d9-83a9-dbc98dbc4e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:36.042616 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3ba6339a-fb37-46d9-83a9-dbc98dbc4e38 None None] MFA Rules not processed for user `3fe1c1254c2b4d98942176ce0c0f2502`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:36.043894 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3ba6339a-fb37-46d9-83a9-dbc98dbc4e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:36.161074 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1232/2432] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:36.186913 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05be87-9a5e-436b-8c3c-6cbe76108bdc service nova] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:36.202816 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05be87-9a5e-436b-8c3c-6cbe76108bdc service nova] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:36.210617 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5bf76-b1e6-4511-b90f-ffce36071df3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:36.211308 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5bf76-b1e6-4511-b90f-ffce36071df3 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:36.211611 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5bf76-b1e6-4511-b90f-ffce36071df3 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:36.211874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5bf76-b1e6-4511-b90f-ffce36071df3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:36.223074 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5bf76-b1e6-4511-b90f-ffce36071df3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:36.224861 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5bf76-b1e6-4511-b90f-ffce36071df3 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:36.246406 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1201/2433] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:38.229528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1715c96-b22c-444f-9243-6aafac5e1e6b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:38.230010 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1715c96-b22c-444f-9243-6aafac5e1e6b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:38.230128 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1715c96-b22c-444f-9243-6aafac5e1e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:38.252917 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c1715c96-b22c-444f-9243-6aafac5e1e6b None None] MFA Rules not processed for user `3fe1c1254c2b4d98942176ce0c0f2502`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:38.254467 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c1715c96-b22c-444f-9243-6aafac5e1e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:38.270978 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1233/2434] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:01:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:38.434155 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7e6f5-6f7a-4695-8793-c9b750f8229d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:38.435065 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7e6f5-6f7a-4695-8793-c9b750f8229d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:38.435369 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7e6f5-6f7a-4695-8793-c9b750f8229d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:38.457502 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-23e7e6f5-6f7a-4695-8793-c9b750f8229d None None] MFA Rules not processed for user `42dcae7ba3c241eb8d7d0894aadb467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:38.458725 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-23e7e6f5-6f7a-4695-8793-c9b750f8229d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:38.531095 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1202/2435] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Oct 2 01:01:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:38.593309 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1715c96-b22c-444f-9243-6aafac5e1e6b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:38.594812 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c1715c96-b22c-444f-9243-6aafac5e1e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:38.649473 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7e6f5-6f7a-4695-8793-c9b750f8229d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:38.658963 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7e6f5-6f7a-4695-8793-c9b750f8229d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:38.663862 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:38.669277 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbf8cd-feb8-4797-92cc-da406bf85183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:38.670370 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbf8cd-feb8-4797-92cc-da406bf85183 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:38.670690 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbf8cd-feb8-4797-92cc-da406bf85183 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:38.671051 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbf8cd-feb8-4797-92cc-da406bf85183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:38.674190 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8efbf8cd-feb8-4797-92cc-da406bf85183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:38.687200 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbf8cd-feb8-4797-92cc-da406bf85183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:38.688633 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1715c96-b22c-444f-9243-6aafac5e1e6b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:38.689420 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbf8cd-feb8-4797-92cc-da406bf85183 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:38.694689 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdfa61-f706-4185-a072-3884f1dd1f95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784579d2ddf4cc99fe0e1d109e5cdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:38.696310 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdfa61-f706-4185-a072-3884f1dd1f95 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:38.696731 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdfa61-f706-4185-a072-3884f1dd1f95 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:38.697138 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdfa61-f706-4185-a072-3884f1dd1f95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:38.700035 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1203/2436] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:38.707719 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdfa61-f706-4185-a072-3884f1dd1f95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:38.709843 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdfa61-f706-4185-a072-3884f1dd1f95 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:38.722583 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1234/2437] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Oct 2 01:01:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 01:01:39.186856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbf8cd-feb8-4797-92cc-da406bf85183 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:39.188271 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8efbf8cd-feb8-4797-92cc-da406bf85183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:39.343944 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbf8cd-feb8-4797-92cc-da406bf85183 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:39.351866 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31e014-7938-4f3f-a567-411834844540 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78481cceebd4138b893eba7e51c9c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:39.353625 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31e014-7938-4f3f-a567-411834844540 service placement] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:39.353911 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31e014-7938-4f3f-a567-411834844540 service placement] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:39.354356 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31e014-7938-4f3f-a567-411834844540 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:39.357592 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ac31e014-7938-4f3f-a567-411834844540 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:39.376295 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31e014-7938-4f3f-a567-411834844540 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:39.378334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31e014-7938-4f3f-a567-411834844540 service placement] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:39.403160 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1204/2438] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:42.499428 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdfa61-f706-4185-a072-3884f1dd1f95 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:42.520059 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdfa61-f706-4185-a072-3884f1dd1f95 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:42.528336 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc01b2e-d27e-4a04-b61b-2f3f554383cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:42.529049 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc01b2e-d27e-4a04-b61b-2f3f554383cc service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:42.529327 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc01b2e-d27e-4a04-b61b-2f3f554383cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:42.529591 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc01b2e-d27e-4a04-b61b-2f3f554383cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:42.532141 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4fc01b2e-d27e-4a04-b61b-2f3f554383cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:42.552893 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc01b2e-d27e-4a04-b61b-2f3f554383cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:42.554785 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc01b2e-d27e-4a04-b61b-2f3f554383cc service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:42.572882 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1235/2439] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:01:49.387909 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:52.562107 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=15 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:53.029783 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31e014-7938-4f3f-a567-411834844540 service placement] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:53.030755 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ac31e014-7938-4f3f-a567-411834844540 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:53.050400 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31e014-7938-4f3f-a567-411834844540 service placement] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:53.056776 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606a317-0bd9-4258-8d59-bfca333ccc25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:53.057527 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606a317-0bd9-4258-8d59-bfca333ccc25 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:53.057911 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606a317-0bd9-4258-8d59-bfca333ccc25 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:53.058561 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606a317-0bd9-4258-8d59-bfca333ccc25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:53.060474 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8606a317-0bd9-4258-8d59-bfca333ccc25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:53.075714 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606a317-0bd9-4258-8d59-bfca333ccc25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:53.077717 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606a317-0bd9-4258-8d59-bfca333ccc25 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:53.090523 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1205/2440] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:55.307003 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc01b2e-d27e-4a04-b61b-2f3f554383cc service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:55.320347 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc01b2e-d27e-4a04-b61b-2f3f554383cc service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:55.326755 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa2c95-5707-4b04-9dbb-d8fa93d880cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:55.327386 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa2c95-5707-4b04-9dbb-d8fa93d880cb service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:55.327663 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa2c95-5707-4b04-9dbb-d8fa93d880cb service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:55.327932 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa2c95-5707-4b04-9dbb-d8fa93d880cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:55.329798 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-deaa2c95-5707-4b04-9dbb-d8fa93d880cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:55.344314 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa2c95-5707-4b04-9dbb-d8fa93d880cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:55.345969 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa2c95-5707-4b04-9dbb-d8fa93d880cb service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:55.366387 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1236/2441] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:57.257611 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499c0f4-29c4-488a-86f2-131cb357b552 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:57.259265 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499c0f4-29c4-488a-86f2-131cb357b552 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:57.259679 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499c0f4-29c4-488a-86f2-131cb357b552 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:57.261080 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1206/2442] 10.222.0.26 () {54 vars in 921 bytes} [Sun Oct 2 01:01:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:01:57.269921 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baf833-77fb-4ec9-8095-336ac63e44c1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:57.270477 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baf833-77fb-4ec9-8095-336ac63e44c1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:57.270477 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baf833-77fb-4ec9-8095-336ac63e44c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:57.292226 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e2baf833-77fb-4ec9-8095-336ac63e44c1 None None] MFA Rules not processed for user `81e0396b7ba341ce8d02b1a149786d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:57.293148 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e2baf833-77fb-4ec9-8095-336ac63e44c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:57.302736 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1237/2443] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Oct 2 01:01:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:01:57.314643 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499c0f4-29c4-488a-86f2-131cb357b552 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:57.316489 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7499c0f4-29c4-488a-86f2-131cb357b552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:57.405282 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499c0f4-29c4-488a-86f2-131cb357b552 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:57.410455 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b30b35-bd4a-4063-9538-1bac3a8a4782 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2920ad41c61b401299ca5ae1714b4031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:57.411507 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b30b35-bd4a-4063-9538-1bac3a8a4782 service glance] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:57.411840 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b30b35-bd4a-4063-9538-1bac3a8a4782 service glance] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:57.412421 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b30b35-bd4a-4063-9538-1bac3a8a4782 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:57.438578 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b30b35-bd4a-4063-9538-1bac3a8a4782 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:57.440763 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b30b35-bd4a-4063-9538-1bac3a8a4782 service glance] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:57.454534 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1207/2444] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:57.534465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0eddba-3369-40b0-a686-74abec60cac5 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:57.534853 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0eddba-3369-40b0-a686-74abec60cac5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:57.535184 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0eddba-3369-40b0-a686-74abec60cac5 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:57.536650 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1238/2445] 10.222.0.26 () {54 vars in 921 bytes} [Sun Oct 2 01:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 01:01:57.543358 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfdf51-a99e-42dd-b2b8-31b9b8fe983a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:57.543697 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfdf51-a99e-42dd-b2b8-31b9b8fe983a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:57.543970 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfdf51-a99e-42dd-b2b8-31b9b8fe983a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:57.576653 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-73dfdf51-a99e-42dd-b2b8-31b9b8fe983a None None] MFA Rules not processed for user `5100db0c968c406fa89e117877604c50`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:57.577908 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-73dfdf51-a99e-42dd-b2b8-31b9b8fe983a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:57.584600 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1208/2446] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Oct 2 01:01:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:57.602259 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0eddba-3369-40b0-a686-74abec60cac5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:57.621950 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0eddba-3369-40b0-a686-74abec60cac5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:57.627258 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee0e27-5a7e-4542-8c9a-a337ff49b52f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:57.628253 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee0e27-5a7e-4542-8c9a-a337ff49b52f service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:57.628889 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee0e27-5a7e-4542-8c9a-a337ff49b52f service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:57.629198 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee0e27-5a7e-4542-8c9a-a337ff49b52f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:57.638762 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee0e27-5a7e-4542-8c9a-a337ff49b52f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:57.640213 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee0e27-5a7e-4542-8c9a-a337ff49b52f service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:57.648979 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1239/2447] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:57.745483 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2abe99-b97b-466c-8224-98b3ee672239 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:57.746393 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2abe99-b97b-466c-8224-98b3ee672239 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:57.746740 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2abe99-b97b-466c-8224-98b3ee672239 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:57.748142 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1209/2448] 10.222.0.26 () {54 vars in 921 bytes} [Sun Oct 2 01:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:01:57.755721 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178600f-8e52-4f0c-abea-b64fee56c127 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:57.756091 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178600f-8e52-4f0c-abea-b64fee56c127 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:57.756725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178600f-8e52-4f0c-abea-b64fee56c127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:57.782396 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7178600f-8e52-4f0c-abea-b64fee56c127 None None] MFA Rules not processed for user `81e0396b7ba341ce8d02b1a149786d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:57.783639 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7178600f-8e52-4f0c-abea-b64fee56c127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:57.793854 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1240/2449] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Oct 2 01:01:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:57.806259 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2abe99-b97b-466c-8224-98b3ee672239 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:57.823305 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2abe99-b97b-466c-8224-98b3ee672239 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:57.826916 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff5f36-3e33-4da6-a24b-efbd0918fff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:57.827516 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff5f36-3e33-4da6-a24b-efbd0918fff1 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:57.827793 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff5f36-3e33-4da6-a24b-efbd0918fff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:57.828064 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff5f36-3e33-4da6-a24b-efbd0918fff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:57.839324 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff5f36-3e33-4da6-a24b-efbd0918fff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:57.840838 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff5f36-3e33-4da6-a24b-efbd0918fff1 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:57.853357 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1210/2450] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:59.760814 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f1070-3450-45f4-8cb7-a3c2e067fbd3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:59.761790 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f1070-3450-45f4-8cb7-a3c2e067fbd3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:59.761790 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f1070-3450-45f4-8cb7-a3c2e067fbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:59.799181 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4b0f1070-3450-45f4-8cb7-a3c2e067fbd3 None None] MFA Rules not processed for user `42dcae7ba3c241eb8d7d0894aadb467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:59.800482 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4b0f1070-3450-45f4-8cb7-a3c2e067fbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:59.808634 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1241/2451] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Oct 2 01:01:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:59.822379 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff5f36-3e33-4da6-a24b-efbd0918fff1 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:59.836269 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff5f36-3e33-4da6-a24b-efbd0918fff1 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:59.842707 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f65afb-7dd6-4e41-ab5f-5050e8cf82ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784579d2ddf4cc99fe0e1d109e5cdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:59.843612 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f65afb-7dd6-4e41-ab5f-5050e8cf82ad service swift] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:59.844093 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f65afb-7dd6-4e41-ab5f-5050e8cf82ad service swift] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:59.844446 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f65afb-7dd6-4e41-ab5f-5050e8cf82ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:59.855574 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f65afb-7dd6-4e41-ab5f-5050e8cf82ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:59.857547 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f65afb-7dd6-4e41-ab5f-5050e8cf82ad service swift] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:59.868886 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1211/2452] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Oct 2 01:01:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 01:02:01.078145 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f1070-3450-45f4-8cb7-a3c2e067fbd3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:01.079839 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4b0f1070-3450-45f4-8cb7-a3c2e067fbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:01.093816 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f1070-3450-45f4-8cb7-a3c2e067fbd3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:01.105898 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84963466-2054-4ec7-9ef3-a43f70e836dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:01.106632 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84963466-2054-4ec7-9ef3-a43f70e836dc service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:01.107115 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84963466-2054-4ec7-9ef3-a43f70e836dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:01.107451 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84963466-2054-4ec7-9ef3-a43f70e836dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:01.110063 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-84963466-2054-4ec7-9ef3-a43f70e836dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:01.127307 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84963466-2054-4ec7-9ef3-a43f70e836dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:01.129256 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84963466-2054-4ec7-9ef3-a43f70e836dc service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:01.142148 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1242/2453] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:06.360738 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f65afb-7dd6-4e41-ab5f-5050e8cf82ad service swift] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:06.363260 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-21f65afb-7dd6-4e41-ab5f-5050e8cf82ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:06.380851 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f65afb-7dd6-4e41-ab5f-5050e8cf82ad service swift] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:06.386251 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6817245-0843-423c-8255-4b00a7c6ba54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78481cceebd4138b893eba7e51c9c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:06.386884 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6817245-0843-423c-8255-4b00a7c6ba54 service placement] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:06.387160 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6817245-0843-423c-8255-4b00a7c6ba54 service placement] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:06.387429 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6817245-0843-423c-8255-4b00a7c6ba54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:06.391634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c6817245-0843-423c-8255-4b00a7c6ba54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:06.430407 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84963466-2054-4ec7-9ef3-a43f70e836dc service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:06.431822 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-84963466-2054-4ec7-9ef3-a43f70e836dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:06.432049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6817245-0843-423c-8255-4b00a7c6ba54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:06.434139 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6817245-0843-423c-8255-4b00a7c6ba54 service placement] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:06.457090 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1212/2454] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:06.467310 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84963466-2054-4ec7-9ef3-a43f70e836dc service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:06.474966 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494d668-c857-4ab0-87f7-c3426066afd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:06.475610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494d668-c857-4ab0-87f7-c3426066afd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:06.475923 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494d668-c857-4ab0-87f7-c3426066afd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:06.477819 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494d668-c857-4ab0-87f7-c3426066afd8 admin admin] PATH_INFO: `/v3/users/1f392d3cac0149b09d4f83e83a930298` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:06.479112 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494d668-c857-4ab0-87f7-c3426066afd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f392d3cac0149b09d4f83e83a930298)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:06.481181 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494d668-c857-4ab0-87f7-c3426066afd8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:06.547799 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2494d668-c857-4ab0-87f7-c3426066afd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f392d3cac0149b09d4f83e83a930298'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:06.548913 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2494d668-c857-4ab0-87f7-c3426066afd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f392d3cac0149b09d4f83e83a930298'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:06.569129 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2494d668-c857-4ab0-87f7-c3426066afd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f392d3cac0149b09d4f83e83a930298'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:06.587838 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2494d668-c857-4ab0-87f7-c3426066afd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f392d3cac0149b09d4f83e83a930298'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:06.589420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2494d668-c857-4ab0-87f7-c3426066afd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f392d3cac0149b09d4f83e83a930298'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:06.633064 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1243/2455] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:06 2022] DELETE /identity/v3/users/1f392d3cac0149b09d4f83e83a930298 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:02:07.034548 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6817245-0843-423c-8255-4b00a7c6ba54 service placement] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:07.061362 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6817245-0843-423c-8255-4b00a7c6ba54 service placement] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:07.155908 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f14d1f-4e5b-4af4-99da-e3e1a63860d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:07.156572 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f14d1f-4e5b-4af4-99da-e3e1a63860d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:07.156878 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f14d1f-4e5b-4af4-99da-e3e1a63860d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:07.157175 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f14d1f-4e5b-4af4-99da-e3e1a63860d4 admin admin] PATH_INFO: `/v3/projects/ef3cd95384ef44d58659e77a1cd99e05` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:07.158477 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f14d1f-4e5b-4af4-99da-e3e1a63860d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef3cd95384ef44d58659e77a1cd99e05)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:07.160606 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f14d1f-4e5b-4af4-99da-e3e1a63860d4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:07.223338 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:07.229126 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-05f14d1f-4e5b-4af4-99da-e3e1a63860d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef3cd95384ef44d58659e77a1cd99e05', 'request_id': 'req-05f14d1f-4e5b-4af4-99da-e3e1a63860d4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:07.238273 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-05f14d1f-4e5b-4af4-99da-e3e1a63860d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef3cd95384ef44d58659e77a1cd99e05', 'request_id': 'req-05f14d1f-4e5b-4af4-99da-e3e1a63860d4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:07.249499 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-05f14d1f-4e5b-4af4-99da-e3e1a63860d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef3cd95384ef44d58659e77a1cd99e05', 'request_id': 'req-05f14d1f-4e5b-4af4-99da-e3e1a63860d4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:07.263778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-05f14d1f-4e5b-4af4-99da-e3e1a63860d4 admin admin] The token cache is being invalidate because project ef3cd95384ef44d58659e77a1cd99e05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:07.264074 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-05f14d1f-4e5b-4af4-99da-e3e1a63860d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:07.264763 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-05f14d1f-4e5b-4af4-99da-e3e1a63860d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:07.266301 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1213/2456] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:07 2022] DELETE /identity/v3/projects/ef3cd95384ef44d58659e77a1cd99e05 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:07.272356 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b7538-3d5e-4c4b-8148-0aa86ee56c30 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:07.273143 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b7538-3d5e-4c4b-8148-0aa86ee56c30 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:07.273683 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b7538-3d5e-4c4b-8148-0aa86ee56c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:07.298714 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f89b7538-3d5e-4c4b-8148-0aa86ee56c30 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:07.300710 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f89b7538-3d5e-4c4b-8148-0aa86ee56c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:07.401039 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1244/2457] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:07.409528 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da363240-2afe-4ade-95a4-f83dcfbad699 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:07.410330 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da363240-2afe-4ade-95a4-f83dcfbad699 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:07.410330 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da363240-2afe-4ade-95a4-f83dcfbad699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:07.443803 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-da363240-2afe-4ade-95a4-f83dcfbad699 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:07.446434 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-da363240-2afe-4ade-95a4-f83dcfbad699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:07.461256 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1214/2458] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:07.466187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b7538-3d5e-4c4b-8148-0aa86ee56c30 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:07.478862 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b7538-3d5e-4c4b-8148-0aa86ee56c30 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:07.484277 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ee867-d44e-4f02-b81f-0a5184a3da57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:07.484929 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ee867-d44e-4f02-b81f-0a5184a3da57 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:07.485323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ee867-d44e-4f02-b81f-0a5184a3da57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:07.486257 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ee867-d44e-4f02-b81f-0a5184a3da57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:07.486930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ee867-d44e-4f02-b81f-0a5184a3da57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:02:07.487245 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ee867-d44e-4f02-b81f-0a5184a3da57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:07.488855 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ee867-d44e-4f02-b81f-0a5184a3da57 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:07.503074 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:07.506957 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1245/2459] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:02:07.511457 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da363240-2afe-4ade-95a4-f83dcfbad699 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:07.524712 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da363240-2afe-4ade-95a4-f83dcfbad699 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:07.530217 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554789a3-6898-4b1e-8496-122fa47f1c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:07.530917 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554789a3-6898-4b1e-8496-122fa47f1c9d admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:07.531273 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554789a3-6898-4b1e-8496-122fa47f1c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:07.531621 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554789a3-6898-4b1e-8496-122fa47f1c9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:07.532359 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554789a3-6898-4b1e-8496-122fa47f1c9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:07.534566 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554789a3-6898-4b1e-8496-122fa47f1c9d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:07.579736 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1215/2460] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:07 2022] POST /identity/v3/projects => generated 405 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:07.587373 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ee867-d44e-4f02-b81f-0a5184a3da57 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:07.598520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ee867-d44e-4f02-b81f-0a5184a3da57 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:07.672980 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e186858-3de9-4e29-913d-2c2d236df640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:07.673720 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e186858-3de9-4e29-913d-2c2d236df640 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:07.674327 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e186858-3de9-4e29-913d-2c2d236df640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:07.674824 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e186858-3de9-4e29-913d-2c2d236df640 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:07.675745 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e186858-3de9-4e29-913d-2c2d236df640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:07.678204 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e186858-3de9-4e29-913d-2c2d236df640 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:07.702867 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1246/2461] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:07 2022] POST /identity/v3/users => generated 303 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:07.706930 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554789a3-6898-4b1e-8496-122fa47f1c9d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:07.720047 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554789a3-6898-4b1e-8496-122fa47f1c9d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:07.725870 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb073da-05b3-44af-9ff9-e840b289c1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:07.729468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb073da-05b3-44af-9ff9-e840b289c1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:07.729468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb073da-05b3-44af-9ff9-e840b289c1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:07.729468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb073da-05b3-44af-9ff9-e840b289c1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:07.729468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb073da-05b3-44af-9ff9-e840b289c1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:07.729468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb073da-05b3-44af-9ff9-e840b289c1b4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:07.754883 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1216/2462] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:07.759716 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e186858-3de9-4e29-913d-2c2d236df640 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:07.776437 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e186858-3de9-4e29-913d-2c2d236df640 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:07.783692 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d411b-f08e-4d0c-9d0f-05bf22271412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:07.784375 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d411b-f08e-4d0c-9d0f-05bf22271412 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:07.784667 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d411b-f08e-4d0c-9d0f-05bf22271412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:07.785030 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d411b-f08e-4d0c-9d0f-05bf22271412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:07.785797 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d411b-f08e-4d0c-9d0f-05bf22271412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:07.787640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d411b-f08e-4d0c-9d0f-05bf22271412 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:07.810139 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1247/2463] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:07.815384 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb073da-05b3-44af-9ff9-e840b289c1b4 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:07.827159 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb073da-05b3-44af-9ff9-e840b289c1b4 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:07.840453 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d0246-3985-440a-8c57-63be05cc066b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:07.841281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d0246-3985-440a-8c57-63be05cc066b admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:07.841565 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d0246-3985-440a-8c57-63be05cc066b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:07.841880 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d0246-3985-440a-8c57-63be05cc066b admin admin] PATH_INFO: `/v3/projects/0fdf7cea6c1543ef92f143da010f1eee/users/854135549d214a28aa5ab1c8ec9e29e5/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:07.860157 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d0246-3985-440a-8c57-63be05cc066b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fdf7cea6c1543ef92f143da010f1eee, user_id=854135549d214a28aa5ab1c8ec9e29e5, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:07.863489 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d0246-3985-440a-8c57-63be05cc066b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:07.885960 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1217/2464] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:07 2022] PUT /identity/v3/projects/0fdf7cea6c1543ef92f143da010f1eee/users/854135549d214a28aa5ab1c8ec9e29e5/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:07.902387 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2ff63-0946-4507-8e1c-b90674c8ac3e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:07.903068 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2ff63-0946-4507-8e1c-b90674c8ac3e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:07.903772 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2ff63-0946-4507-8e1c-b90674c8ac3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:07.942573 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a7a2ff63-0946-4507-8e1c-b90674c8ac3e None None] MFA Rules not processed for user `854135549d214a28aa5ab1c8ec9e29e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:07.943602 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a7a2ff63-0946-4507-8e1c-b90674c8ac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:08.038431 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1248/2465] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:07 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:08.043333 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d0246-3985-440a-8c57-63be05cc066b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:08.163427 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d0246-3985-440a-8c57-63be05cc066b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:08.170081 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda03eaf-54ea-4853-bc5a-58bff8fb27f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:08.170943 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda03eaf-54ea-4853-bc5a-58bff8fb27f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:08.171224 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda03eaf-54ea-4853-bc5a-58bff8fb27f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:08.171628 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda03eaf-54ea-4853-bc5a-58bff8fb27f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:08.172548 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda03eaf-54ea-4853-bc5a-58bff8fb27f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:08.175111 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda03eaf-54ea-4853-bc5a-58bff8fb27f5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:08.223649 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1218/2466] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:08 2022] POST /identity/v3/projects => generated 405 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:02:08.228604 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2ff63-0946-4507-8e1c-b90674c8ac3e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:08.260844 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2ff63-0946-4507-8e1c-b90674c8ac3e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:08.340107 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d787f-f496-4be1-84ce-a317dd900d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:08.340692 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d787f-f496-4be1-84ce-a317dd900d9e admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:08.341026 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d787f-f496-4be1-84ce-a317dd900d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:08.341255 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d787f-f496-4be1-84ce-a317dd900d9e admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:08.341928 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d787f-f496-4be1-84ce-a317dd900d9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:08.343894 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d787f-f496-4be1-84ce-a317dd900d9e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:08.362793 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:08.371862 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1249/2467] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:08 2022] POST /identity/v3/users => generated 309 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:02:08.375518 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda03eaf-54ea-4853-bc5a-58bff8fb27f5 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:08.394574 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda03eaf-54ea-4853-bc5a-58bff8fb27f5 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:08.400086 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc7d04-be6c-4849-898e-5b58db2803f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:08.400814 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc7d04-be6c-4849-898e-5b58db2803f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:08.401126 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc7d04-be6c-4849-898e-5b58db2803f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:08.401405 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc7d04-be6c-4849-898e-5b58db2803f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:08.402052 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc7d04-be6c-4849-898e-5b58db2803f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:08.403719 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc7d04-be6c-4849-898e-5b58db2803f1 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:08.417101 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1219/2468] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:08.421271 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d787f-f496-4be1-84ce-a317dd900d9e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:08.432596 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d787f-f496-4be1-84ce-a317dd900d9e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:08.438156 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89334643-8ca5-4fd6-a38c-56e2c9fb4e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:08.438806 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89334643-8ca5-4fd6-a38c-56e2c9fb4e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:08.439078 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89334643-8ca5-4fd6-a38c-56e2c9fb4e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:08.439364 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89334643-8ca5-4fd6-a38c-56e2c9fb4e02 admin admin] PATH_INFO: `/v3/projects/32ca69dfdc554b5eb292b84ed79f5edf/users/76b6e1f7529b423ab1e3dcb9cfc671d7/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:08.459099 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89334643-8ca5-4fd6-a38c-56e2c9fb4e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ca69dfdc554b5eb292b84ed79f5edf, user_id=76b6e1f7529b423ab1e3dcb9cfc671d7, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:08.461953 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89334643-8ca5-4fd6-a38c-56e2c9fb4e02 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:08.484082 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1250/2469] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:08 2022] PUT /identity/v3/projects/32ca69dfdc554b5eb292b84ed79f5edf/users/76b6e1f7529b423ab1e3dcb9cfc671d7/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:08.487082 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc7d04-be6c-4849-898e-5b58db2803f1 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:08.498585 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc7d04-be6c-4849-898e-5b58db2803f1 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:08.543950 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:08.567039 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b757f-324a-426c-8a25-6182b6712a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:08.567671 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b757f-324a-426c-8a25-6182b6712a8d admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:08.567981 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b757f-324a-426c-8a25-6182b6712a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:08.568304 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b757f-324a-426c-8a25-6182b6712a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:08.573569 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b757f-324a-426c-8a25-6182b6712a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:08.575446 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b757f-324a-426c-8a25-6182b6712a8d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:08.586898 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1220/2470] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:08.591629 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89334643-8ca5-4fd6-a38c-56e2c9fb4e02 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:08.604082 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89334643-8ca5-4fd6-a38c-56e2c9fb4e02 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:08.608910 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448c6a1-6914-44ec-98ed-c5fef0513c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:08.609679 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448c6a1-6914-44ec-98ed-c5fef0513c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:08.610029 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448c6a1-6914-44ec-98ed-c5fef0513c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:08.610371 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448c6a1-6914-44ec-98ed-c5fef0513c25 admin admin] PATH_INFO: `/v3/projects/32ca69dfdc554b5eb292b84ed79f5edf/users/76b6e1f7529b423ab1e3dcb9cfc671d7/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:08.612637 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448c6a1-6914-44ec-98ed-c5fef0513c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ca69dfdc554b5eb292b84ed79f5edf, user_id=76b6e1f7529b423ab1e3dcb9cfc671d7, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:08.615402 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448c6a1-6914-44ec-98ed-c5fef0513c25 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:08.626990 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1251/2471] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:08 2022] PUT /identity/v3/projects/32ca69dfdc554b5eb292b84ed79f5edf/users/76b6e1f7529b423ab1e3dcb9cfc671d7/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:08.637779 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8146fec-96ae-4b14-8c39-b8efebda2c8f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:08.638068 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8146fec-96ae-4b14-8c39-b8efebda2c8f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:08.638345 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8146fec-96ae-4b14-8c39-b8efebda2c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:08.668568 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-c8146fec-96ae-4b14-8c39-b8efebda2c8f None None] MFA Rules not processed for user `76b6e1f7529b423ab1e3dcb9cfc671d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:08.669848 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c8146fec-96ae-4b14-8c39-b8efebda2c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:08.745468 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1221/2472] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:08 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:08.756240 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448c6a1-6914-44ec-98ed-c5fef0513c25 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:08.758138 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3448c6a1-6914-44ec-98ed-c5fef0513c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:08.827515 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448c6a1-6914-44ec-98ed-c5fef0513c25 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:08.831331 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bce129-ca86-4695-9ba8-5ce7e78aee72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:08.831945 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bce129-ca86-4695-9ba8-5ce7e78aee72 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:08.832258 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bce129-ca86-4695-9ba8-5ce7e78aee72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:08.832528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bce129-ca86-4695-9ba8-5ce7e78aee72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:08.843473 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bce129-ca86-4695-9ba8-5ce7e78aee72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:08.845048 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bce129-ca86-4695-9ba8-5ce7e78aee72 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:08.855277 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1252/2473] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:08 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:09.013995 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8146fec-96ae-4b14-8c39-b8efebda2c8f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:09.213461 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8146fec-96ae-4b14-8c39-b8efebda2c8f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:09.218411 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae31482-cc71-41ea-afe3-fe451f863ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:09.219198 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae31482-cc71-41ea-afe3-fe451f863ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:09.219485 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae31482-cc71-41ea-afe3-fe451f863ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:09.219757 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae31482-cc71-41ea-afe3-fe451f863ec6 admin admin] PATH_INFO: `/v3/users/854135549d214a28aa5ab1c8ec9e29e5` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:09.220908 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae31482-cc71-41ea-afe3-fe451f863ec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=854135549d214a28aa5ab1c8ec9e29e5)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:09.222894 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae31482-cc71-41ea-afe3-fe451f863ec6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:09.291817 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-aae31482-cc71-41ea-afe3-fe451f863ec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '854135549d214a28aa5ab1c8ec9e29e5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:09.292555 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-aae31482-cc71-41ea-afe3-fe451f863ec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '854135549d214a28aa5ab1c8ec9e29e5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:09.299715 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-aae31482-cc71-41ea-afe3-fe451f863ec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '854135549d214a28aa5ab1c8ec9e29e5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:09.300521 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-aae31482-cc71-41ea-afe3-fe451f863ec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '854135549d214a28aa5ab1c8ec9e29e5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:09.308746 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-aae31482-cc71-41ea-afe3-fe451f863ec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '854135549d214a28aa5ab1c8ec9e29e5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:09.314326 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:09.331160 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1222/2474] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:09 2022] DELETE /identity/v3/users/854135549d214a28aa5ab1c8ec9e29e5 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:09.336597 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e6dce-ab72-4eea-975c-d1d6be1379af None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:09.337142 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e6dce-ab72-4eea-975c-d1d6be1379af None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:09.337332 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e6dce-ab72-4eea-975c-d1d6be1379af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:09.356866 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f67e6dce-ab72-4eea-975c-d1d6be1379af None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:09.358095 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f67e6dce-ab72-4eea-975c-d1d6be1379af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:09.422953 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1253/2475] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:09.432874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae31482-cc71-41ea-afe3-fe451f863ec6 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:09.434349 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-aae31482-cc71-41ea-afe3-fe451f863ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:09.511791 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae31482-cc71-41ea-afe3-fe451f863ec6 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:09.515501 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab049543-a7a7-4bf2-a05d-476b22f39727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:09.516107 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab049543-a7a7-4bf2-a05d-476b22f39727 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:09.516387 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab049543-a7a7-4bf2-a05d-476b22f39727 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:09.516658 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab049543-a7a7-4bf2-a05d-476b22f39727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:09.526256 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab049543-a7a7-4bf2-a05d-476b22f39727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:09.527689 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab049543-a7a7-4bf2-a05d-476b22f39727 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:09.537621 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1223/2476] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:09.811071 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e6dce-ab72-4eea-975c-d1d6be1379af None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:09.812549 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f67e6dce-ab72-4eea-975c-d1d6be1379af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:09.826500 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e6dce-ab72-4eea-975c-d1d6be1379af None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:09.832187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82aa21-2945-45a5-9510-73ec1ffa2ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:09.832825 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82aa21-2945-45a5-9510-73ec1ffa2ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:09.833157 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82aa21-2945-45a5-9510-73ec1ffa2ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:09.834125 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82aa21-2945-45a5-9510-73ec1ffa2ec0 admin admin] PATH_INFO: `/v3/projects/0fdf7cea6c1543ef92f143da010f1eee` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:09.834756 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82aa21-2945-45a5-9510-73ec1ffa2ec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fdf7cea6c1543ef92f143da010f1eee)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:09.838667 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82aa21-2945-45a5-9510-73ec1ffa2ec0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:09.900389 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bf82aa21-2945-45a5-9510-73ec1ffa2ec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fdf7cea6c1543ef92f143da010f1eee', 'request_id': 'req-bf82aa21-2945-45a5-9510-73ec1ffa2ec0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:09.906893 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bf82aa21-2945-45a5-9510-73ec1ffa2ec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fdf7cea6c1543ef92f143da010f1eee', 'request_id': 'req-bf82aa21-2945-45a5-9510-73ec1ffa2ec0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:09.910649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:09.915806 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bf82aa21-2945-45a5-9510-73ec1ffa2ec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fdf7cea6c1543ef92f143da010f1eee', 'request_id': 'req-bf82aa21-2945-45a5-9510-73ec1ffa2ec0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:09.927459 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bf82aa21-2945-45a5-9510-73ec1ffa2ec0 admin admin] The token cache is being invalidate because project 0fdf7cea6c1543ef92f143da010f1eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:09.927748 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bf82aa21-2945-45a5-9510-73ec1ffa2ec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:09.928392 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bf82aa21-2945-45a5-9510-73ec1ffa2ec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:09.930859 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1254/2477] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:09 2022] DELETE /identity/v3/projects/0fdf7cea6c1543ef92f143da010f1eee => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:09.935757 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab049543-a7a7-4bf2-a05d-476b22f39727 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:09.945714 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab049543-a7a7-4bf2-a05d-476b22f39727 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:10.006179 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2fded-1f7d-4dd2-940b-27cc451213da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:10.006826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2fded-1f7d-4dd2-940b-27cc451213da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:10.007126 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2fded-1f7d-4dd2-940b-27cc451213da admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:10.007417 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2fded-1f7d-4dd2-940b-27cc451213da admin admin] PATH_INFO: `/v3/users/76b6e1f7529b423ab1e3dcb9cfc671d7` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:10.008593 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2fded-1f7d-4dd2-940b-27cc451213da admin admin] RBAC: Authorizing `identity:delete_user(user_id=76b6e1f7529b423ab1e3dcb9cfc671d7)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:10.010660 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2fded-1f7d-4dd2-940b-27cc451213da admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:10.058781 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-21a2fded-1f7d-4dd2-940b-27cc451213da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76b6e1f7529b423ab1e3dcb9cfc671d7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:10.059369 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-21a2fded-1f7d-4dd2-940b-27cc451213da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76b6e1f7529b423ab1e3dcb9cfc671d7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:10.068250 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-21a2fded-1f7d-4dd2-940b-27cc451213da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76b6e1f7529b423ab1e3dcb9cfc671d7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:10.068925 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-21a2fded-1f7d-4dd2-940b-27cc451213da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76b6e1f7529b423ab1e3dcb9cfc671d7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:10.077079 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-21a2fded-1f7d-4dd2-940b-27cc451213da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76b6e1f7529b423ab1e3dcb9cfc671d7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:10.095949 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1224/2478] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:09 2022] DELETE /identity/v3/users/76b6e1f7529b423ab1e3dcb9cfc671d7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:10.409803 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82aa21-2945-45a5-9510-73ec1ffa2ec0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:10.417260 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bf82aa21-2945-45a5-9510-73ec1ffa2ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:10.443704 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82aa21-2945-45a5-9510-73ec1ffa2ec0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:10.561363 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534724b-f6ad-4fdf-afc4-5e09f6beeedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:10.562005 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534724b-f6ad-4fdf-afc4-5e09f6beeedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:10.562287 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534724b-f6ad-4fdf-afc4-5e09f6beeedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:10.562617 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534724b-f6ad-4fdf-afc4-5e09f6beeedb admin admin] PATH_INFO: `/v3/projects/32ca69dfdc554b5eb292b84ed79f5edf` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:10.563807 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534724b-f6ad-4fdf-afc4-5e09f6beeedb admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ca69dfdc554b5eb292b84ed79f5edf)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:10.565890 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534724b-f6ad-4fdf-afc4-5e09f6beeedb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:10.617233 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f534724b-f6ad-4fdf-afc4-5e09f6beeedb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ca69dfdc554b5eb292b84ed79f5edf', 'request_id': 'req-f534724b-f6ad-4fdf-afc4-5e09f6beeedb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:10.623588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f534724b-f6ad-4fdf-afc4-5e09f6beeedb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ca69dfdc554b5eb292b84ed79f5edf', 'request_id': 'req-f534724b-f6ad-4fdf-afc4-5e09f6beeedb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:10.631466 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f534724b-f6ad-4fdf-afc4-5e09f6beeedb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ca69dfdc554b5eb292b84ed79f5edf', 'request_id': 'req-f534724b-f6ad-4fdf-afc4-5e09f6beeedb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:10.643744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f534724b-f6ad-4fdf-afc4-5e09f6beeedb admin admin] The token cache is being invalidate because project 32ca69dfdc554b5eb292b84ed79f5edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:10.644063 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f534724b-f6ad-4fdf-afc4-5e09f6beeedb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:10.644769 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f534724b-f6ad-4fdf-afc4-5e09f6beeedb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:10.646344 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1255/2479] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:10 2022] DELETE /identity/v3/projects/32ca69dfdc554b5eb292b84ed79f5edf => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:10.652193 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda10a63-99d5-4e18-8cb4-89443bc8a6d2 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:10.652679 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda10a63-99d5-4e18-8cb4-89443bc8a6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:10.652778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda10a63-99d5-4e18-8cb4-89443bc8a6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:10.667686 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:10.673593 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-bda10a63-99d5-4e18-8cb4-89443bc8a6d2 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:10.675588 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-bda10a63-99d5-4e18-8cb4-89443bc8a6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:10.739318 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1225/2480] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:10.747949 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f8b19-0404-4f80-a5e4-067503eddc38 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:10.748231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f8b19-0404-4f80-a5e4-067503eddc38 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:10.748505 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f8b19-0404-4f80-a5e4-067503eddc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:10.768965 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-531f8b19-0404-4f80-a5e4-067503eddc38 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:10.770189 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-531f8b19-0404-4f80-a5e4-067503eddc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:10.778992 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1256/2481] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:10.784049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda10a63-99d5-4e18-8cb4-89443bc8a6d2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:10.794699 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda10a63-99d5-4e18-8cb4-89443bc8a6d2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:10.799667 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ea03c-dc08-46ff-8dc3-ff68187a3f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:10.800303 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ea03c-dc08-46ff-8dc3-ff68187a3f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:10.800585 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ea03c-dc08-46ff-8dc3-ff68187a3f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:10.800884 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ea03c-dc08-46ff-8dc3-ff68187a3f5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:10.801570 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ea03c-dc08-46ff-8dc3-ff68187a3f5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:02:10.801872 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ea03c-dc08-46ff-8dc3-ff68187a3f5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:10.803543 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ea03c-dc08-46ff-8dc3-ff68187a3f5e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:10.817058 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1226/2482] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:02:10.822903 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f8b19-0404-4f80-a5e4-067503eddc38 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:10.832528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f8b19-0404-4f80-a5e4-067503eddc38 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:10.838275 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74bfcc-5b9f-42da-911a-501d934ae3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:10.838891 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74bfcc-5b9f-42da-911a-501d934ae3da admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:10.839167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74bfcc-5b9f-42da-911a-501d934ae3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:10.839432 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74bfcc-5b9f-42da-911a-501d934ae3da admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:10.840074 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74bfcc-5b9f-42da-911a-501d934ae3da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:10.842039 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74bfcc-5b9f-42da-911a-501d934ae3da admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:10.871522 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1257/2483] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:10 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:10.876078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ea03c-dc08-46ff-8dc3-ff68187a3f5e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:10.887690 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ea03c-dc08-46ff-8dc3-ff68187a3f5e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:10.949930 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a714bf-4356-43de-9d44-1f71e03decc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:10.950539 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a714bf-4356-43de-9d44-1f71e03decc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:10.950820 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a714bf-4356-43de-9d44-1f71e03decc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:10.951095 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a714bf-4356-43de-9d44-1f71e03decc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:10.951724 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a714bf-4356-43de-9d44-1f71e03decc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:10.953702 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a714bf-4356-43de-9d44-1f71e03decc7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:10.976053 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1227/2484] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:10 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:02:10.980742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74bfcc-5b9f-42da-911a-501d934ae3da admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:10.991081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74bfcc-5b9f-42da-911a-501d934ae3da admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:10.996904 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d7a15-f7e0-42b2-b96c-cccc4073537c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:10.997521 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d7a15-f7e0-42b2-b96c-cccc4073537c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:10.997796 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d7a15-f7e0-42b2-b96c-cccc4073537c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:10.998069 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d7a15-f7e0-42b2-b96c-cccc4073537c admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:10.998699 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d7a15-f7e0-42b2-b96c-cccc4073537c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:11.000271 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d7a15-f7e0-42b2-b96c-cccc4073537c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:11.011119 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1258/2485] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:02:11.015240 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a714bf-4356-43de-9d44-1f71e03decc7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:11.025479 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a714bf-4356-43de-9d44-1f71e03decc7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:11.030118 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6ae1c-dd40-42b8-add6-18b7caf19c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:11.030706 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6ae1c-dd40-42b8-add6-18b7caf19c8a admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:11.030984 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6ae1c-dd40-42b8-add6-18b7caf19c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:11.031255 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6ae1c-dd40-42b8-add6-18b7caf19c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:11.031884 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6ae1c-dd40-42b8-add6-18b7caf19c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:11.033530 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6ae1c-dd40-42b8-add6-18b7caf19c8a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:11.043854 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1228/2486] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:11.048239 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d7a15-f7e0-42b2-b96c-cccc4073537c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:11.058809 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d7a15-f7e0-42b2-b96c-cccc4073537c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:11.063343 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6f89a-3b63-4546-914d-b4a79b1f3654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:11.063981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6f89a-3b63-4546-914d-b4a79b1f3654 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:11.064258 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6f89a-3b63-4546-914d-b4a79b1f3654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:11.064528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6f89a-3b63-4546-914d-b4a79b1f3654 admin admin] PATH_INFO: `/v3/projects/04fbfa6812b94a4296c2169b2b0a0362/users/751cfd4e232e4db8aacf69431c3ea6c6/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:11.081583 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6f89a-3b63-4546-914d-b4a79b1f3654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04fbfa6812b94a4296c2169b2b0a0362, user_id=751cfd4e232e4db8aacf69431c3ea6c6, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:11.084113 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6f89a-3b63-4546-914d-b4a79b1f3654 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:11.098700 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1259/2487] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:11 2022] PUT /identity/v3/projects/04fbfa6812b94a4296c2169b2b0a0362/users/751cfd4e232e4db8aacf69431c3ea6c6/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:11.112178 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886537f0-8c05-43a1-9332-dc29150bd0a6 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:11.112490 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886537f0-8c05-43a1-9332-dc29150bd0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:11.112764 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886537f0-8c05-43a1-9332-dc29150bd0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:11.142210 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-886537f0-8c05-43a1-9332-dc29150bd0a6 None None] MFA Rules not processed for user `751cfd4e232e4db8aacf69431c3ea6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:11.143424 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-886537f0-8c05-43a1-9332-dc29150bd0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:11.216252 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1229/2488] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:11.220995 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6f89a-3b63-4546-914d-b4a79b1f3654 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:11.235353 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:11.289480 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6f89a-3b63-4546-914d-b4a79b1f3654 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:11.294231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d6ca2-1c4a-4722-a655-85d2246452f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:11.294833 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d6ca2-1c4a-4722-a655-85d2246452f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:11.295120 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d6ca2-1c4a-4722-a655-85d2246452f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:11.295417 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d6ca2-1c4a-4722-a655-85d2246452f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:11.296054 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d6ca2-1c4a-4722-a655-85d2246452f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:11.297999 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d6ca2-1c4a-4722-a655-85d2246452f6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:11.330415 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1260/2489] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:11 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:11.334776 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886537f0-8c05-43a1-9332-dc29150bd0a6 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:11.346823 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:11.355497 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886537f0-8c05-43a1-9332-dc29150bd0a6 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:11.417392 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1946e-fdea-4abb-8c8d-7547d537dab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:11.418046 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1946e-fdea-4abb-8c8d-7547d537dab3 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:11.418402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1946e-fdea-4abb-8c8d-7547d537dab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:11.418727 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1946e-fdea-4abb-8c8d-7547d537dab3 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:11.419414 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1946e-fdea-4abb-8c8d-7547d537dab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:11.421525 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1946e-fdea-4abb-8c8d-7547d537dab3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:11.445555 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1230/2490] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:11 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:11.449913 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d6ca2-1c4a-4722-a655-85d2246452f6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:11.461424 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d6ca2-1c4a-4722-a655-85d2246452f6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:11.466762 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f92e41-c31f-4d5e-b2da-5640e0e17a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:11.467482 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f92e41-c31f-4d5e-b2da-5640e0e17a89 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:11.467763 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f92e41-c31f-4d5e-b2da-5640e0e17a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:11.468031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f92e41-c31f-4d5e-b2da-5640e0e17a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:11.469404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f92e41-c31f-4d5e-b2da-5640e0e17a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:11.471202 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f92e41-c31f-4d5e-b2da-5640e0e17a89 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:11.483372 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1261/2491] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:11.487682 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1946e-fdea-4abb-8c8d-7547d537dab3 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:11.499961 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1946e-fdea-4abb-8c8d-7547d537dab3 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:11.506138 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0dc7c-b069-49f5-b5d0-d57a276eca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:11.506834 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0dc7c-b069-49f5-b5d0-d57a276eca39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:11.507765 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0dc7c-b069-49f5-b5d0-d57a276eca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:11.508082 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0dc7c-b069-49f5-b5d0-d57a276eca39 admin admin] PATH_INFO: `/v3/projects/3200a15622f5418cac1c4419096ef6af/users/b19aef8986464e9ead473b231e0cb3aa/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:11.528015 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0dc7c-b069-49f5-b5d0-d57a276eca39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3200a15622f5418cac1c4419096ef6af, user_id=b19aef8986464e9ead473b231e0cb3aa, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:11.530741 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0dc7c-b069-49f5-b5d0-d57a276eca39 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:11.546733 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1231/2492] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:11 2022] PUT /identity/v3/projects/3200a15622f5418cac1c4419096ef6af/users/b19aef8986464e9ead473b231e0cb3aa/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:11.551351 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f92e41-c31f-4d5e-b2da-5640e0e17a89 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:11.562323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f92e41-c31f-4d5e-b2da-5640e0e17a89 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:11.637713 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bd79b-4530-4161-9917-3eb16400cf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:11.638338 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bd79b-4530-4161-9917-3eb16400cf68 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:11.638643 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bd79b-4530-4161-9917-3eb16400cf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:11.638920 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bd79b-4530-4161-9917-3eb16400cf68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:11.639578 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bd79b-4530-4161-9917-3eb16400cf68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:11.641290 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bd79b-4530-4161-9917-3eb16400cf68 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:11.654542 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1262/2493] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:11.659455 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0dc7c-b069-49f5-b5d0-d57a276eca39 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:11.671612 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0dc7c-b069-49f5-b5d0-d57a276eca39 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:11.678721 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9ef0a-1746-4b82-9d05-a82cbf841019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:11.679570 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9ef0a-1746-4b82-9d05-a82cbf841019 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:11.679926 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9ef0a-1746-4b82-9d05-a82cbf841019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:11.680639 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9ef0a-1746-4b82-9d05-a82cbf841019 admin admin] PATH_INFO: `/v3/projects/3200a15622f5418cac1c4419096ef6af/users/b19aef8986464e9ead473b231e0cb3aa/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:11.682657 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9ef0a-1746-4b82-9d05-a82cbf841019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3200a15622f5418cac1c4419096ef6af, user_id=b19aef8986464e9ead473b231e0cb3aa, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:11.685738 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9ef0a-1746-4b82-9d05-a82cbf841019 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:11.700059 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1232/2494] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:11 2022] PUT /identity/v3/projects/3200a15622f5418cac1c4419096ef6af/users/b19aef8986464e9ead473b231e0cb3aa/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:11.710817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb62d4-3b61-43eb-824a-78ce8cd480b5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:11.711177 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb62d4-3b61-43eb-824a-78ce8cd480b5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:11.711369 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb62d4-3b61-43eb-824a-78ce8cd480b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:11.742941 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bcfb62d4-3b61-43eb-824a-78ce8cd480b5 None None] MFA Rules not processed for user `b19aef8986464e9ead473b231e0cb3aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:11.745620 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bcfb62d4-3b61-43eb-824a-78ce8cd480b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:11.818950 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1263/2495] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:11.831579 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9ef0a-1746-4b82-9d05-a82cbf841019 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:11.833466 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-87f9ef0a-1746-4b82-9d05-a82cbf841019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:11.895226 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9ef0a-1746-4b82-9d05-a82cbf841019 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:11.899157 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86520349-09c4-4935-9583-444fd83dcc1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:11.899793 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86520349-09c4-4935-9583-444fd83dcc1a service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:11.900073 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86520349-09c4-4935-9583-444fd83dcc1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:11.900345 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86520349-09c4-4935-9583-444fd83dcc1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:11.910666 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86520349-09c4-4935-9583-444fd83dcc1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:11.912120 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86520349-09c4-4935-9583-444fd83dcc1a service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:11.922475 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1233/2496] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:12.012255 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb62d4-3b61-43eb-824a-78ce8cd480b5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:12.023682 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb62d4-3b61-43eb-824a-78ce8cd480b5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:12.027445 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fd755-e976-4fb4-8810-a70df9d4f655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:12.028081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fd755-e976-4fb4-8810-a70df9d4f655 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:12.028363 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fd755-e976-4fb4-8810-a70df9d4f655 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:12.028637 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fd755-e976-4fb4-8810-a70df9d4f655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:12.035174 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:12.098867 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085fd755-e976-4fb4-8810-a70df9d4f655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:12.100326 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085fd755-e976-4fb4-8810-a70df9d4f655 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:12.111981 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1264/2497] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:13.686543 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86520349-09c4-4935-9583-444fd83dcc1a service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:13.688142 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-86520349-09c4-4935-9583-444fd83dcc1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:13.754945 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:13.776450 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86520349-09c4-4935-9583-444fd83dcc1a service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:13.782113 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4576e7d-4bd3-40e7-b317-cddae3da645f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:13.782719 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4576e7d-4bd3-40e7-b317-cddae3da645f service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:13.782998 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4576e7d-4bd3-40e7-b317-cddae3da645f service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:13.783272 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4576e7d-4bd3-40e7-b317-cddae3da645f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:13.785053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e4576e7d-4bd3-40e7-b317-cddae3da645f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:13.797590 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4576e7d-4bd3-40e7-b317-cddae3da645f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:13.799185 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4576e7d-4bd3-40e7-b317-cddae3da645f service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:13.809843 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1234/2498] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:15.735983 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a896e2-3f32-401d-8bc0-63f34d2cedfe None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:15.736485 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a896e2-3f32-401d-8bc0-63f34d2cedfe None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:15.736584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a896e2-3f32-401d-8bc0-63f34d2cedfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:15.758554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c8a896e2-3f32-401d-8bc0-63f34d2cedfe None None] MFA Rules not processed for user `42dcae7ba3c241eb8d7d0894aadb467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:15.759791 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c8a896e2-3f32-401d-8bc0-63f34d2cedfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:15.817473 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1265/2499] 10.222.0.26 () {58 vars in 967 bytes} [Sun Oct 2 01:02:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:15.830432 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4576e7d-4bd3-40e7-b317-cddae3da645f service nova] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:15.831853 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e4576e7d-4bd3-40e7-b317-cddae3da645f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:15.906194 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4576e7d-4bd3-40e7-b317-cddae3da645f service nova] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:15.911191 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172dbe2-33c6-4e43-94e0-5a765e1d9779 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784579d2ddf4cc99fe0e1d109e5cdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:15.911800 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172dbe2-33c6-4e43-94e0-5a765e1d9779 service swift] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:15.912076 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172dbe2-33c6-4e43-94e0-5a765e1d9779 service swift] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:15.912345 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172dbe2-33c6-4e43-94e0-5a765e1d9779 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:15.921565 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172dbe2-33c6-4e43-94e0-5a765e1d9779 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:15.923159 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172dbe2-33c6-4e43-94e0-5a765e1d9779 service swift] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:15.932961 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1235/2500] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Oct 2 01:02:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:02:19.134088 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a896e2-3f32-401d-8bc0-63f34d2cedfe None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:19.200270 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a896e2-3f32-401d-8bc0-63f34d2cedfe None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:19.204812 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb0998-0638-49ec-9576-96a20f613329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:19.205468 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb0998-0638-49ec-9576-96a20f613329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:19.205748 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb0998-0638-49ec-9576-96a20f613329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:19.206022 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb0998-0638-49ec-9576-96a20f613329 admin admin] PATH_INFO: `/v3/users/751cfd4e232e4db8aacf69431c3ea6c6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:19.207175 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb0998-0638-49ec-9576-96a20f613329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=751cfd4e232e4db8aacf69431c3ea6c6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:19.209128 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb0998-0638-49ec-9576-96a20f613329 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:19.257024 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-14bb0998-0638-49ec-9576-96a20f613329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '751cfd4e232e4db8aacf69431c3ea6c6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:19.257606 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-14bb0998-0638-49ec-9576-96a20f613329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '751cfd4e232e4db8aacf69431c3ea6c6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:19.263141 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:19.271480 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-14bb0998-0638-49ec-9576-96a20f613329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '751cfd4e232e4db8aacf69431c3ea6c6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:19.279176 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-14bb0998-0638-49ec-9576-96a20f613329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '751cfd4e232e4db8aacf69431c3ea6c6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:19.279832 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-14bb0998-0638-49ec-9576-96a20f613329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '751cfd4e232e4db8aacf69431c3ea6c6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:19.293121 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1266/2501] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:19 2022] DELETE /identity/v3/users/751cfd4e232e4db8aacf69431c3ea6c6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:19.297820 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f650a-a2c3-4c79-9009-c26511cc593b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:19.298280 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f650a-a2c3-4c79-9009-c26511cc593b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:19.298445 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f650a-a2c3-4c79-9009-c26511cc593b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:19.317174 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-bf3f650a-a2c3-4c79-9009-c26511cc593b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:19.318365 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-bf3f650a-a2c3-4c79-9009-c26511cc593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:19.378335 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1236/2502] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:19.388082 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb0998-0638-49ec-9576-96a20f613329 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:19.389515 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-14bb0998-0638-49ec-9576-96a20f613329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:19.448224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb0998-0638-49ec-9576-96a20f613329 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:19.451966 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65653e5c-df40-49c4-b2cc-8aaa4c29e12a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:19.452568 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65653e5c-df40-49c4-b2cc-8aaa4c29e12a service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:19.452845 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65653e5c-df40-49c4-b2cc-8aaa4c29e12a service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:19.453141 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65653e5c-df40-49c4-b2cc-8aaa4c29e12a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:19.462928 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65653e5c-df40-49c4-b2cc-8aaa4c29e12a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:19.464347 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65653e5c-df40-49c4-b2cc-8aaa4c29e12a service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:19.473662 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1267/2503] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:19.744153 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f650a-a2c3-4c79-9009-c26511cc593b None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:19.745614 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-bf3f650a-a2c3-4c79-9009-c26511cc593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:19.760154 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f650a-a2c3-4c79-9009-c26511cc593b None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:19.765198 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0302e-4a9a-4eb4-b5f8-7c94ee11c056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:19.765960 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0302e-4a9a-4eb4-b5f8-7c94ee11c056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:19.766307 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0302e-4a9a-4eb4-b5f8-7c94ee11c056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:19.766587 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0302e-4a9a-4eb4-b5f8-7c94ee11c056 admin admin] PATH_INFO: `/v3/projects/04fbfa6812b94a4296c2169b2b0a0362` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:19.767766 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0302e-4a9a-4eb4-b5f8-7c94ee11c056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04fbfa6812b94a4296c2169b2b0a0362)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:19.769750 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0302e-4a9a-4eb4-b5f8-7c94ee11c056 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:19.824335 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-69d0302e-4a9a-4eb4-b5f8-7c94ee11c056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04fbfa6812b94a4296c2169b2b0a0362', 'request_id': 'req-69d0302e-4a9a-4eb4-b5f8-7c94ee11c056'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:19.830749 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-69d0302e-4a9a-4eb4-b5f8-7c94ee11c056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04fbfa6812b94a4296c2169b2b0a0362', 'request_id': 'req-69d0302e-4a9a-4eb4-b5f8-7c94ee11c056'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:19.838685 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-69d0302e-4a9a-4eb4-b5f8-7c94ee11c056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04fbfa6812b94a4296c2169b2b0a0362', 'request_id': 'req-69d0302e-4a9a-4eb4-b5f8-7c94ee11c056'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:19.843409 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:19.851126 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-69d0302e-4a9a-4eb4-b5f8-7c94ee11c056 admin admin] The token cache is being invalidate because project 04fbfa6812b94a4296c2169b2b0a0362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:19.851587 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-69d0302e-4a9a-4eb4-b5f8-7c94ee11c056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:19.852874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-69d0302e-4a9a-4eb4-b5f8-7c94ee11c056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:19.854391 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1237/2504] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:19 2022] DELETE /identity/v3/projects/04fbfa6812b94a4296c2169b2b0a0362 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:19.858407 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65653e5c-df40-49c4-b2cc-8aaa4c29e12a service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:19.868609 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65653e5c-df40-49c4-b2cc-8aaa4c29e12a service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:19.924888 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed754a-6857-4e2a-ab07-2c47b9f29ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:19.925536 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed754a-6857-4e2a-ab07-2c47b9f29ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:19.925816 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed754a-6857-4e2a-ab07-2c47b9f29ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:19.926088 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed754a-6857-4e2a-ab07-2c47b9f29ce2 admin admin] PATH_INFO: `/v3/users/b19aef8986464e9ead473b231e0cb3aa` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:19.927196 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed754a-6857-4e2a-ab07-2c47b9f29ce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b19aef8986464e9ead473b231e0cb3aa)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:19.929138 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed754a-6857-4e2a-ab07-2c47b9f29ce2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:19.975077 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-16ed754a-6857-4e2a-ab07-2c47b9f29ce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b19aef8986464e9ead473b231e0cb3aa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:19.975720 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-16ed754a-6857-4e2a-ab07-2c47b9f29ce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b19aef8986464e9ead473b231e0cb3aa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:19.988722 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-16ed754a-6857-4e2a-ab07-2c47b9f29ce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b19aef8986464e9ead473b231e0cb3aa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:19.997013 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-16ed754a-6857-4e2a-ab07-2c47b9f29ce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b19aef8986464e9ead473b231e0cb3aa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:19.997638 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-16ed754a-6857-4e2a-ab07-2c47b9f29ce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b19aef8986464e9ead473b231e0cb3aa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:20.002223 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:20.012750 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1268/2505] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:19 2022] DELETE /identity/v3/users/b19aef8986464e9ead473b231e0cb3aa => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:20.282379 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0302e-4a9a-4eb4-b5f8-7c94ee11c056 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:20.283970 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-69d0302e-4a9a-4eb4-b5f8-7c94ee11c056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:20.307728 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0302e-4a9a-4eb4-b5f8-7c94ee11c056 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:20.364088 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f07a0-5afa-4c29-b75d-47bb8f07403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:20.364640 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f07a0-5afa-4c29-b75d-47bb8f07403a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:20.364923 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f07a0-5afa-4c29-b75d-47bb8f07403a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:20.365223 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f07a0-5afa-4c29-b75d-47bb8f07403a admin admin] PATH_INFO: `/v3/projects/3200a15622f5418cac1c4419096ef6af` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:20.366596 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f07a0-5afa-4c29-b75d-47bb8f07403a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3200a15622f5418cac1c4419096ef6af)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:20.369352 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f07a0-5afa-4c29-b75d-47bb8f07403a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:20.416210 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-145f07a0-5afa-4c29-b75d-47bb8f07403a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3200a15622f5418cac1c4419096ef6af', 'request_id': 'req-145f07a0-5afa-4c29-b75d-47bb8f07403a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:20.422852 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-145f07a0-5afa-4c29-b75d-47bb8f07403a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3200a15622f5418cac1c4419096ef6af', 'request_id': 'req-145f07a0-5afa-4c29-b75d-47bb8f07403a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:20.431671 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-145f07a0-5afa-4c29-b75d-47bb8f07403a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3200a15622f5418cac1c4419096ef6af', 'request_id': 'req-145f07a0-5afa-4c29-b75d-47bb8f07403a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:20.442549 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-145f07a0-5afa-4c29-b75d-47bb8f07403a admin admin] The token cache is being invalidate because project 3200a15622f5418cac1c4419096ef6af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:20.442826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-145f07a0-5afa-4c29-b75d-47bb8f07403a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:20.443630 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-145f07a0-5afa-4c29-b75d-47bb8f07403a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:20.445155 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1238/2506] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:20 2022] DELETE /identity/v3/projects/3200a15622f5418cac1c4419096ef6af => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:20.450357 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85ad4a-15f2-4758-9350-f5bd8c8e57d5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:20.450893 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85ad4a-15f2-4758-9350-f5bd8c8e57d5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:20.450893 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85ad4a-15f2-4758-9350-f5bd8c8e57d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:20.471285 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7b85ad4a-15f2-4758-9350-f5bd8c8e57d5 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:20.472497 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7b85ad4a-15f2-4758-9350-f5bd8c8e57d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:20.533038 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1269/2507] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:20.541619 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5eb21-d6ff-4135-8177-7b849e2088bf None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:20.541943 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5eb21-d6ff-4135-8177-7b849e2088bf None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:20.542298 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5eb21-d6ff-4135-8177-7b849e2088bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:20.563385 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-95e5eb21-d6ff-4135-8177-7b849e2088bf None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:20.564590 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-95e5eb21-d6ff-4135-8177-7b849e2088bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:20.573066 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1239/2508] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:20.577460 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85ad4a-15f2-4758-9350-f5bd8c8e57d5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:20.587277 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85ad4a-15f2-4758-9350-f5bd8c8e57d5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:20.592028 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d6e20-8d0d-4ad8-ae54-b70b72c5b55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:20.592620 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d6e20-8d0d-4ad8-ae54-b70b72c5b55c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:20.592901 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d6e20-8d0d-4ad8-ae54-b70b72c5b55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:20.593221 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d6e20-8d0d-4ad8-ae54-b70b72c5b55c admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:20.593863 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d6e20-8d0d-4ad8-ae54-b70b72c5b55c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:02:20.594167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d6e20-8d0d-4ad8-ae54-b70b72c5b55c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:20.595757 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d6e20-8d0d-4ad8-ae54-b70b72c5b55c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:20.608059 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1270/2509] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:02:20.612589 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5eb21-d6ff-4135-8177-7b849e2088bf None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:20.622992 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5eb21-d6ff-4135-8177-7b849e2088bf None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:20.627574 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4806e0a-e2d7-4e1e-a471-7eda2c8bb19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:20.628161 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4806e0a-e2d7-4e1e-a471-7eda2c8bb19b admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:20.628546 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4806e0a-e2d7-4e1e-a471-7eda2c8bb19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:20.628714 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4806e0a-e2d7-4e1e-a471-7eda2c8bb19b admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:20.629422 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4806e0a-e2d7-4e1e-a471-7eda2c8bb19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:20.631332 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4806e0a-e2d7-4e1e-a471-7eda2c8bb19b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:20.658163 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1240/2510] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:20 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:20.662340 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d6e20-8d0d-4ad8-ae54-b70b72c5b55c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:20.672989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d6e20-8d0d-4ad8-ae54-b70b72c5b55c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:20.733147 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a83862-9dbc-4022-8984-bccbc118b620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:20.733817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a83862-9dbc-4022-8984-bccbc118b620 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:20.734027 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a83862-9dbc-4022-8984-bccbc118b620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:20.734297 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a83862-9dbc-4022-8984-bccbc118b620 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:20.734927 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a83862-9dbc-4022-8984-bccbc118b620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:20.736870 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a83862-9dbc-4022-8984-bccbc118b620 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:20.758066 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1271/2511] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:20 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:20.762487 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4806e0a-e2d7-4e1e-a471-7eda2c8bb19b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:20.773022 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4806e0a-e2d7-4e1e-a471-7eda2c8bb19b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:20.784091 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b6eb5-b222-4af3-bc23-120f6eff074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:20.784712 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b6eb5-b222-4af3-bc23-120f6eff074d admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:20.785023 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b6eb5-b222-4af3-bc23-120f6eff074d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:20.785338 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b6eb5-b222-4af3-bc23-120f6eff074d admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:20.785943 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b6eb5-b222-4af3-bc23-120f6eff074d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:20.787559 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b6eb5-b222-4af3-bc23-120f6eff074d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:20.799430 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1241/2512] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:20.803511 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a83862-9dbc-4022-8984-bccbc118b620 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:20.813628 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a83862-9dbc-4022-8984-bccbc118b620 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:20.818241 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711413d-c002-4b8b-9716-832d0770b6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:20.818837 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711413d-c002-4b8b-9716-832d0770b6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:20.819113 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711413d-c002-4b8b-9716-832d0770b6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:20.819382 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711413d-c002-4b8b-9716-832d0770b6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:20.820008 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711413d-c002-4b8b-9716-832d0770b6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:20.821664 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711413d-c002-4b8b-9716-832d0770b6c3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:20.831635 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1272/2513] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:20.836074 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b6eb5-b222-4af3-bc23-120f6eff074d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:20.847765 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b6eb5-b222-4af3-bc23-120f6eff074d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:20.853157 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c674d-5a93-43e1-8ea9-95b71fc37414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:20.853811 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c674d-5a93-43e1-8ea9-95b71fc37414 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:20.854092 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c674d-5a93-43e1-8ea9-95b71fc37414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:20.854364 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c674d-5a93-43e1-8ea9-95b71fc37414 admin admin] PATH_INFO: `/v3/projects/7c1d16708b6f4a209684526fa4723b44/users/c92023a916e94c1cb9d829c11aa02772/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:20.869555 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c674d-5a93-43e1-8ea9-95b71fc37414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1d16708b6f4a209684526fa4723b44, user_id=c92023a916e94c1cb9d829c11aa02772, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:20.872218 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c674d-5a93-43e1-8ea9-95b71fc37414 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:20.885545 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1242/2514] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:20 2022] PUT /identity/v3/projects/7c1d16708b6f4a209684526fa4723b44/users/c92023a916e94c1cb9d829c11aa02772/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:20.896781 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28490e3-2b5f-47d5-ad65-d5f77daa3cde None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:20.897113 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28490e3-2b5f-47d5-ad65-d5f77daa3cde None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:20.897380 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28490e3-2b5f-47d5-ad65-d5f77daa3cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:20.925494 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f28490e3-2b5f-47d5-ad65-d5f77daa3cde None None] MFA Rules not processed for user `c92023a916e94c1cb9d829c11aa02772`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:20.926728 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f28490e3-2b5f-47d5-ad65-d5f77daa3cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:20.973595 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:20.997091 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1273/2515] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:21.002143 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c674d-5a93-43e1-8ea9-95b71fc37414 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:21.032627 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:21.075628 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c674d-5a93-43e1-8ea9-95b71fc37414 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:21.080209 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39964ac0-2f1e-40af-85c7-88137aebb0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:21.080801 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39964ac0-2f1e-40af-85c7-88137aebb0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:21.081111 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39964ac0-2f1e-40af-85c7-88137aebb0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:21.081380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39964ac0-2f1e-40af-85c7-88137aebb0b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:21.081990 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39964ac0-2f1e-40af-85c7-88137aebb0b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:21.083881 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39964ac0-2f1e-40af-85c7-88137aebb0b4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:21.110597 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1243/2516] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:21 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:21.114810 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28490e3-2b5f-47d5-ad65-d5f77daa3cde None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:21.126400 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28490e3-2b5f-47d5-ad65-d5f77daa3cde None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:21.182750 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a92de7-8c1e-402c-9fb1-cac4ea5cea45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:21.183354 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a92de7-8c1e-402c-9fb1-cac4ea5cea45 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:21.183659 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a92de7-8c1e-402c-9fb1-cac4ea5cea45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:21.183932 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a92de7-8c1e-402c-9fb1-cac4ea5cea45 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:21.184551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a92de7-8c1e-402c-9fb1-cac4ea5cea45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:21.186493 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a92de7-8c1e-402c-9fb1-cac4ea5cea45 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:21.207516 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1274/2517] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:21 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:21.212409 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39964ac0-2f1e-40af-85c7-88137aebb0b4 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:21.223028 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39964ac0-2f1e-40af-85c7-88137aebb0b4 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:21.228095 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca44f8-7a14-4a10-8bb0-0e56335ae513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:21.228705 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca44f8-7a14-4a10-8bb0-0e56335ae513 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:21.229043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca44f8-7a14-4a10-8bb0-0e56335ae513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:21.229318 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca44f8-7a14-4a10-8bb0-0e56335ae513 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:21.229961 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca44f8-7a14-4a10-8bb0-0e56335ae513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:21.231562 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca44f8-7a14-4a10-8bb0-0e56335ae513 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:21.242614 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1244/2518] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:21.246781 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a92de7-8c1e-402c-9fb1-cac4ea5cea45 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:21.256790 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a92de7-8c1e-402c-9fb1-cac4ea5cea45 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:21.262017 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0431ad2-0059-4286-bfc8-6f9f1d044924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:21.262660 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0431ad2-0059-4286-bfc8-6f9f1d044924 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:21.262944 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0431ad2-0059-4286-bfc8-6f9f1d044924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:21.263216 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0431ad2-0059-4286-bfc8-6f9f1d044924 admin admin] PATH_INFO: `/v3/projects/2973fa4f4b5d45e9b7e4bf478f09c691/users/47b1657dbfe344a18f19717f09c715f8/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:21.278236 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0431ad2-0059-4286-bfc8-6f9f1d044924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2973fa4f4b5d45e9b7e4bf478f09c691, user_id=47b1657dbfe344a18f19717f09c715f8, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:21.280883 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0431ad2-0059-4286-bfc8-6f9f1d044924 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:21.294115 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1275/2519] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:21 2022] PUT /identity/v3/projects/2973fa4f4b5d45e9b7e4bf478f09c691/users/47b1657dbfe344a18f19717f09c715f8/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:21.298253 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca44f8-7a14-4a10-8bb0-0e56335ae513 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:21.308084 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca44f8-7a14-4a10-8bb0-0e56335ae513 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:21.366790 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c321ea-031f-4872-a41a-59a8e9be0363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:21.367415 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c321ea-031f-4872-a41a-59a8e9be0363 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:21.367832 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c321ea-031f-4872-a41a-59a8e9be0363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:21.368217 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c321ea-031f-4872-a41a-59a8e9be0363 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:21.368802 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c321ea-031f-4872-a41a-59a8e9be0363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:21.370524 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c321ea-031f-4872-a41a-59a8e9be0363 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:21.380251 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1245/2520] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:21.385181 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0431ad2-0059-4286-bfc8-6f9f1d044924 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:21.395439 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0431ad2-0059-4286-bfc8-6f9f1d044924 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:21.401372 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532279c3-46d5-4890-931c-86753844d9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:21.402045 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532279c3-46d5-4890-931c-86753844d9d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:21.402322 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532279c3-46d5-4890-931c-86753844d9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:21.402593 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532279c3-46d5-4890-931c-86753844d9d5 admin admin] PATH_INFO: `/v3/projects/2973fa4f4b5d45e9b7e4bf478f09c691/users/47b1657dbfe344a18f19717f09c715f8/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:21.404560 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532279c3-46d5-4890-931c-86753844d9d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2973fa4f4b5d45e9b7e4bf478f09c691, user_id=47b1657dbfe344a18f19717f09c715f8, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:21.407277 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532279c3-46d5-4890-931c-86753844d9d5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:21.421963 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1276/2521] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:21 2022] PUT /identity/v3/projects/2973fa4f4b5d45e9b7e4bf478f09c691/users/47b1657dbfe344a18f19717f09c715f8/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:21.432638 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165eab69-c005-4635-8f2f-8e5f4ddcd25c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:21.433100 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165eab69-c005-4635-8f2f-8e5f4ddcd25c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:21.433498 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165eab69-c005-4635-8f2f-8e5f4ddcd25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:21.462967 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-165eab69-c005-4635-8f2f-8e5f4ddcd25c None None] MFA Rules not processed for user `47b1657dbfe344a18f19717f09c715f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:21.464190 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-165eab69-c005-4635-8f2f-8e5f4ddcd25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:21.533730 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1246/2522] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:21.546991 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532279c3-46d5-4890-931c-86753844d9d5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:21.548793 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-532279c3-46d5-4890-931c-86753844d9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:21.608261 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532279c3-46d5-4890-931c-86753844d9d5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:21.612074 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c9ca6-eae2-448c-800c-c9eff166c159 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:21.612679 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c9ca6-eae2-448c-800c-c9eff166c159 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:21.612974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c9ca6-eae2-448c-800c-c9eff166c159 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:21.613250 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c9ca6-eae2-448c-800c-c9eff166c159 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:21.623633 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c9ca6-eae2-448c-800c-c9eff166c159 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:21.625113 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c9ca6-eae2-448c-800c-c9eff166c159 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:21.635324 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1277/2523] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:21.953768 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165eab69-c005-4635-8f2f-8e5f4ddcd25c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:21.962899 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165eab69-c005-4635-8f2f-8e5f4ddcd25c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:21.967586 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de2080-fa65-4a1d-b061-bbeddae563b8 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b1657dbfe344a18f19717f09c715f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2973fa4f4b5d45e9b7e4bf478f09c691', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:21.968174 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de2080-fa65-4a1d-b061-bbeddae563b8 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:21.968458 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de2080-fa65-4a1d-b061-bbeddae563b8 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:21.968742 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de2080-fa65-4a1d-b061-bbeddae563b8 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:21.969424 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de2080-fa65-4a1d-b061-bbeddae563b8 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:02:21.969732 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de2080-fa65-4a1d-b061-bbeddae563b8 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:21.971327 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de2080-fa65-4a1d-b061-bbeddae563b8 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:21.983845 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1247/2524] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:02:21.988023 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c9ca6-eae2-448c-800c-c9eff166c159 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:21.998143 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c9ca6-eae2-448c-800c-c9eff166c159 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:22.002771 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ccf91-0f05-4ec9-ab3c-b67549756fab tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b1657dbfe344a18f19717f09c715f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2973fa4f4b5d45e9b7e4bf478f09c691', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:22.003412 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ccf91-0f05-4ec9-ab3c-b67549756fab tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:22.003692 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ccf91-0f05-4ec9-ab3c-b67549756fab tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:22.004062 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ccf91-0f05-4ec9-ab3c-b67549756fab tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:22.004682 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ccf91-0f05-4ec9-ab3c-b67549756fab tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:22.006748 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ccf91-0f05-4ec9-ab3c-b67549756fab tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:22.033567 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1278/2525] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:21 2022] POST /identity/v3/projects => generated 353 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:22.037724 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de2080-fa65-4a1d-b061-bbeddae563b8 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:22.044595 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:22.048617 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de2080-fa65-4a1d-b061-bbeddae563b8 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:22.106876 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a2426-74d3-4d3d-8453-63a1c2540ded tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b1657dbfe344a18f19717f09c715f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2973fa4f4b5d45e9b7e4bf478f09c691', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:22.107481 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a2426-74d3-4d3d-8453-63a1c2540ded tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:22.107764 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a2426-74d3-4d3d-8453-63a1c2540ded tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:22.108038 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a2426-74d3-4d3d-8453-63a1c2540ded tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:22.108685 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a2426-74d3-4d3d-8453-63a1c2540ded tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:02:22.109019 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a2426-74d3-4d3d-8453-63a1c2540ded tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:22.110634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a2426-74d3-4d3d-8453-63a1c2540ded tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:22.126853 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1248/2526] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:02:22.169345 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ccf91-0f05-4ec9-ab3c-b67549756fab tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:22.182696 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ccf91-0f05-4ec9-ab3c-b67549756fab tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:22.187360 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dd531-82a7-40e8-b0bc-580890548f67 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b1657dbfe344a18f19717f09c715f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2973fa4f4b5d45e9b7e4bf478f09c691', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:22.187999 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dd531-82a7-40e8-b0bc-580890548f67 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:22.188285 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dd531-82a7-40e8-b0bc-580890548f67 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:22.188558 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dd531-82a7-40e8-b0bc-580890548f67 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] PATH_INFO: `/v3/projects/702277c772814aa597806d8afd11ae44` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:22.189723 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dd531-82a7-40e8-b0bc-580890548f67 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] RBAC: Authorizing `identity:delete_project(project_id=702277c772814aa597806d8afd11ae44)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:22.191643 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dd531-82a7-40e8-b0bc-580890548f67 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:22.211143 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:22.242328 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-610dd531-82a7-40e8-b0bc-580890548f67 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '702277c772814aa597806d8afd11ae44', 'request_id': 'req-610dd531-82a7-40e8-b0bc-580890548f67'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:22.249126 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-610dd531-82a7-40e8-b0bc-580890548f67 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '702277c772814aa597806d8afd11ae44', 'request_id': 'req-610dd531-82a7-40e8-b0bc-580890548f67'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:22.256603 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-610dd531-82a7-40e8-b0bc-580890548f67 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '702277c772814aa597806d8afd11ae44', 'request_id': 'req-610dd531-82a7-40e8-b0bc-580890548f67'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:22.268279 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-610dd531-82a7-40e8-b0bc-580890548f67 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] The token cache is being invalidate because project 702277c772814aa597806d8afd11ae44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:22.268567 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-610dd531-82a7-40e8-b0bc-580890548f67 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:22.269233 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-610dd531-82a7-40e8-b0bc-580890548f67 tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:22.270724 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1279/2527] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:22 2022] DELETE /identity/v3/projects/702277c772814aa597806d8afd11ae44 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:22.499064 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a2426-74d3-4d3d-8453-63a1c2540ded tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:22.501033 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-596a2426-74d3-4d3d-8453-63a1c2540ded tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:22.577175 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a2426-74d3-4d3d-8453-63a1c2540ded tempest-VolumeQuotaClassesTest-239698118 tempest-VolumeQuotaClassesTest-239698118-project-admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:22.649072 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af316fef-3832-435c-aa74-13a64b063ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:22.649916 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af316fef-3832-435c-aa74-13a64b063ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:22.650205 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af316fef-3832-435c-aa74-13a64b063ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:22.651070 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af316fef-3832-435c-aa74-13a64b063ff0 admin admin] PATH_INFO: `/v3/users/c92023a916e94c1cb9d829c11aa02772` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:22.653015 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af316fef-3832-435c-aa74-13a64b063ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92023a916e94c1cb9d829c11aa02772)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:22.655681 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af316fef-3832-435c-aa74-13a64b063ff0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:22.720718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-af316fef-3832-435c-aa74-13a64b063ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92023a916e94c1cb9d829c11aa02772'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:22.721514 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-af316fef-3832-435c-aa74-13a64b063ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92023a916e94c1cb9d829c11aa02772'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:22.723318 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:22.730974 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-af316fef-3832-435c-aa74-13a64b063ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92023a916e94c1cb9d829c11aa02772'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:22.731893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-af316fef-3832-435c-aa74-13a64b063ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92023a916e94c1cb9d829c11aa02772'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:22.743706 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-af316fef-3832-435c-aa74-13a64b063ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92023a916e94c1cb9d829c11aa02772'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:22.766151 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1249/2528] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:22 2022] DELETE /identity/v3/users/c92023a916e94c1cb9d829c11aa02772 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:22.771523 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa9693-6f00-481c-9e00-54750f6b4cb4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:22.772332 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa9693-6f00-481c-9e00-54750f6b4cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:22.772332 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa9693-6f00-481c-9e00-54750f6b4cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:22.796759 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-90aa9693-6f00-481c-9e00-54750f6b4cb4 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:22.798426 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-90aa9693-6f00-481c-9e00-54750f6b4cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:22.869696 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1280/2529] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:02:22.881087 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af316fef-3832-435c-aa74-13a64b063ff0 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:22.883093 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-af316fef-3832-435c-aa74-13a64b063ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:22.955166 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af316fef-3832-435c-aa74-13a64b063ff0 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:22.959046 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac03a92-fac7-43cb-80e2-c5bb9e258b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:22.959634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac03a92-fac7-43cb-80e2-c5bb9e258b44 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:22.959920 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac03a92-fac7-43cb-80e2-c5bb9e258b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:22.960195 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac03a92-fac7-43cb-80e2-c5bb9e258b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:22.974042 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac03a92-fac7-43cb-80e2-c5bb9e258b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:22.975510 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac03a92-fac7-43cb-80e2-c5bb9e258b44 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:22.986669 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1250/2530] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:23.297179 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa9693-6f00-481c-9e00-54750f6b4cb4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:23.299183 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-90aa9693-6f00-481c-9e00-54750f6b4cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:23.312679 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa9693-6f00-481c-9e00-54750f6b4cb4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:23.318027 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4774e8d-130b-41cc-a238-cbc7caab551d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:23.319039 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4774e8d-130b-41cc-a238-cbc7caab551d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:23.319519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4774e8d-130b-41cc-a238-cbc7caab551d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:23.319991 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4774e8d-130b-41cc-a238-cbc7caab551d admin admin] PATH_INFO: `/v3/projects/7c1d16708b6f4a209684526fa4723b44` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:23.322608 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4774e8d-130b-41cc-a238-cbc7caab551d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1d16708b6f4a209684526fa4723b44)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:23.326708 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4774e8d-130b-41cc-a238-cbc7caab551d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:23.393943 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b4774e8d-130b-41cc-a238-cbc7caab551d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1d16708b6f4a209684526fa4723b44', 'request_id': 'req-b4774e8d-130b-41cc-a238-cbc7caab551d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:23.401157 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b4774e8d-130b-41cc-a238-cbc7caab551d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1d16708b6f4a209684526fa4723b44', 'request_id': 'req-b4774e8d-130b-41cc-a238-cbc7caab551d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:23.410769 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b4774e8d-130b-41cc-a238-cbc7caab551d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1d16708b6f4a209684526fa4723b44', 'request_id': 'req-b4774e8d-130b-41cc-a238-cbc7caab551d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:23.424553 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b4774e8d-130b-41cc-a238-cbc7caab551d admin admin] The token cache is being invalidate because project 7c1d16708b6f4a209684526fa4723b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:23.424845 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b4774e8d-130b-41cc-a238-cbc7caab551d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:23.425588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b4774e8d-130b-41cc-a238-cbc7caab551d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:23.427054 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1281/2531] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:23 2022] DELETE /identity/v3/projects/7c1d16708b6f4a209684526fa4723b44 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:23.431014 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac03a92-fac7-43cb-80e2-c5bb9e258b44 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:23.441233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac03a92-fac7-43cb-80e2-c5bb9e258b44 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:23.508049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d0636-4370-4fc3-8650-e323b7e45814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:23.508689 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d0636-4370-4fc3-8650-e323b7e45814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:23.508859 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d0636-4370-4fc3-8650-e323b7e45814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:23.509167 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d0636-4370-4fc3-8650-e323b7e45814 admin admin] PATH_INFO: `/v3/users/47b1657dbfe344a18f19717f09c715f8` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:23.510833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d0636-4370-4fc3-8650-e323b7e45814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47b1657dbfe344a18f19717f09c715f8)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:23.513004 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d0636-4370-4fc3-8650-e323b7e45814 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:23.559953 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-671d0636-4370-4fc3-8650-e323b7e45814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47b1657dbfe344a18f19717f09c715f8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:23.560597 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-671d0636-4370-4fc3-8650-e323b7e45814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47b1657dbfe344a18f19717f09c715f8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:23.567926 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-671d0636-4370-4fc3-8650-e323b7e45814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47b1657dbfe344a18f19717f09c715f8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:23.568766 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-671d0636-4370-4fc3-8650-e323b7e45814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47b1657dbfe344a18f19717f09c715f8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:23.577093 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-671d0636-4370-4fc3-8650-e323b7e45814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47b1657dbfe344a18f19717f09c715f8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:23.582489 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:23.598385 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1251/2532] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:23 2022] DELETE /identity/v3/users/47b1657dbfe344a18f19717f09c715f8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:23.872443 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4774e8d-130b-41cc-a238-cbc7caab551d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:23.873961 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b4774e8d-130b-41cc-a238-cbc7caab551d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:23.888151 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4774e8d-130b-41cc-a238-cbc7caab551d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:23.918965 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:23.951199 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9a929-b643-43fe-9702-6a72472cd744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:23.951821 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9a929-b643-43fe-9702-6a72472cd744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:23.952094 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9a929-b643-43fe-9702-6a72472cd744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:23.952360 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9a929-b643-43fe-9702-6a72472cd744 admin admin] PATH_INFO: `/v3/projects/2973fa4f4b5d45e9b7e4bf478f09c691` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:23.953476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9a929-b643-43fe-9702-6a72472cd744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2973fa4f4b5d45e9b7e4bf478f09c691)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:23.955367 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9a929-b643-43fe-9702-6a72472cd744 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:24.001978 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-28e9a929-b643-43fe-9702-6a72472cd744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2973fa4f4b5d45e9b7e4bf478f09c691', 'request_id': 'req-28e9a929-b643-43fe-9702-6a72472cd744'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:24.008131 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-28e9a929-b643-43fe-9702-6a72472cd744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2973fa4f4b5d45e9b7e4bf478f09c691', 'request_id': 'req-28e9a929-b643-43fe-9702-6a72472cd744'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:24.016448 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-28e9a929-b643-43fe-9702-6a72472cd744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2973fa4f4b5d45e9b7e4bf478f09c691', 'request_id': 'req-28e9a929-b643-43fe-9702-6a72472cd744'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:24.028588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-28e9a929-b643-43fe-9702-6a72472cd744 admin admin] The token cache is being invalidate because project 2973fa4f4b5d45e9b7e4bf478f09c691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:24.028878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-28e9a929-b643-43fe-9702-6a72472cd744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:24.029604 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-28e9a929-b643-43fe-9702-6a72472cd744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:24.031085 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1282/2533] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:23 2022] DELETE /identity/v3/projects/2973fa4f4b5d45e9b7e4bf478f09c691 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:24.036024 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572be91b-77f0-4388-8881-882358253a65 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:24.036386 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572be91b-77f0-4388-8881-882358253a65 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:24.036664 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572be91b-77f0-4388-8881-882358253a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:24.056426 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-572be91b-77f0-4388-8881-882358253a65 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:24.057581 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-572be91b-77f0-4388-8881-882358253a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:24.121878 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1252/2534] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:24.130823 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd7322-e4a0-45e8-8766-37efd2c98bee None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:24.131108 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd7322-e4a0-45e8-8766-37efd2c98bee None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:24.131377 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd7322-e4a0-45e8-8766-37efd2c98bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:24.152530 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b7cd7322-e4a0-45e8-8766-37efd2c98bee None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:24.153812 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b7cd7322-e4a0-45e8-8766-37efd2c98bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:24.162290 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1283/2535] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:24.166570 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572be91b-77f0-4388-8881-882358253a65 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:24.177261 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572be91b-77f0-4388-8881-882358253a65 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:24.181822 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af856d-f500-4cc9-aed5-deda65917828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:24.182418 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af856d-f500-4cc9-aed5-deda65917828 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:24.182691 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af856d-f500-4cc9-aed5-deda65917828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:24.183622 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af856d-f500-4cc9-aed5-deda65917828 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:24.184271 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af856d-f500-4cc9-aed5-deda65917828 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:02:24.184602 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af856d-f500-4cc9-aed5-deda65917828 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:24.186212 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af856d-f500-4cc9-aed5-deda65917828 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:24.198190 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1253/2536] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:02:24.203308 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd7322-e4a0-45e8-8766-37efd2c98bee None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:24.212930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd7322-e4a0-45e8-8766-37efd2c98bee None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:24.217960 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd33c4-75eb-493e-ad68-ce0d05e1969d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:24.218562 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd33c4-75eb-493e-ad68-ce0d05e1969d admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:24.218841 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd33c4-75eb-493e-ad68-ce0d05e1969d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:24.219109 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd33c4-75eb-493e-ad68-ce0d05e1969d admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:24.219770 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd33c4-75eb-493e-ad68-ce0d05e1969d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:24.221733 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd33c4-75eb-493e-ad68-ce0d05e1969d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:24.249742 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1284/2537] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:24 2022] POST /identity/v3/projects => generated 407 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:24.254036 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af856d-f500-4cc9-aed5-deda65917828 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:24.265153 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af856d-f500-4cc9-aed5-deda65917828 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:24.324114 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b0406-19b8-4b4f-9a87-903a38ab3e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:24.324629 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b0406-19b8-4b4f-9a87-903a38ab3e0f admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:24.324901 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b0406-19b8-4b4f-9a87-903a38ab3e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:24.325200 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b0406-19b8-4b4f-9a87-903a38ab3e0f admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:24.325818 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b0406-19b8-4b4f-9a87-903a38ab3e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:24.327773 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b0406-19b8-4b4f-9a87-903a38ab3e0f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:24.350099 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1254/2538] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:24 2022] POST /identity/v3/users => generated 304 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:24.355073 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd33c4-75eb-493e-ad68-ce0d05e1969d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:24.366273 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd33c4-75eb-493e-ad68-ce0d05e1969d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:24.371362 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906667c-c926-4378-a1e0-25700935a7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:24.371961 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906667c-c926-4378-a1e0-25700935a7ae admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:24.372236 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906667c-c926-4378-a1e0-25700935a7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:24.372503 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906667c-c926-4378-a1e0-25700935a7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:24.373187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906667c-c926-4378-a1e0-25700935a7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:24.374957 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906667c-c926-4378-a1e0-25700935a7ae admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:24.384955 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1285/2539] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:24.389845 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b0406-19b8-4b4f-9a87-903a38ab3e0f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:24.400073 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b0406-19b8-4b4f-9a87-903a38ab3e0f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:24.404784 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae067c-1da5-4669-be73-e86fdeeaabf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:24.405418 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae067c-1da5-4669-be73-e86fdeeaabf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:24.405700 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae067c-1da5-4669-be73-e86fdeeaabf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:24.405971 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae067c-1da5-4669-be73-e86fdeeaabf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:24.406608 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae067c-1da5-4669-be73-e86fdeeaabf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:24.408224 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae067c-1da5-4669-be73-e86fdeeaabf3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:24.420072 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1255/2540] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:24.424280 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906667c-c926-4378-a1e0-25700935a7ae admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:24.435587 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906667c-c926-4378-a1e0-25700935a7ae admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:24.440290 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328e28b-2287-4d25-8037-9d7753a74db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:24.440974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328e28b-2287-4d25-8037-9d7753a74db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:24.441252 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328e28b-2287-4d25-8037-9d7753a74db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:24.441526 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328e28b-2287-4d25-8037-9d7753a74db3 admin admin] PATH_INFO: `/v3/projects/89869faf6a4c4fe3bb22444a6cc1bfc3/users/b550daf5ffb4493b889bee89f5f3b3df/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:24.456658 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328e28b-2287-4d25-8037-9d7753a74db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89869faf6a4c4fe3bb22444a6cc1bfc3, user_id=b550daf5ffb4493b889bee89f5f3b3df, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:24.459412 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328e28b-2287-4d25-8037-9d7753a74db3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:24.472496 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1286/2541] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:24 2022] PUT /identity/v3/projects/89869faf6a4c4fe3bb22444a6cc1bfc3/users/b550daf5ffb4493b889bee89f5f3b3df/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:02:24.483594 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214ec4d-68c8-464c-a589-290a6e536a81 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:24.483876 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214ec4d-68c8-464c-a589-290a6e536a81 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:24.484171 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214ec4d-68c8-464c-a589-290a6e536a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:24.512470 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e214ec4d-68c8-464c-a589-290a6e536a81 None None] MFA Rules not processed for user `b550daf5ffb4493b889bee89f5f3b3df`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:24.513692 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e214ec4d-68c8-464c-a589-290a6e536a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:24.554774 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:24.580329 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1256/2542] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:24 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:24.584893 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328e28b-2287-4d25-8037-9d7753a74db3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:24.642883 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:24.649305 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328e28b-2287-4d25-8037-9d7753a74db3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:24.654719 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb88cd1-f5e1-44c7-b0e2-63813277e022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:24.655319 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb88cd1-f5e1-44c7-b0e2-63813277e022 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:24.655624 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb88cd1-f5e1-44c7-b0e2-63813277e022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:24.655896 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb88cd1-f5e1-44c7-b0e2-63813277e022 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:24.656515 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb88cd1-f5e1-44c7-b0e2-63813277e022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:24.658481 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb88cd1-f5e1-44c7-b0e2-63813277e022 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:24.685419 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1287/2543] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:24 2022] POST /identity/v3/projects => generated 409 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:24.690173 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214ec4d-68c8-464c-a589-290a6e536a81 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:24.704529 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214ec4d-68c8-464c-a589-290a6e536a81 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:24.763383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a2c44-4b6a-44d6-8c7e-14ec6c36056b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:24.763993 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a2c44-4b6a-44d6-8c7e-14ec6c36056b admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:24.764280 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a2c44-4b6a-44d6-8c7e-14ec6c36056b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:24.764554 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a2c44-4b6a-44d6-8c7e-14ec6c36056b admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:24.765211 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a2c44-4b6a-44d6-8c7e-14ec6c36056b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:24.767137 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a2c44-4b6a-44d6-8c7e-14ec6c36056b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:24.789044 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1257/2544] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:24 2022] POST /identity/v3/users => generated 311 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:24.793664 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb88cd1-f5e1-44c7-b0e2-63813277e022 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:24.803828 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb88cd1-f5e1-44c7-b0e2-63813277e022 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:24.808665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef44e3-b5bd-4967-bb36-da5a04897b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:24.809288 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef44e3-b5bd-4967-bb36-da5a04897b90 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:24.809569 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef44e3-b5bd-4967-bb36-da5a04897b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:24.809841 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef44e3-b5bd-4967-bb36-da5a04897b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:24.810474 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef44e3-b5bd-4967-bb36-da5a04897b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:24.812061 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef44e3-b5bd-4967-bb36-da5a04897b90 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:24.822436 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1288/2545] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:24.826893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a2c44-4b6a-44d6-8c7e-14ec6c36056b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:24.837340 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a2c44-4b6a-44d6-8c7e-14ec6c36056b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:24.842495 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b603f5d-1b7a-4137-a88f-e3fcdf247a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:24.843145 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b603f5d-1b7a-4137-a88f-e3fcdf247a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:24.843431 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b603f5d-1b7a-4137-a88f-e3fcdf247a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:24.843705 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b603f5d-1b7a-4137-a88f-e3fcdf247a1c admin admin] PATH_INFO: `/v3/projects/db030913059f486aa93e4cd9701d33ff/users/aa72f5fa9a744ad08f277b074ceaa668/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:24.859197 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b603f5d-1b7a-4137-a88f-e3fcdf247a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db030913059f486aa93e4cd9701d33ff, user_id=aa72f5fa9a744ad08f277b074ceaa668, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:24.861958 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b603f5d-1b7a-4137-a88f-e3fcdf247a1c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:24.875247 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1258/2546] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:24 2022] PUT /identity/v3/projects/db030913059f486aa93e4cd9701d33ff/users/aa72f5fa9a744ad08f277b074ceaa668/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:24.879197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef44e3-b5bd-4967-bb36-da5a04897b90 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:24.889163 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef44e3-b5bd-4967-bb36-da5a04897b90 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:24.946873 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08409af-6e6b-49e9-be4e-a3801f8254e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:24.947539 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08409af-6e6b-49e9-be4e-a3801f8254e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:24.947742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08409af-6e6b-49e9-be4e-a3801f8254e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:24.948012 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08409af-6e6b-49e9-be4e-a3801f8254e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:24.948675 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08409af-6e6b-49e9-be4e-a3801f8254e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:24.950291 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08409af-6e6b-49e9-be4e-a3801f8254e1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:24.960199 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1289/2547] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:24.964918 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b603f5d-1b7a-4137-a88f-e3fcdf247a1c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:24.975601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b603f5d-1b7a-4137-a88f-e3fcdf247a1c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:24.981388 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0898bc9-a9d5-43be-897a-ea82ce48ddcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:24.982105 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0898bc9-a9d5-43be-897a-ea82ce48ddcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:24.982386 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0898bc9-a9d5-43be-897a-ea82ce48ddcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:24.982660 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0898bc9-a9d5-43be-897a-ea82ce48ddcc admin admin] PATH_INFO: `/v3/projects/db030913059f486aa93e4cd9701d33ff/users/aa72f5fa9a744ad08f277b074ceaa668/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:24.984758 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0898bc9-a9d5-43be-897a-ea82ce48ddcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=db030913059f486aa93e4cd9701d33ff, user_id=aa72f5fa9a744ad08f277b074ceaa668, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:24.987748 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0898bc9-a9d5-43be-897a-ea82ce48ddcc admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:25.000307 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1259/2548] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:24 2022] PUT /identity/v3/projects/db030913059f486aa93e4cd9701d33ff/users/aa72f5fa9a744ad08f277b074ceaa668/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:25.012103 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d992b43-264b-4eba-93a4-a3e73a3963ca None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:25.012530 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d992b43-264b-4eba-93a4-a3e73a3963ca None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:25.012891 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d992b43-264b-4eba-93a4-a3e73a3963ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:25.050237 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1d992b43-264b-4eba-93a4-a3e73a3963ca None None] MFA Rules not processed for user `aa72f5fa9a744ad08f277b074ceaa668`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:25.051838 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1d992b43-264b-4eba-93a4-a3e73a3963ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:25.124716 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1290/2549] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:25 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:25.135551 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0898bc9-a9d5-43be-897a-ea82ce48ddcc admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:25.137916 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e0898bc9-a9d5-43be-897a-ea82ce48ddcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:25.197465 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0898bc9-a9d5-43be-897a-ea82ce48ddcc admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:25.201979 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cff45-0fce-4734-bfa0-9b45f850d2bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:25.202585 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cff45-0fce-4734-bfa0-9b45f850d2bd service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:25.202873 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cff45-0fce-4734-bfa0-9b45f850d2bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:25.203144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cff45-0fce-4734-bfa0-9b45f850d2bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:25.212345 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319cff45-0fce-4734-bfa0-9b45f850d2bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:25.213876 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319cff45-0fce-4734-bfa0-9b45f850d2bd service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:25.225054 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1260/2550] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:25 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:25.378056 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d992b43-264b-4eba-93a4-a3e73a3963ca None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:25.392797 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d992b43-264b-4eba-93a4-a3e73a3963ca None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:25.396682 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24ad5d-b5a3-4a45-85cd-2f446e7139bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:25.397313 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24ad5d-b5a3-4a45-85cd-2f446e7139bb service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:25.397596 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24ad5d-b5a3-4a45-85cd-2f446e7139bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:25.397872 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24ad5d-b5a3-4a45-85cd-2f446e7139bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:25.452565 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:25.462954 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24ad5d-b5a3-4a45-85cd-2f446e7139bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:25.465288 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24ad5d-b5a3-4a45-85cd-2f446e7139bb service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:25.474541 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1291/2551] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:25 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:30.753913 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cff45-0fce-4734-bfa0-9b45f850d2bd service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:30.797419 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:30.819963 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cff45-0fce-4734-bfa0-9b45f850d2bd service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:30.824615 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4ba48-1481-48cd-8c90-272913e5a8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:30.825279 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4ba48-1481-48cd-8c90-272913e5a8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:30.825561 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4ba48-1481-48cd-8c90-272913e5a8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:30.825834 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4ba48-1481-48cd-8c90-272913e5a8a1 admin admin] PATH_INFO: `/v3/users/b550daf5ffb4493b889bee89f5f3b3df` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:30.826955 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4ba48-1481-48cd-8c90-272913e5a8a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b550daf5ffb4493b889bee89f5f3b3df)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:30.828887 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4ba48-1481-48cd-8c90-272913e5a8a1 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:30.877515 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-01b4ba48-1481-48cd-8c90-272913e5a8a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b550daf5ffb4493b889bee89f5f3b3df'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:30.878166 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-01b4ba48-1481-48cd-8c90-272913e5a8a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b550daf5ffb4493b889bee89f5f3b3df'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:30.885509 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-01b4ba48-1481-48cd-8c90-272913e5a8a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b550daf5ffb4493b889bee89f5f3b3df'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:30.886329 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-01b4ba48-1481-48cd-8c90-272913e5a8a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b550daf5ffb4493b889bee89f5f3b3df'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:30.894380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-01b4ba48-1481-48cd-8c90-272913e5a8a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b550daf5ffb4493b889bee89f5f3b3df'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:30.912435 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1261/2552] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:30 2022] DELETE /identity/v3/users/b550daf5ffb4493b889bee89f5f3b3df => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:30.917107 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e0489-5712-4e9c-8dce-af170dd8736d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:30.917589 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e0489-5712-4e9c-8dce-af170dd8736d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:30.917685 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e0489-5712-4e9c-8dce-af170dd8736d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:30.938048 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-591e0489-5712-4e9c-8dce-af170dd8736d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:30.939311 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-591e0489-5712-4e9c-8dce-af170dd8736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:30.999912 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1292/2553] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:31.009836 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4ba48-1481-48cd-8c90-272913e5a8a1 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:31.011239 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-01b4ba48-1481-48cd-8c90-272913e5a8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:31.069200 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4ba48-1481-48cd-8c90-272913e5a8a1 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:31.072830 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961ab58-c183-4087-9129-d3a7f6736d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:31.073504 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961ab58-c183-4087-9129-d3a7f6736d06 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:31.073783 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961ab58-c183-4087-9129-d3a7f6736d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:31.074055 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961ab58-c183-4087-9129-d3a7f6736d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:31.083363 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961ab58-c183-4087-9129-d3a7f6736d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:31.084791 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961ab58-c183-4087-9129-d3a7f6736d06 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:31.094961 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1262/2554] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:31.381788 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e0489-5712-4e9c-8dce-af170dd8736d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:31.383344 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-591e0489-5712-4e9c-8dce-af170dd8736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:31.396601 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e0489-5712-4e9c-8dce-af170dd8736d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:31.401799 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b33dd3-e604-460f-9a1f-3e5e1d026f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:31.403023 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b33dd3-e604-460f-9a1f-3e5e1d026f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:31.403302 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b33dd3-e604-460f-9a1f-3e5e1d026f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:31.403575 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b33dd3-e604-460f-9a1f-3e5e1d026f6a admin admin] PATH_INFO: `/v3/projects/89869faf6a4c4fe3bb22444a6cc1bfc3` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:31.409239 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b33dd3-e604-460f-9a1f-3e5e1d026f6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=89869faf6a4c4fe3bb22444a6cc1bfc3)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:31.409239 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b33dd3-e604-460f-9a1f-3e5e1d026f6a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:31.455918 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-31b33dd3-e604-460f-9a1f-3e5e1d026f6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89869faf6a4c4fe3bb22444a6cc1bfc3', 'request_id': 'req-31b33dd3-e604-460f-9a1f-3e5e1d026f6a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:31.462139 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-31b33dd3-e604-460f-9a1f-3e5e1d026f6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89869faf6a4c4fe3bb22444a6cc1bfc3', 'request_id': 'req-31b33dd3-e604-460f-9a1f-3e5e1d026f6a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:31.470518 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-31b33dd3-e604-460f-9a1f-3e5e1d026f6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89869faf6a4c4fe3bb22444a6cc1bfc3', 'request_id': 'req-31b33dd3-e604-460f-9a1f-3e5e1d026f6a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:31.481526 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-31b33dd3-e604-460f-9a1f-3e5e1d026f6a admin admin] The token cache is being invalidate because project 89869faf6a4c4fe3bb22444a6cc1bfc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:31.481804 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-31b33dd3-e604-460f-9a1f-3e5e1d026f6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:31.482425 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-31b33dd3-e604-460f-9a1f-3e5e1d026f6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:31.483889 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1293/2555] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:31 2022] DELETE /identity/v3/projects/89869faf6a4c4fe3bb22444a6cc1bfc3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:31.487865 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961ab58-c183-4087-9129-d3a7f6736d06 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:31.498619 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961ab58-c183-4087-9129-d3a7f6736d06 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:31.558152 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d830bb7-767f-421b-9b65-370e1541308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:31.558843 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d830bb7-767f-421b-9b65-370e1541308b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:31.559130 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d830bb7-767f-421b-9b65-370e1541308b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:31.559406 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d830bb7-767f-421b-9b65-370e1541308b admin admin] PATH_INFO: `/v3/users/aa72f5fa9a744ad08f277b074ceaa668` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:31.560565 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d830bb7-767f-421b-9b65-370e1541308b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa72f5fa9a744ad08f277b074ceaa668)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:31.562544 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d830bb7-767f-421b-9b65-370e1541308b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:31.564162 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:31.620071 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4d830bb7-767f-421b-9b65-370e1541308b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa72f5fa9a744ad08f277b074ceaa668'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:31.621019 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4d830bb7-767f-421b-9b65-370e1541308b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa72f5fa9a744ad08f277b074ceaa668'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:31.629826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4d830bb7-767f-421b-9b65-370e1541308b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa72f5fa9a744ad08f277b074ceaa668'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:31.630527 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4d830bb7-767f-421b-9b65-370e1541308b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa72f5fa9a744ad08f277b074ceaa668'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:31.638090 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4d830bb7-767f-421b-9b65-370e1541308b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa72f5fa9a744ad08f277b074ceaa668'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:31.657226 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1263/2556] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:31 2022] DELETE /identity/v3/users/aa72f5fa9a744ad08f277b074ceaa668 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:31.971155 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b33dd3-e604-460f-9a1f-3e5e1d026f6a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:31.972605 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-31b33dd3-e604-460f-9a1f-3e5e1d026f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:31.985507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b33dd3-e604-460f-9a1f-3e5e1d026f6a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:32.043676 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08ea91-00c4-4d48-8156-7fc92d56f546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:32.044299 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08ea91-00c4-4d48-8156-7fc92d56f546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:32.044577 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08ea91-00c4-4d48-8156-7fc92d56f546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:32.044843 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08ea91-00c4-4d48-8156-7fc92d56f546 admin admin] PATH_INFO: `/v3/projects/db030913059f486aa93e4cd9701d33ff` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:32.045959 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08ea91-00c4-4d48-8156-7fc92d56f546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db030913059f486aa93e4cd9701d33ff)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:32.047848 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08ea91-00c4-4d48-8156-7fc92d56f546 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:32.063545 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:32.094110 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0f08ea91-00c4-4d48-8156-7fc92d56f546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db030913059f486aa93e4cd9701d33ff', 'request_id': 'req-0f08ea91-00c4-4d48-8156-7fc92d56f546'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:32.100299 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0f08ea91-00c4-4d48-8156-7fc92d56f546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db030913059f486aa93e4cd9701d33ff', 'request_id': 'req-0f08ea91-00c4-4d48-8156-7fc92d56f546'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:32.107507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0f08ea91-00c4-4d48-8156-7fc92d56f546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db030913059f486aa93e4cd9701d33ff', 'request_id': 'req-0f08ea91-00c4-4d48-8156-7fc92d56f546'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:32.118888 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0f08ea91-00c4-4d48-8156-7fc92d56f546 admin admin] The token cache is being invalidate because project db030913059f486aa93e4cd9701d33ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:32.119212 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0f08ea91-00c4-4d48-8156-7fc92d56f546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:32.119877 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0f08ea91-00c4-4d48-8156-7fc92d56f546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:32.121722 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1294/2557] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:31 2022] DELETE /identity/v3/projects/db030913059f486aa93e4cd9701d33ff => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:02:32.126721 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dfef8-4c73-4ebe-882a-c38bf345e461 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:32.127175 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dfef8-4c73-4ebe-882a-c38bf345e461 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:32.127272 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dfef8-4c73-4ebe-882a-c38bf345e461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:32.147942 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d73dfef8-4c73-4ebe-882a-c38bf345e461 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:32.149197 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d73dfef8-4c73-4ebe-882a-c38bf345e461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:32.212540 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1264/2558] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:32.222280 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb18da-d867-442e-9f9b-5a0cedfe4984 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:32.222565 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb18da-d867-442e-9f9b-5a0cedfe4984 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:32.222842 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb18da-d867-442e-9f9b-5a0cedfe4984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:32.243590 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ebeb18da-d867-442e-9f9b-5a0cedfe4984 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:32.244813 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ebeb18da-d867-442e-9f9b-5a0cedfe4984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:32.253493 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1295/2559] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:32.257865 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73dfef8-4c73-4ebe-882a-c38bf345e461 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:32.269680 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73dfef8-4c73-4ebe-882a-c38bf345e461 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:32.274320 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031204e-835e-4023-bcde-68f2f80e3db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:32.274911 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031204e-835e-4023-bcde-68f2f80e3db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:32.275192 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031204e-835e-4023-bcde-68f2f80e3db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:32.275463 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031204e-835e-4023-bcde-68f2f80e3db6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:32.276103 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031204e-835e-4023-bcde-68f2f80e3db6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:02:32.276401 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031204e-835e-4023-bcde-68f2f80e3db6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:32.278164 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031204e-835e-4023-bcde-68f2f80e3db6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:32.289887 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1265/2560] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:02:32.294397 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb18da-d867-442e-9f9b-5a0cedfe4984 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:32.303981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb18da-d867-442e-9f9b-5a0cedfe4984 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:32.309861 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34139b8d-6878-4b33-866f-ffbd8c893632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:32.310644 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139b8d-6878-4b33-866f-ffbd8c893632 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:32.310992 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139b8d-6878-4b33-866f-ffbd8c893632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:32.311270 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139b8d-6878-4b33-866f-ffbd8c893632 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:32.311926 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34139b8d-6878-4b33-866f-ffbd8c893632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:32.314132 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34139b8d-6878-4b33-866f-ffbd8c893632 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:32.344883 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1296/2561] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:32 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:32.350209 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031204e-835e-4023-bcde-68f2f80e3db6 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:32.360233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031204e-835e-4023-bcde-68f2f80e3db6 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:32.419507 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df490a-edd6-4276-9387-9b4998c5c76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:32.420119 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df490a-edd6-4276-9387-9b4998c5c76c admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:32.420425 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df490a-edd6-4276-9387-9b4998c5c76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:32.420691 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df490a-edd6-4276-9387-9b4998c5c76c admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:32.421351 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df490a-edd6-4276-9387-9b4998c5c76c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:32.423305 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df490a-edd6-4276-9387-9b4998c5c76c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:32.434821 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:32.447135 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1266/2562] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:32 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:32.451840 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34139b8d-6878-4b33-866f-ffbd8c893632 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:32.462903 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34139b8d-6878-4b33-866f-ffbd8c893632 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:32.467901 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9451d-1901-401b-ad27-4c68d1a1defa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:32.468496 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9451d-1901-401b-ad27-4c68d1a1defa admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:32.468774 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9451d-1901-401b-ad27-4c68d1a1defa admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:32.469080 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9451d-1901-401b-ad27-4c68d1a1defa admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:32.469716 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9451d-1901-401b-ad27-4c68d1a1defa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:32.471349 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9451d-1901-401b-ad27-4c68d1a1defa admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:32.481759 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1297/2563] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:32.485739 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df490a-edd6-4276-9387-9b4998c5c76c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:32.496706 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df490a-edd6-4276-9387-9b4998c5c76c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:32.501785 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4058d4d-6436-4a79-9385-e8171d746efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:32.502380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4058d4d-6436-4a79-9385-e8171d746efa admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:32.502661 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4058d4d-6436-4a79-9385-e8171d746efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:32.502935 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4058d4d-6436-4a79-9385-e8171d746efa admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:32.503578 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4058d4d-6436-4a79-9385-e8171d746efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:32.505221 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4058d4d-6436-4a79-9385-e8171d746efa admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:32.516896 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1267/2564] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:32.521127 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9451d-1901-401b-ad27-4c68d1a1defa admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:32.532142 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9451d-1901-401b-ad27-4c68d1a1defa admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:32.537186 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e258a-8cab-48e0-83ac-ac832e16ddc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:32.537837 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e258a-8cab-48e0-83ac-ac832e16ddc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:32.538118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e258a-8cab-48e0-83ac-ac832e16ddc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:32.538391 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e258a-8cab-48e0-83ac-ac832e16ddc5 admin admin] PATH_INFO: `/v3/projects/0bd8190faf8b4abe8b9fe2479e06d184/users/3d715cb11ad446a5abc205b0abc2c038/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:32.553404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e258a-8cab-48e0-83ac-ac832e16ddc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bd8190faf8b4abe8b9fe2479e06d184, user_id=3d715cb11ad446a5abc205b0abc2c038, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:32.556044 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e258a-8cab-48e0-83ac-ac832e16ddc5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:32.570297 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1298/2565] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:32 2022] PUT /identity/v3/projects/0bd8190faf8b4abe8b9fe2479e06d184/users/3d715cb11ad446a5abc205b0abc2c038/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:32.581089 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826c76f-0cf3-4d02-97c7-6e4d416517ca None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:32.581308 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826c76f-0cf3-4d02-97c7-6e4d416517ca None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:32.581582 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826c76f-0cf3-4d02-97c7-6e4d416517ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:32.611940 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5826c76f-0cf3-4d02-97c7-6e4d416517ca None None] MFA Rules not processed for user `3d715cb11ad446a5abc205b0abc2c038`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:32.613218 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5826c76f-0cf3-4d02-97c7-6e4d416517ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:32.679099 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1268/2566] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:32.684220 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e258a-8cab-48e0-83ac-ac832e16ddc5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:32.747744 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e258a-8cab-48e0-83ac-ac832e16ddc5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:32.752745 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec985a-a800-47ad-b73a-7c4adf26b3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:32.753403 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec985a-a800-47ad-b73a-7c4adf26b3ab admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:32.753681 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec985a-a800-47ad-b73a-7c4adf26b3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:32.753947 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec985a-a800-47ad-b73a-7c4adf26b3ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:32.754560 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec985a-a800-47ad-b73a-7c4adf26b3ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:32.756449 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec985a-a800-47ad-b73a-7c4adf26b3ab admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:32.784017 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1299/2567] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:32 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:32.788132 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826c76f-0cf3-4d02-97c7-6e4d416517ca None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:32.799986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826c76f-0cf3-4d02-97c7-6e4d416517ca None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:32.860409 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3edc4e-6d45-4fc5-8833-d0e8225bcbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:32.860930 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3edc4e-6d45-4fc5-8833-d0e8225bcbae admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:32.861238 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3edc4e-6d45-4fc5-8833-d0e8225bcbae admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:32.861509 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3edc4e-6d45-4fc5-8833-d0e8225bcbae admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:32.862133 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3edc4e-6d45-4fc5-8833-d0e8225bcbae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:32.864056 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3edc4e-6d45-4fc5-8833-d0e8225bcbae admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:32.886036 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1269/2568] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:32 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:02:32.890306 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec985a-a800-47ad-b73a-7c4adf26b3ab admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:32.900541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec985a-a800-47ad-b73a-7c4adf26b3ab admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:32.905321 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e244311-ee29-4525-8422-ad587a3d440c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:32.905922 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e244311-ee29-4525-8422-ad587a3d440c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:32.906198 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e244311-ee29-4525-8422-ad587a3d440c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:32.906462 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e244311-ee29-4525-8422-ad587a3d440c admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:32.907130 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e244311-ee29-4525-8422-ad587a3d440c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:32.908707 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e244311-ee29-4525-8422-ad587a3d440c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:32.920901 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1300/2569] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:32.925276 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3edc4e-6d45-4fc5-8833-d0e8225bcbae admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:32.936342 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3edc4e-6d45-4fc5-8833-d0e8225bcbae admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:32.941203 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69441970-827f-4c2b-bb1e-742380b818c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:32.941858 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69441970-827f-4c2b-bb1e-742380b818c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:32.942140 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69441970-827f-4c2b-bb1e-742380b818c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:32.942412 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69441970-827f-4c2b-bb1e-742380b818c7 admin admin] PATH_INFO: `/v3/projects/b44da2deb3794084b50b14280b56d69f/users/8f4935b7d2d94faf8c932741c3a0453f/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:32.962674 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69441970-827f-4c2b-bb1e-742380b818c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44da2deb3794084b50b14280b56d69f, user_id=8f4935b7d2d94faf8c932741c3a0453f, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:32.965919 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69441970-827f-4c2b-bb1e-742380b818c7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:32.981821 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1270/2570] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:32 2022] PUT /identity/v3/projects/b44da2deb3794084b50b14280b56d69f/users/8f4935b7d2d94faf8c932741c3a0453f/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:02:32.986197 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e244311-ee29-4525-8422-ad587a3d440c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:32.998198 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e244311-ee29-4525-8422-ad587a3d440c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:33.008501 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:33.063064 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d32c7-6224-4013-8a4f-ea92042d3ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:33.063683 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d32c7-6224-4013-8a4f-ea92042d3ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:33.063968 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d32c7-6224-4013-8a4f-ea92042d3ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:33.064238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d32c7-6224-4013-8a4f-ea92042d3ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:33.064880 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d32c7-6224-4013-8a4f-ea92042d3ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:33.066510 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d32c7-6224-4013-8a4f-ea92042d3ba1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:33.077607 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1301/2571] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:33.081826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69441970-827f-4c2b-bb1e-742380b818c7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:33.092998 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69441970-827f-4c2b-bb1e-742380b818c7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:33.097826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40006768-8b9a-4256-b135-5ba4ba125f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:33.098476 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40006768-8b9a-4256-b135-5ba4ba125f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:33.098763 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40006768-8b9a-4256-b135-5ba4ba125f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:33.099042 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40006768-8b9a-4256-b135-5ba4ba125f79 admin admin] PATH_INFO: `/v3/projects/b44da2deb3794084b50b14280b56d69f/users/8f4935b7d2d94faf8c932741c3a0453f/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:33.101083 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40006768-8b9a-4256-b135-5ba4ba125f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44da2deb3794084b50b14280b56d69f, user_id=8f4935b7d2d94faf8c932741c3a0453f, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:33.103776 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40006768-8b9a-4256-b135-5ba4ba125f79 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:33.115344 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1271/2572] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:33 2022] PUT /identity/v3/projects/b44da2deb3794084b50b14280b56d69f/users/8f4935b7d2d94faf8c932741c3a0453f/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:33.127695 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7272d5-078d-4eab-9bc2-31aa4d4a18e1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:33.127982 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7272d5-078d-4eab-9bc2-31aa4d4a18e1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:33.128289 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7272d5-078d-4eab-9bc2-31aa4d4a18e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:33.159922 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ac7272d5-078d-4eab-9bc2-31aa4d4a18e1 None None] MFA Rules not processed for user `8f4935b7d2d94faf8c932741c3a0453f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:33.161177 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ac7272d5-078d-4eab-9bc2-31aa4d4a18e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:33.238835 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1302/2573] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:33.250241 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40006768-8b9a-4256-b135-5ba4ba125f79 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:33.252063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-40006768-8b9a-4256-b135-5ba4ba125f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:33.300274 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:33.331711 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40006768-8b9a-4256-b135-5ba4ba125f79 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:33.335467 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23c09f-4605-49ac-bc1e-be0b1038df7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:33.336074 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23c09f-4605-49ac-bc1e-be0b1038df7b service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:33.336352 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23c09f-4605-49ac-bc1e-be0b1038df7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:33.336632 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23c09f-4605-49ac-bc1e-be0b1038df7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:33.346726 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23c09f-4605-49ac-bc1e-be0b1038df7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:33.348283 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23c09f-4605-49ac-bc1e-be0b1038df7b service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:33.368010 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1272/2574] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:33.805960 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7272d5-078d-4eab-9bc2-31aa4d4a18e1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:33.868958 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7272d5-078d-4eab-9bc2-31aa4d4a18e1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:33.874159 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f423a1-05d7-4e33-ac55-1b39698dd0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:33.874713 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f423a1-05d7-4e33-ac55-1b39698dd0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:33.874989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f423a1-05d7-4e33-ac55-1b39698dd0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:33.875258 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f423a1-05d7-4e33-ac55-1b39698dd0cc admin admin] PATH_INFO: `/v3/users/3d715cb11ad446a5abc205b0abc2c038` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:33.876355 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f423a1-05d7-4e33-ac55-1b39698dd0cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d715cb11ad446a5abc205b0abc2c038)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:33.878313 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f423a1-05d7-4e33-ac55-1b39698dd0cc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:33.917015 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:33.927250 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d8f423a1-05d7-4e33-ac55-1b39698dd0cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d715cb11ad446a5abc205b0abc2c038'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:33.927898 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d8f423a1-05d7-4e33-ac55-1b39698dd0cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d715cb11ad446a5abc205b0abc2c038'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:33.940318 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d8f423a1-05d7-4e33-ac55-1b39698dd0cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d715cb11ad446a5abc205b0abc2c038'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:33.947385 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d8f423a1-05d7-4e33-ac55-1b39698dd0cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d715cb11ad446a5abc205b0abc2c038'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:33.948069 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d8f423a1-05d7-4e33-ac55-1b39698dd0cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d715cb11ad446a5abc205b0abc2c038'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:33.960642 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1303/2575] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:33 2022] DELETE /identity/v3/users/3d715cb11ad446a5abc205b0abc2c038 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:33.965564 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295664e7-2a4d-424a-b2a2-53828c13d608 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:33.965859 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295664e7-2a4d-424a-b2a2-53828c13d608 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:33.966138 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295664e7-2a4d-424a-b2a2-53828c13d608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:33.984897 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-295664e7-2a4d-424a-b2a2-53828c13d608 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:33.986143 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-295664e7-2a4d-424a-b2a2-53828c13d608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:34.051041 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1273/2576] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:34.061928 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f423a1-05d7-4e33-ac55-1b39698dd0cc admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:34.063443 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d8f423a1-05d7-4e33-ac55-1b39698dd0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:34.123283 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f423a1-05d7-4e33-ac55-1b39698dd0cc admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:34.126969 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae5c95-db18-41c5-8209-d6d7c80debd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:34.127514 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae5c95-db18-41c5-8209-d6d7c80debd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:34.127790 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae5c95-db18-41c5-8209-d6d7c80debd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:34.128058 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae5c95-db18-41c5-8209-d6d7c80debd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:34.137610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae5c95-db18-41c5-8209-d6d7c80debd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:34.139032 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae5c95-db18-41c5-8209-d6d7c80debd4 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:34.148490 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1304/2577] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:34.439016 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295664e7-2a4d-424a-b2a2-53828c13d608 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:34.440558 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-295664e7-2a4d-424a-b2a2-53828c13d608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:34.454522 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295664e7-2a4d-424a-b2a2-53828c13d608 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:34.459533 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b06f79-6382-498d-83b1-018d6ab71f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:34.460171 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b06f79-6382-498d-83b1-018d6ab71f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:34.460453 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b06f79-6382-498d-83b1-018d6ab71f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:34.460728 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b06f79-6382-498d-83b1-018d6ab71f0e admin admin] PATH_INFO: `/v3/projects/0bd8190faf8b4abe8b9fe2479e06d184` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:34.461899 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b06f79-6382-498d-83b1-018d6ab71f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bd8190faf8b4abe8b9fe2479e06d184)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:34.463832 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b06f79-6382-498d-83b1-018d6ab71f0e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:34.519693 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-95b06f79-6382-498d-83b1-018d6ab71f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bd8190faf8b4abe8b9fe2479e06d184', 'request_id': 'req-95b06f79-6382-498d-83b1-018d6ab71f0e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:34.526770 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-95b06f79-6382-498d-83b1-018d6ab71f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bd8190faf8b4abe8b9fe2479e06d184', 'request_id': 'req-95b06f79-6382-498d-83b1-018d6ab71f0e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:34.535204 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-95b06f79-6382-498d-83b1-018d6ab71f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bd8190faf8b4abe8b9fe2479e06d184', 'request_id': 'req-95b06f79-6382-498d-83b1-018d6ab71f0e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:34.547822 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-95b06f79-6382-498d-83b1-018d6ab71f0e admin admin] The token cache is being invalidate because project 0bd8190faf8b4abe8b9fe2479e06d184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:34.548111 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-95b06f79-6382-498d-83b1-018d6ab71f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:34.548757 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-95b06f79-6382-498d-83b1-018d6ab71f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:34.550680 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1274/2578] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:34 2022] DELETE /identity/v3/projects/0bd8190faf8b4abe8b9fe2479e06d184 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:34.554757 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae5c95-db18-41c5-8209-d6d7c80debd4 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:34.565080 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae5c95-db18-41c5-8209-d6d7c80debd4 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:34.625790 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe78a33-d0ee-4992-af2d-f308c11f766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:34.626420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe78a33-d0ee-4992-af2d-f308c11f766e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:34.626738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe78a33-d0ee-4992-af2d-f308c11f766e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:34.626964 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe78a33-d0ee-4992-af2d-f308c11f766e admin admin] PATH_INFO: `/v3/users/8f4935b7d2d94faf8c932741c3a0453f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:34.628139 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe78a33-d0ee-4992-af2d-f308c11f766e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f4935b7d2d94faf8c932741c3a0453f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:34.630106 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe78a33-d0ee-4992-af2d-f308c11f766e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:34.676616 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dbe78a33-d0ee-4992-af2d-f308c11f766e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f4935b7d2d94faf8c932741c3a0453f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:34.677267 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dbe78a33-d0ee-4992-af2d-f308c11f766e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f4935b7d2d94faf8c932741c3a0453f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:34.685491 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:34.690420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dbe78a33-d0ee-4992-af2d-f308c11f766e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f4935b7d2d94faf8c932741c3a0453f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:34.698175 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dbe78a33-d0ee-4992-af2d-f308c11f766e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f4935b7d2d94faf8c932741c3a0453f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:34.698798 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dbe78a33-d0ee-4992-af2d-f308c11f766e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f4935b7d2d94faf8c932741c3a0453f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:34.711717 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1305/2579] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:34 2022] DELETE /identity/v3/users/8f4935b7d2d94faf8c932741c3a0453f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:34.983882 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b06f79-6382-498d-83b1-018d6ab71f0e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:34.985542 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-95b06f79-6382-498d-83b1-018d6ab71f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:35.000422 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b06f79-6382-498d-83b1-018d6ab71f0e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:35.049781 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:35.060967 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5485647-294c-4fa3-b3f3-b7769e4f2ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:35.061653 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5485647-294c-4fa3-b3f3-b7769e4f2ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:35.062043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5485647-294c-4fa3-b3f3-b7769e4f2ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:35.062317 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5485647-294c-4fa3-b3f3-b7769e4f2ad5 admin admin] PATH_INFO: `/v3/projects/b44da2deb3794084b50b14280b56d69f` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:35.063562 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5485647-294c-4fa3-b3f3-b7769e4f2ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44da2deb3794084b50b14280b56d69f)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:35.065541 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5485647-294c-4fa3-b3f3-b7769e4f2ad5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:35.111509 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e5485647-294c-4fa3-b3f3-b7769e4f2ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44da2deb3794084b50b14280b56d69f', 'request_id': 'req-e5485647-294c-4fa3-b3f3-b7769e4f2ad5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:35.118789 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e5485647-294c-4fa3-b3f3-b7769e4f2ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44da2deb3794084b50b14280b56d69f', 'request_id': 'req-e5485647-294c-4fa3-b3f3-b7769e4f2ad5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:35.127010 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e5485647-294c-4fa3-b3f3-b7769e4f2ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44da2deb3794084b50b14280b56d69f', 'request_id': 'req-e5485647-294c-4fa3-b3f3-b7769e4f2ad5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:35.137405 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e5485647-294c-4fa3-b3f3-b7769e4f2ad5 admin admin] The token cache is being invalidate because project b44da2deb3794084b50b14280b56d69f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:35.137694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e5485647-294c-4fa3-b3f3-b7769e4f2ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:35.138321 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e5485647-294c-4fa3-b3f3-b7769e4f2ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:35.139782 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1275/2580] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:34 2022] DELETE /identity/v3/projects/b44da2deb3794084b50b14280b56d69f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:35.144638 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014d683-5e72-4d28-8bfe-c8aa061be30d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:35.145183 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014d683-5e72-4d28-8bfe-c8aa061be30d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:35.145317 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014d683-5e72-4d28-8bfe-c8aa061be30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:35.164829 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3014d683-5e72-4d28-8bfe-c8aa061be30d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:35.166080 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3014d683-5e72-4d28-8bfe-c8aa061be30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:35.225853 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1306/2581] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:35.234273 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5e496-eb6b-44b9-b0cf-6614aeb17c2d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:35.234555 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5e496-eb6b-44b9-b0cf-6614aeb17c2d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:35.234823 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5e496-eb6b-44b9-b0cf-6614aeb17c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:35.255250 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-fde5e496-eb6b-44b9-b0cf-6614aeb17c2d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:35.256581 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fde5e496-eb6b-44b9-b0cf-6614aeb17c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:35.264375 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1276/2582] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:35.268887 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014d683-5e72-4d28-8bfe-c8aa061be30d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:35.279466 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014d683-5e72-4d28-8bfe-c8aa061be30d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:35.288022 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a114f11-6856-4250-8a12-6139da9f26d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:35.288622 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a114f11-6856-4250-8a12-6139da9f26d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:35.288905 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a114f11-6856-4250-8a12-6139da9f26d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:35.289209 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a114f11-6856-4250-8a12-6139da9f26d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:35.289852 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a114f11-6856-4250-8a12-6139da9f26d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:02:35.290156 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a114f11-6856-4250-8a12-6139da9f26d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:35.291873 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a114f11-6856-4250-8a12-6139da9f26d5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:35.304310 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1307/2583] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:02:35.308900 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5e496-eb6b-44b9-b0cf-6614aeb17c2d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:35.318277 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5e496-eb6b-44b9-b0cf-6614aeb17c2d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:35.322942 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d34f1-4fa8-4ad8-a9c5-d87b76682483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:35.323550 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d34f1-4fa8-4ad8-a9c5-d87b76682483 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:35.323828 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d34f1-4fa8-4ad8-a9c5-d87b76682483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:35.324238 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d34f1-4fa8-4ad8-a9c5-d87b76682483 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:35.325078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d34f1-4fa8-4ad8-a9c5-d87b76682483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:35.326981 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d34f1-4fa8-4ad8-a9c5-d87b76682483 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:35.354323 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1277/2584] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:35 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:35.359116 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a114f11-6856-4250-8a12-6139da9f26d5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:35.370001 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a114f11-6856-4250-8a12-6139da9f26d5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:35.429041 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7693b95-fa4b-42f6-82cb-54671230b22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:35.429653 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7693b95-fa4b-42f6-82cb-54671230b22b admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:35.429935 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7693b95-fa4b-42f6-82cb-54671230b22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:35.430214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7693b95-fa4b-42f6-82cb-54671230b22b admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:35.430857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7693b95-fa4b-42f6-82cb-54671230b22b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:35.432783 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7693b95-fa4b-42f6-82cb-54671230b22b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:35.459693 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1308/2585] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:35 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:02:35.465506 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d34f1-4fa8-4ad8-a9c5-d87b76682483 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:35.478302 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d34f1-4fa8-4ad8-a9c5-d87b76682483 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:35.483930 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf3a5f-55c1-406a-a297-c6accccb8a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:35.484545 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf3a5f-55c1-406a-a297-c6accccb8a34 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:35.484827 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf3a5f-55c1-406a-a297-c6accccb8a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:35.485131 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf3a5f-55c1-406a-a297-c6accccb8a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:35.485777 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf3a5f-55c1-406a-a297-c6accccb8a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:35.487373 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf3a5f-55c1-406a-a297-c6accccb8a34 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:35.497838 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1278/2586] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:02:35.503942 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7693b95-fa4b-42f6-82cb-54671230b22b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:35.514571 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7693b95-fa4b-42f6-82cb-54671230b22b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:35.519480 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd5071-d10d-4ebe-9818-9eaa720fdace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:35.520090 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd5071-d10d-4ebe-9818-9eaa720fdace admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:35.520372 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd5071-d10d-4ebe-9818-9eaa720fdace admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:35.520644 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd5071-d10d-4ebe-9818-9eaa720fdace admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:35.521322 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd5071-d10d-4ebe-9818-9eaa720fdace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:35.522947 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd5071-d10d-4ebe-9818-9eaa720fdace admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:35.534841 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1309/2587] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:35.539507 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf3a5f-55c1-406a-a297-c6accccb8a34 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:35.553181 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf3a5f-55c1-406a-a297-c6accccb8a34 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:35.556008 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4237e4c-5f2b-4fb2-b05d-f50063b0944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:35.556679 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4237e4c-5f2b-4fb2-b05d-f50063b0944b admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:35.557000 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4237e4c-5f2b-4fb2-b05d-f50063b0944b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:35.557327 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4237e4c-5f2b-4fb2-b05d-f50063b0944b admin admin] PATH_INFO: `/v3/projects/f133449dedf340198ad34060852dbc4e/users/f3bce4ab82b34dbd96e9815f71ce4a3b/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:35.574880 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4237e4c-5f2b-4fb2-b05d-f50063b0944b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f133449dedf340198ad34060852dbc4e, user_id=f3bce4ab82b34dbd96e9815f71ce4a3b, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:35.577678 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4237e4c-5f2b-4fb2-b05d-f50063b0944b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:35.591740 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1279/2588] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:35 2022] PUT /identity/v3/projects/f133449dedf340198ad34060852dbc4e/users/f3bce4ab82b34dbd96e9815f71ce4a3b/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:02:35.603020 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc2316-42ef-4331-805e-54bef8c17782 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:35.603313 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc2316-42ef-4331-805e-54bef8c17782 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:35.603594 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc2316-42ef-4331-805e-54bef8c17782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:35.634521 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e2dc2316-42ef-4331-805e-54bef8c17782 None None] MFA Rules not processed for user `f3bce4ab82b34dbd96e9815f71ce4a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:35.635780 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e2dc2316-42ef-4331-805e-54bef8c17782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:35.669060 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:35.709715 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1310/2589] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:35.721864 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4237e4c-5f2b-4fb2-b05d-f50063b0944b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:35.724075 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e4237e4c-5f2b-4fb2-b05d-f50063b0944b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:35.790413 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4237e4c-5f2b-4fb2-b05d-f50063b0944b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:35.794669 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c54be-df48-4923-9406-68a157b64277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:35.795289 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c54be-df48-4923-9406-68a157b64277 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:35.795571 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c54be-df48-4923-9406-68a157b64277 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:35.795839 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c54be-df48-4923-9406-68a157b64277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:35.805156 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c54be-df48-4923-9406-68a157b64277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:35.806595 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c54be-df48-4923-9406-68a157b64277 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:35.816907 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1280/2590] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:36.853826 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb3f08-9011-4184-9555-7a9621dbcd37 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:36.854461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb3f08-9011-4184-9555-7a9621dbcd37 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:36.854461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb3f08-9011-4184-9555-7a9621dbcd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:36.875913 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7edb3f08-9011-4184-9555-7a9621dbcd37 None None] MFA Rules not processed for user `3fe1c1254c2b4d98942176ce0c0f2502`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:36.877173 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7edb3f08-9011-4184-9555-7a9621dbcd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:36.932488 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1311/2591] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:41.300960 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c54be-df48-4923-9406-68a157b64277 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:41.336381 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:41.377009 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c54be-df48-4923-9406-68a157b64277 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:41.381383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c510af-ee07-4e90-8923-70b5c7dbfd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:41.382002 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c510af-ee07-4e90-8923-70b5c7dbfd52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:41.382316 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c510af-ee07-4e90-8923-70b5c7dbfd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:41.382583 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c510af-ee07-4e90-8923-70b5c7dbfd52 admin admin] PATH_INFO: `/v3/users/f3bce4ab82b34dbd96e9815f71ce4a3b` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:41.384263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c510af-ee07-4e90-8923-70b5c7dbfd52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3bce4ab82b34dbd96e9815f71ce4a3b)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:41.386195 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c510af-ee07-4e90-8923-70b5c7dbfd52 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:41.433786 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-70c510af-ee07-4e90-8923-70b5c7dbfd52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3bce4ab82b34dbd96e9815f71ce4a3b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:41.434436 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-70c510af-ee07-4e90-8923-70b5c7dbfd52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3bce4ab82b34dbd96e9815f71ce4a3b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:41.444732 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-70c510af-ee07-4e90-8923-70b5c7dbfd52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3bce4ab82b34dbd96e9815f71ce4a3b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:41.445398 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-70c510af-ee07-4e90-8923-70b5c7dbfd52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3bce4ab82b34dbd96e9815f71ce4a3b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:41.454583 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-70c510af-ee07-4e90-8923-70b5c7dbfd52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3bce4ab82b34dbd96e9815f71ce4a3b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:41.473064 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1281/2592] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:41 2022] DELETE /identity/v3/users/f3bce4ab82b34dbd96e9815f71ce4a3b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:41.477584 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae07b01-712f-468f-8ca6-c3b58e1204be None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:41.478044 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae07b01-712f-468f-8ca6-c3b58e1204be None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:41.478163 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae07b01-712f-468f-8ca6-c3b58e1204be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:41.497885 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5ae07b01-712f-468f-8ca6-c3b58e1204be None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:41.499311 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5ae07b01-712f-468f-8ca6-c3b58e1204be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:41.557955 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1312/2593] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:41.568596 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c510af-ee07-4e90-8923-70b5c7dbfd52 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:41.570004 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-70c510af-ee07-4e90-8923-70b5c7dbfd52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:41.634523 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c510af-ee07-4e90-8923-70b5c7dbfd52 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:41.639500 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a2e61-d3e6-41c5-b686-1c4324c08104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:41.640120 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a2e61-d3e6-41c5-b686-1c4324c08104 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:41.640399 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a2e61-d3e6-41c5-b686-1c4324c08104 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:41.640669 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a2e61-d3e6-41c5-b686-1c4324c08104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:41.651825 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a2e61-d3e6-41c5-b686-1c4324c08104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:41.653314 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a2e61-d3e6-41c5-b686-1c4324c08104 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:41.663931 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1282/2594] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:42.106419 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae07b01-712f-468f-8ca6-c3b58e1204be None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:42.108736 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5ae07b01-712f-468f-8ca6-c3b58e1204be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:42.121920 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae07b01-712f-468f-8ca6-c3b58e1204be None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:42.133880 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed679e-d66e-4ff4-ae9a-b3ffc5bda63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:42.134912 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed679e-d66e-4ff4-ae9a-b3ffc5bda63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:42.135404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed679e-d66e-4ff4-ae9a-b3ffc5bda63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:42.135885 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed679e-d66e-4ff4-ae9a-b3ffc5bda63b admin admin] PATH_INFO: `/v3/projects/f133449dedf340198ad34060852dbc4e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:42.142619 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed679e-d66e-4ff4-ae9a-b3ffc5bda63b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f133449dedf340198ad34060852dbc4e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:42.145941 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed679e-d66e-4ff4-ae9a-b3ffc5bda63b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:42.203583 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6ed679e-d66e-4ff4-ae9a-b3ffc5bda63b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f133449dedf340198ad34060852dbc4e', 'request_id': 'req-b6ed679e-d66e-4ff4-ae9a-b3ffc5bda63b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:42.210038 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6ed679e-d66e-4ff4-ae9a-b3ffc5bda63b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f133449dedf340198ad34060852dbc4e', 'request_id': 'req-b6ed679e-d66e-4ff4-ae9a-b3ffc5bda63b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:42.220201 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6ed679e-d66e-4ff4-ae9a-b3ffc5bda63b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f133449dedf340198ad34060852dbc4e', 'request_id': 'req-b6ed679e-d66e-4ff4-ae9a-b3ffc5bda63b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:42.229519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:42.234208 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6ed679e-d66e-4ff4-ae9a-b3ffc5bda63b admin admin] The token cache is being invalidate because project f133449dedf340198ad34060852dbc4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:42.234890 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6ed679e-d66e-4ff4-ae9a-b3ffc5bda63b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:42.236303 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6ed679e-d66e-4ff4-ae9a-b3ffc5bda63b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:42.238537 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1313/2595] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:42 2022] DELETE /identity/v3/projects/f133449dedf340198ad34060852dbc4e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:42.243650 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f9aa9-ce8c-48e5-b799-e1fd44d725d5 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:42.244640 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f9aa9-ce8c-48e5-b799-e1fd44d725d5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:42.244917 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f9aa9-ce8c-48e5-b799-e1fd44d725d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:42.266347 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-753f9aa9-ce8c-48e5-b799-e1fd44d725d5 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:42.267579 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-753f9aa9-ce8c-48e5-b799-e1fd44d725d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:42.309585 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:42.333222 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1283/2596] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:42.399698 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c3bda-024b-4301-a2e8-212af2d237c9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:42.399986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c3bda-024b-4301-a2e8-212af2d237c9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:42.400262 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c3bda-024b-4301-a2e8-212af2d237c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:42.424375 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-298c3bda-024b-4301-a2e8-212af2d237c9 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:42.425613 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-298c3bda-024b-4301-a2e8-212af2d237c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:42.433492 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1314/2597] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:42.438456 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f9aa9-ce8c-48e5-b799-e1fd44d725d5 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:42.448903 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f9aa9-ce8c-48e5-b799-e1fd44d725d5 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:42.454334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916a48a-8984-47d4-836b-5eb1e9ba545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:42.455016 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916a48a-8984-47d4-836b-5eb1e9ba545b admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:42.455363 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916a48a-8984-47d4-836b-5eb1e9ba545b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:42.455705 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916a48a-8984-47d4-836b-5eb1e9ba545b admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:42.456424 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916a48a-8984-47d4-836b-5eb1e9ba545b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:02:42.456803 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916a48a-8984-47d4-836b-5eb1e9ba545b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:42.458598 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916a48a-8984-47d4-836b-5eb1e9ba545b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:42.471074 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1284/2598] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:02:42.475418 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c3bda-024b-4301-a2e8-212af2d237c9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:42.485799 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c3bda-024b-4301-a2e8-212af2d237c9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:42.490994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec1554-d172-46c6-8d78-3a4f659eab60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:42.491697 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec1554-d172-46c6-8d78-3a4f659eab60 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:42.492047 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec1554-d172-46c6-8d78-3a4f659eab60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:42.492385 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec1554-d172-46c6-8d78-3a4f659eab60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:42.493133 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec1554-d172-46c6-8d78-3a4f659eab60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:42.495111 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec1554-d172-46c6-8d78-3a4f659eab60 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:42.523684 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1315/2599] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:42 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:42.527841 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916a48a-8984-47d4-836b-5eb1e9ba545b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:42.538457 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916a48a-8984-47d4-836b-5eb1e9ba545b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:42.597842 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a826074-2b40-4358-ab58-9633fa2e9aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:42.598346 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a826074-2b40-4358-ab58-9633fa2e9aac admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:42.598650 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a826074-2b40-4358-ab58-9633fa2e9aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:42.598917 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a826074-2b40-4358-ab58-9633fa2e9aac admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:42.599559 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a826074-2b40-4358-ab58-9633fa2e9aac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:42.601566 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a826074-2b40-4358-ab58-9633fa2e9aac admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:42.625487 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1285/2600] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:42 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:42.629997 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec1554-d172-46c6-8d78-3a4f659eab60 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:42.640761 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec1554-d172-46c6-8d78-3a4f659eab60 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:42.645349 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb7bad-7802-4096-9481-2c7f115d5185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:42.645959 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb7bad-7802-4096-9481-2c7f115d5185 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:42.646231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb7bad-7802-4096-9481-2c7f115d5185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:42.646497 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb7bad-7802-4096-9481-2c7f115d5185 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:42.647125 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb7bad-7802-4096-9481-2c7f115d5185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:42.648694 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb7bad-7802-4096-9481-2c7f115d5185 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:42.658773 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1316/2601] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:42.662951 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a826074-2b40-4358-ab58-9633fa2e9aac admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:42.673939 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a826074-2b40-4358-ab58-9633fa2e9aac admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:42.678563 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab87516-34ce-499a-806e-9475a8543916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:42.679150 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87516-34ce-499a-806e-9475a8543916 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:42.679425 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87516-34ce-499a-806e-9475a8543916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:42.679694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87516-34ce-499a-806e-9475a8543916 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:42.680321 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab87516-34ce-499a-806e-9475a8543916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:42.681935 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab87516-34ce-499a-806e-9475a8543916 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:42.693380 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1286/2602] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:42.697510 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb7bad-7802-4096-9481-2c7f115d5185 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:42.707492 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb7bad-7802-4096-9481-2c7f115d5185 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:42.712126 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d051d-5faf-4b54-982c-03b67c7bdc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:42.712764 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d051d-5faf-4b54-982c-03b67c7bdc45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:42.713075 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d051d-5faf-4b54-982c-03b67c7bdc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:42.713344 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d051d-5faf-4b54-982c-03b67c7bdc45 admin admin] PATH_INFO: `/v3/projects/441780e6f659495f959e1b04b2776882/users/a26fb01f71cb4a31bbc16a822800d2e8/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:42.728611 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d051d-5faf-4b54-982c-03b67c7bdc45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=441780e6f659495f959e1b04b2776882, user_id=a26fb01f71cb4a31bbc16a822800d2e8, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:42.731305 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d051d-5faf-4b54-982c-03b67c7bdc45 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:42.745847 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1317/2603] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:42 2022] PUT /identity/v3/projects/441780e6f659495f959e1b04b2776882/users/a26fb01f71cb4a31bbc16a822800d2e8/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:42.755969 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142eae89-564a-412e-80aa-4b10742b5903 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:42.756263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142eae89-564a-412e-80aa-4b10742b5903 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:42.756562 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142eae89-564a-412e-80aa-4b10742b5903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:42.785459 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-142eae89-564a-412e-80aa-4b10742b5903 None None] MFA Rules not processed for user `a26fb01f71cb4a31bbc16a822800d2e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:42.786688 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-142eae89-564a-412e-80aa-4b10742b5903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:42.852225 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1287/2604] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:42.863554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d051d-5faf-4b54-982c-03b67c7bdc45 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:42.865293 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-869d051d-5faf-4b54-982c-03b67c7bdc45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:42.924421 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d051d-5faf-4b54-982c-03b67c7bdc45 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:42.928092 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba5079-729c-4f80-84b9-51f21e275d3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:42.928687 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba5079-729c-4f80-84b9-51f21e275d3b service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:42.928988 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba5079-729c-4f80-84b9-51f21e275d3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:42.929261 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba5079-729c-4f80-84b9-51f21e275d3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:42.937570 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba5079-729c-4f80-84b9-51f21e275d3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:42.938986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba5079-729c-4f80-84b9-51f21e275d3b service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:42.947700 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1318/2605] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:45.988460 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142eae89-564a-412e-80aa-4b10742b5903 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:46.032896 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:46.055776 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142eae89-564a-412e-80aa-4b10742b5903 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:46.061078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760aeac5-1908-4d29-837e-f21ee41583a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:46.061714 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760aeac5-1908-4d29-837e-f21ee41583a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:46.061993 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760aeac5-1908-4d29-837e-f21ee41583a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:46.062269 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760aeac5-1908-4d29-837e-f21ee41583a7 admin admin] PATH_INFO: `/v3/users/a26fb01f71cb4a31bbc16a822800d2e8` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:46.063390 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760aeac5-1908-4d29-837e-f21ee41583a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a26fb01f71cb4a31bbc16a822800d2e8)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:46.065403 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760aeac5-1908-4d29-837e-f21ee41583a7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:46.121730 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-760aeac5-1908-4d29-837e-f21ee41583a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a26fb01f71cb4a31bbc16a822800d2e8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:46.122520 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-760aeac5-1908-4d29-837e-f21ee41583a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a26fb01f71cb4a31bbc16a822800d2e8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:46.130525 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-760aeac5-1908-4d29-837e-f21ee41583a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a26fb01f71cb4a31bbc16a822800d2e8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:46.131153 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-760aeac5-1908-4d29-837e-f21ee41583a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a26fb01f71cb4a31bbc16a822800d2e8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:46.139785 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-760aeac5-1908-4d29-837e-f21ee41583a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a26fb01f71cb4a31bbc16a822800d2e8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:46.158572 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1288/2606] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:45 2022] DELETE /identity/v3/users/a26fb01f71cb4a31bbc16a822800d2e8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:46.163057 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc79fec-1ebc-4c70-9b7f-5e3e5846d594 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:46.163517 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc79fec-1ebc-4c70-9b7f-5e3e5846d594 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:46.163733 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc79fec-1ebc-4c70-9b7f-5e3e5846d594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:46.182932 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3dc79fec-1ebc-4c70-9b7f-5e3e5846d594 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:46.184254 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3dc79fec-1ebc-4c70-9b7f-5e3e5846d594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:46.246041 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1319/2607] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:46.260300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760aeac5-1908-4d29-837e-f21ee41583a7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:46.261856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-760aeac5-1908-4d29-837e-f21ee41583a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:46.324670 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760aeac5-1908-4d29-837e-f21ee41583a7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:46.328310 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e93595-08f9-41f4-b83a-a9b4e09354b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:46.328924 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e93595-08f9-41f4-b83a-a9b4e09354b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:46.329222 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e93595-08f9-41f4-b83a-a9b4e09354b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:46.329487 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e93595-08f9-41f4-b83a-a9b4e09354b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:46.339053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e93595-08f9-41f4-b83a-a9b4e09354b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:46.340688 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e93595-08f9-41f4-b83a-a9b4e09354b9 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:46.350809 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1289/2608] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:47.065648 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc79fec-1ebc-4c70-9b7f-5e3e5846d594 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:47.067110 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3dc79fec-1ebc-4c70-9b7f-5e3e5846d594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:47.089084 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc79fec-1ebc-4c70-9b7f-5e3e5846d594 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:47.094827 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779708c6-37f9-40cd-bb10-9f6172813a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:47.095576 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779708c6-37f9-40cd-bb10-9f6172813a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:47.095865 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779708c6-37f9-40cd-bb10-9f6172813a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:47.096141 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779708c6-37f9-40cd-bb10-9f6172813a56 admin admin] PATH_INFO: `/v3/projects/441780e6f659495f959e1b04b2776882` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:47.097398 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779708c6-37f9-40cd-bb10-9f6172813a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=441780e6f659495f959e1b04b2776882)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:47.099319 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779708c6-37f9-40cd-bb10-9f6172813a56 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:47.141490 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:47.152924 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-779708c6-37f9-40cd-bb10-9f6172813a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '441780e6f659495f959e1b04b2776882', 'request_id': 'req-779708c6-37f9-40cd-bb10-9f6172813a56'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:47.159655 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-779708c6-37f9-40cd-bb10-9f6172813a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '441780e6f659495f959e1b04b2776882', 'request_id': 'req-779708c6-37f9-40cd-bb10-9f6172813a56'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:47.167401 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-779708c6-37f9-40cd-bb10-9f6172813a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '441780e6f659495f959e1b04b2776882', 'request_id': 'req-779708c6-37f9-40cd-bb10-9f6172813a56'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:47.178930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-779708c6-37f9-40cd-bb10-9f6172813a56 admin admin] The token cache is being invalidate because project 441780e6f659495f959e1b04b2776882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:47.179219 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-779708c6-37f9-40cd-bb10-9f6172813a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:47.179952 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-779708c6-37f9-40cd-bb10-9f6172813a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:47.181614 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1320/2609] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:47 2022] DELETE /identity/v3/projects/441780e6f659495f959e1b04b2776882 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:56.346195 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=61,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:57.064667 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e93595-08f9-41f4-b83a-a9b4e09354b9 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:57.066093 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-24e93595-08f9-41f4-b83a-a9b4e09354b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:57.077150 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e93595-08f9-41f4-b83a-a9b4e09354b9 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:57.125282 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842176f-bead-49af-8a59-77fa328a480b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:57.125881 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842176f-bead-49af-8a59-77fa328a480b service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:57.126156 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842176f-bead-49af-8a59-77fa328a480b service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:57.126422 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842176f-bead-49af-8a59-77fa328a480b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:57.128153 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0842176f-bead-49af-8a59-77fa328a480b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:57.175810 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=5,keystone:SELECT=11,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:57.191486 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842176f-bead-49af-8a59-77fa328a480b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:57.192924 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842176f-bead-49af-8a59-77fa328a480b service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:57.202880 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1290/2610] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:00.337194 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779708c6-37f9-40cd-bb10-9f6172813a56 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:00.339500 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-779708c6-37f9-40cd-bb10-9f6172813a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:00.414428 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842176f-bead-49af-8a59-77fa328a480b service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:00.416174 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0842176f-bead-49af-8a59-77fa328a480b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:00.429782 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842176f-bead-49af-8a59-77fa328a480b service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:00.438282 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4d484-ede7-4af1-851e-94d8fb730c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:00.439022 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4d484-ede7-4af1-851e-94d8fb730c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:00.439351 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4d484-ede7-4af1-851e-94d8fb730c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:00.439692 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4d484-ede7-4af1-851e-94d8fb730c47 admin admin] PATH_INFO: `/v3/users/c21c29da391b4d78a063dbe50057b6eb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:00.441003 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4d484-ede7-4af1-851e-94d8fb730c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21c29da391b4d78a063dbe50057b6eb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:00.443393 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4d484-ede7-4af1-851e-94d8fb730c47 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:00.448004 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779708c6-37f9-40cd-bb10-9f6172813a56 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:00.458180 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d280d55-a49e-42e6-8a60-46098960c271 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78481cceebd4138b893eba7e51c9c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:00.459260 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d280d55-a49e-42e6-8a60-46098960c271 service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:00.459887 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d280d55-a49e-42e6-8a60-46098960c271 service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:00.460236 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d280d55-a49e-42e6-8a60-46098960c271 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:00.464386 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9d280d55-a49e-42e6-8a60-46098960c271 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:00.480060 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d280d55-a49e-42e6-8a60-46098960c271 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:00.483117 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d280d55-a49e-42e6-8a60-46098960c271 service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:00.500077 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1321/2611] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:00.511326 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1dd4d484-ede7-4af1-851e-94d8fb730c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21c29da391b4d78a063dbe50057b6eb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:00.512323 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1dd4d484-ede7-4af1-851e-94d8fb730c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21c29da391b4d78a063dbe50057b6eb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:00.524416 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1dd4d484-ede7-4af1-851e-94d8fb730c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21c29da391b4d78a063dbe50057b6eb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:00.525684 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1dd4d484-ede7-4af1-851e-94d8fb730c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21c29da391b4d78a063dbe50057b6eb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:00.536328 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1dd4d484-ede7-4af1-851e-94d8fb730c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21c29da391b4d78a063dbe50057b6eb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:00.557170 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1291/2612] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:03:00 2022] DELETE /identity/v3/users/c21c29da391b4d78a063dbe50057b6eb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:00.749789 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d280d55-a49e-42e6-8a60-46098960c271 service placement] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:00.762832 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d280d55-a49e-42e6-8a60-46098960c271 service placement] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:00.828326 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bfaa0-6d2f-4dd6-a397-3ebf2213e28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:00.829180 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bfaa0-6d2f-4dd6-a397-3ebf2213e28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:00.829311 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bfaa0-6d2f-4dd6-a397-3ebf2213e28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:00.829575 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bfaa0-6d2f-4dd6-a397-3ebf2213e28b admin admin] PATH_INFO: `/v3/projects/346545279d0943359a5d495b9dc7f498` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:00.830683 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bfaa0-6d2f-4dd6-a397-3ebf2213e28b admin admin] RBAC: Authorizing `identity:delete_project(project_id=346545279d0943359a5d495b9dc7f498)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:00.833024 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bfaa0-6d2f-4dd6-a397-3ebf2213e28b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:00.882048 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2e1bfaa0-6d2f-4dd6-a397-3ebf2213e28b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '346545279d0943359a5d495b9dc7f498', 'request_id': 'req-2e1bfaa0-6d2f-4dd6-a397-3ebf2213e28b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:00.889092 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2e1bfaa0-6d2f-4dd6-a397-3ebf2213e28b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '346545279d0943359a5d495b9dc7f498', 'request_id': 'req-2e1bfaa0-6d2f-4dd6-a397-3ebf2213e28b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:00.897831 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2e1bfaa0-6d2f-4dd6-a397-3ebf2213e28b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '346545279d0943359a5d495b9dc7f498', 'request_id': 'req-2e1bfaa0-6d2f-4dd6-a397-3ebf2213e28b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:00.909857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2e1bfaa0-6d2f-4dd6-a397-3ebf2213e28b admin admin] The token cache is being invalidate because project 346545279d0943359a5d495b9dc7f498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:03:00.910154 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2e1bfaa0-6d2f-4dd6-a397-3ebf2213e28b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:00.910818 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2e1bfaa0-6d2f-4dd6-a397-3ebf2213e28b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:00.912399 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1322/2613] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:03:00 2022] DELETE /identity/v3/projects/346545279d0943359a5d495b9dc7f498 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:00.918748 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec243a6-5a7e-4a4c-8659-281a42c5f95e None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:00.919204 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec243a6-5a7e-4a4c-8659-281a42c5f95e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:00.919664 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec243a6-5a7e-4a4c-8659-281a42c5f95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:00.941603 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-bec243a6-5a7e-4a4c-8659-281a42c5f95e None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:00.942838 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-bec243a6-5a7e-4a4c-8659-281a42c5f95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:00.960643 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:01.008675 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1292/2614] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:01.017725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1b3b4-6cac-4ba2-a5dc-382321de975e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:01.018006 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1b3b4-6cac-4ba2-a5dc-382321de975e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:01.018278 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1b3b4-6cac-4ba2-a5dc-382321de975e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:01.038530 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8af1b3b4-6cac-4ba2-a5dc-382321de975e None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:01.039633 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8af1b3b4-6cac-4ba2-a5dc-382321de975e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:01.047915 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1323/2615] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:01.052327 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec243a6-5a7e-4a4c-8659-281a42c5f95e None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:01.063136 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec243a6-5a7e-4a4c-8659-281a42c5f95e None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:01.067787 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6340e-1bdb-4855-8a24-28bbad8fc60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:01.068506 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6340e-1bdb-4855-8a24-28bbad8fc60e admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:01.068724 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6340e-1bdb-4855-8a24-28bbad8fc60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:01.069029 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6340e-1bdb-4855-8a24-28bbad8fc60e admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:01.069677 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6340e-1bdb-4855-8a24-28bbad8fc60e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:03:01.070014 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6340e-1bdb-4855-8a24-28bbad8fc60e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:01.071671 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6340e-1bdb-4855-8a24-28bbad8fc60e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:01.084372 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1293/2616] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:03:01.088758 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1b3b4-6cac-4ba2-a5dc-382321de975e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:01.098433 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1b3b4-6cac-4ba2-a5dc-382321de975e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:01.103075 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbb659-1ad4-4394-830e-2fa5a7a00374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:01.103664 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbb659-1ad4-4394-830e-2fa5a7a00374 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:01.103940 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbb659-1ad4-4394-830e-2fa5a7a00374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:01.104208 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbb659-1ad4-4394-830e-2fa5a7a00374 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:01.104835 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbb659-1ad4-4394-830e-2fa5a7a00374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:01.107629 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbb659-1ad4-4394-830e-2fa5a7a00374 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:01.119196 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:01.138322 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1324/2617] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:03:01 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:01.142695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6340e-1bdb-4855-8a24-28bbad8fc60e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:01.152769 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6340e-1bdb-4855-8a24-28bbad8fc60e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:01.210030 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbb071-eec3-4ceb-83d0-4e08bdde51fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:01.210632 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbb071-eec3-4ceb-83d0-4e08bdde51fb admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:01.210923 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbb071-eec3-4ceb-83d0-4e08bdde51fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:01.211190 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbb071-eec3-4ceb-83d0-4e08bdde51fb admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:01.211833 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbb071-eec3-4ceb-83d0-4e08bdde51fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:01.213823 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbb071-eec3-4ceb-83d0-4e08bdde51fb admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:01.236315 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1294/2618] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:03:01 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:01.241103 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbb659-1ad4-4394-830e-2fa5a7a00374 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:01.252992 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbb659-1ad4-4394-830e-2fa5a7a00374 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:01.257725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e0861-6100-4101-8c63-ecffd0635c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:01.258315 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e0861-6100-4101-8c63-ecffd0635c8f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:01.258596 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e0861-6100-4101-8c63-ecffd0635c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:01.258869 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e0861-6100-4101-8c63-ecffd0635c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:01.259507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e0861-6100-4101-8c63-ecffd0635c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:01.261141 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e0861-6100-4101-8c63-ecffd0635c8f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:01.271031 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1325/2619] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:01.275145 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbb071-eec3-4ceb-83d0-4e08bdde51fb admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:01.285532 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbb071-eec3-4ceb-83d0-4e08bdde51fb admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:01.290427 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c66cf-0d6e-4c3a-84b2-4a8599271b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:01.291112 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c66cf-0d6e-4c3a-84b2-4a8599271b08 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:01.291239 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c66cf-0d6e-4c3a-84b2-4a8599271b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:01.291490 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c66cf-0d6e-4c3a-84b2-4a8599271b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:01.292120 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c66cf-0d6e-4c3a-84b2-4a8599271b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:01.294622 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c66cf-0d6e-4c3a-84b2-4a8599271b08 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:01.305378 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1295/2620] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:01.310181 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e0861-6100-4101-8c63-ecffd0635c8f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:01.320209 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e0861-6100-4101-8c63-ecffd0635c8f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:01.325251 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536813e4-a7e7-4ca5-a4b2-d06164ff8a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:01.325906 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536813e4-a7e7-4ca5-a4b2-d06164ff8a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:01.326186 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536813e4-a7e7-4ca5-a4b2-d06164ff8a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:01.326459 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536813e4-a7e7-4ca5-a4b2-d06164ff8a9c admin admin] PATH_INFO: `/v3/projects/3fbb88cdaae1426581699d654749e149/users/098718ef781845dc8d81900f95dc76a4/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:01.342235 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536813e4-a7e7-4ca5-a4b2-d06164ff8a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fbb88cdaae1426581699d654749e149, user_id=098718ef781845dc8d81900f95dc76a4, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:01.344896 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536813e4-a7e7-4ca5-a4b2-d06164ff8a9c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:01.359289 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1326/2621] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:01 2022] PUT /identity/v3/projects/3fbb88cdaae1426581699d654749e149/users/098718ef781845dc8d81900f95dc76a4/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:01.369789 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aeae5d-8628-4fcb-8767-03e89bba07b3 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:01.370075 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aeae5d-8628-4fcb-8767-03e89bba07b3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:01.370374 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aeae5d-8628-4fcb-8767-03e89bba07b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:01.398935 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-43aeae5d-8628-4fcb-8767-03e89bba07b3 None None] MFA Rules not processed for user `098718ef781845dc8d81900f95dc76a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:01.400165 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-43aeae5d-8628-4fcb-8767-03e89bba07b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:01.472352 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1296/2622] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:01.484277 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536813e4-a7e7-4ca5-a4b2-d06164ff8a9c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:01.486083 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-536813e4-a7e7-4ca5-a4b2-d06164ff8a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:01.563426 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536813e4-a7e7-4ca5-a4b2-d06164ff8a9c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:01.568908 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e7016-4154-4fa0-9de7-b8b94e84cc2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e0396b7ba341ce8d02b1a149786d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:01.569526 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e7016-4154-4fa0-9de7-b8b94e84cc2a service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:01.569802 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e7016-4154-4fa0-9de7-b8b94e84cc2a service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:01.570071 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e7016-4154-4fa0-9de7-b8b94e84cc2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:01.578021 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e7016-4154-4fa0-9de7-b8b94e84cc2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:01.579646 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e7016-4154-4fa0-9de7-b8b94e84cc2a service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:01.588467 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1327/2623] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:04.291121 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aeae5d-8628-4fcb-8767-03e89bba07b3 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:04.310495 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:04.356026 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aeae5d-8628-4fcb-8767-03e89bba07b3 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:04.361292 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda3f6a-981b-4474-938b-09c6534e50b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:04.362110 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda3f6a-981b-4474-938b-09c6534e50b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:04.362412 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda3f6a-981b-4474-938b-09c6534e50b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:04.362694 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda3f6a-981b-4474-938b-09c6534e50b6 admin admin] PATH_INFO: `/v3/users/098718ef781845dc8d81900f95dc76a4` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:04.363886 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda3f6a-981b-4474-938b-09c6534e50b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=098718ef781845dc8d81900f95dc76a4)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:04.366232 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda3f6a-981b-4474-938b-09c6534e50b6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:04.421485 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-acda3f6a-981b-4474-938b-09c6534e50b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098718ef781845dc8d81900f95dc76a4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:04.422402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-acda3f6a-981b-4474-938b-09c6534e50b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098718ef781845dc8d81900f95dc76a4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:04.430890 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-acda3f6a-981b-4474-938b-09c6534e50b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098718ef781845dc8d81900f95dc76a4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:04.431650 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-acda3f6a-981b-4474-938b-09c6534e50b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098718ef781845dc8d81900f95dc76a4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:04.440634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-acda3f6a-981b-4474-938b-09c6534e50b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098718ef781845dc8d81900f95dc76a4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:04.460326 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1297/2624] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:03:04 2022] DELETE /identity/v3/users/098718ef781845dc8d81900f95dc76a4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:04.465094 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad2cc3-9606-4392-bc41-c0a1291a89b7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:04.465587 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad2cc3-9606-4392-bc41-c0a1291a89b7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:04.466201 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad2cc3-9606-4392-bc41-c0a1291a89b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:04.485816 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-93ad2cc3-9606-4392-bc41-c0a1291a89b7 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:04.487085 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-93ad2cc3-9606-4392-bc41-c0a1291a89b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:04.551268 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1328/2625] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:04.561610 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda3f6a-981b-4474-938b-09c6534e50b6 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:04.563147 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-acda3f6a-981b-4474-938b-09c6534e50b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:04.630596 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda3f6a-981b-4474-938b-09c6534e50b6 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:04.634171 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbf108-a4b1-4a73-8159-c23f53480e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:04.634775 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbf108-a4b1-4a73-8159-c23f53480e98 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:04.635051 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbf108-a4b1-4a73-8159-c23f53480e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:04.635322 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbf108-a4b1-4a73-8159-c23f53480e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:04.644500 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbf108-a4b1-4a73-8159-c23f53480e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:04.645956 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbf108-a4b1-4a73-8159-c23f53480e98 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:04.657000 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1298/2626] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:04.940278 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad2cc3-9606-4392-bc41-c0a1291a89b7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:04.943325 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-93ad2cc3-9606-4392-bc41-c0a1291a89b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:04.964104 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad2cc3-9606-4392-bc41-c0a1291a89b7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:04.972196 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e78f19-d3e4-4f9e-9baa-c9de078ff064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:04.972891 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e78f19-d3e4-4f9e-9baa-c9de078ff064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:04.973278 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e78f19-d3e4-4f9e-9baa-c9de078ff064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:04.973994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e78f19-d3e4-4f9e-9baa-c9de078ff064 admin admin] PATH_INFO: `/v3/projects/3fbb88cdaae1426581699d654749e149` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:04.974987 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e78f19-d3e4-4f9e-9baa-c9de078ff064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fbb88cdaae1426581699d654749e149)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:04.978031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e78f19-d3e4-4f9e-9baa-c9de078ff064 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:05.018894 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:05.029289 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-71e78f19-d3e4-4f9e-9baa-c9de078ff064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fbb88cdaae1426581699d654749e149', 'request_id': 'req-71e78f19-d3e4-4f9e-9baa-c9de078ff064'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:05.035525 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-71e78f19-d3e4-4f9e-9baa-c9de078ff064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fbb88cdaae1426581699d654749e149', 'request_id': 'req-71e78f19-d3e4-4f9e-9baa-c9de078ff064'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:05.043492 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-71e78f19-d3e4-4f9e-9baa-c9de078ff064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fbb88cdaae1426581699d654749e149', 'request_id': 'req-71e78f19-d3e4-4f9e-9baa-c9de078ff064'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:05.054559 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-71e78f19-d3e4-4f9e-9baa-c9de078ff064 admin admin] The token cache is being invalidate because project 3fbb88cdaae1426581699d654749e149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:03:05.054777 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-71e78f19-d3e4-4f9e-9baa-c9de078ff064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:05.055422 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-71e78f19-d3e4-4f9e-9baa-c9de078ff064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:05.056904 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1329/2627] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:03:04 2022] DELETE /identity/v3/projects/3fbb88cdaae1426581699d654749e149 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:05.061845 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5ddad-aedd-43f5-a2ac-65988cd40199 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:05.062133 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5ddad-aedd-43f5-a2ac-65988cd40199 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:05.062405 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5ddad-aedd-43f5-a2ac-65988cd40199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:05.088038 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-9eb5ddad-aedd-43f5-a2ac-65988cd40199 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:05.090114 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9eb5ddad-aedd-43f5-a2ac-65988cd40199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:05.126762 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:05.155290 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1299/2628] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:05.163652 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b29c5-9c76-4d97-83f8-61c57e836e15 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:05.163968 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b29c5-9c76-4d97-83f8-61c57e836e15 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:05.164246 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b29c5-9c76-4d97-83f8-61c57e836e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:05.183675 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c72b29c5-9c76-4d97-83f8-61c57e836e15 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:05.185461 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c72b29c5-9c76-4d97-83f8-61c57e836e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:05.193245 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1330/2629] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:05.197537 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5ddad-aedd-43f5-a2ac-65988cd40199 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:05.207907 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5ddad-aedd-43f5-a2ac-65988cd40199 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:05.212428 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b153eb0-3eba-4875-a228-d1c7258e5bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:05.213055 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b153eb0-3eba-4875-a228-d1c7258e5bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:05.213334 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b153eb0-3eba-4875-a228-d1c7258e5bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:05.213609 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b153eb0-3eba-4875-a228-d1c7258e5bc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:05.214251 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b153eb0-3eba-4875-a228-d1c7258e5bc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:03:05.214572 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b153eb0-3eba-4875-a228-d1c7258e5bc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:05.216199 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b153eb0-3eba-4875-a228-d1c7258e5bc0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:05.228433 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1300/2630] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:03:05.232916 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b29c5-9c76-4d97-83f8-61c57e836e15 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:05.242342 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b29c5-9c76-4d97-83f8-61c57e836e15 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:05.247540 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbd70f-6155-4cf3-bbdf-d42c3c06ba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:05.248112 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbd70f-6155-4cf3-bbdf-d42c3c06ba3c admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:05.248386 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbd70f-6155-4cf3-bbdf-d42c3c06ba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:05.248653 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbd70f-6155-4cf3-bbdf-d42c3c06ba3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:05.249310 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbd70f-6155-4cf3-bbdf-d42c3c06ba3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:05.251207 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbd70f-6155-4cf3-bbdf-d42c3c06ba3c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:05.278600 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1331/2631] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:03:05 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:05.282919 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b153eb0-3eba-4875-a228-d1c7258e5bc0 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:05.292891 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b153eb0-3eba-4875-a228-d1c7258e5bc0 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:05.350658 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c2282-a06c-4a9a-b0fe-ebafc8a64319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:05.351183 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c2282-a06c-4a9a-b0fe-ebafc8a64319 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:05.351466 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c2282-a06c-4a9a-b0fe-ebafc8a64319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:05.351741 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c2282-a06c-4a9a-b0fe-ebafc8a64319 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:05.352397 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c2282-a06c-4a9a-b0fe-ebafc8a64319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:05.354375 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c2282-a06c-4a9a-b0fe-ebafc8a64319 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:05.377493 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1301/2632] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:03:05 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:03:05.382944 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbd70f-6155-4cf3-bbdf-d42c3c06ba3c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:05.393836 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbd70f-6155-4cf3-bbdf-d42c3c06ba3c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:05.398528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb217a-1928-4191-b237-238b6828aa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:05.399120 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb217a-1928-4191-b237-238b6828aa29 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:05.399395 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb217a-1928-4191-b237-238b6828aa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:05.399662 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb217a-1928-4191-b237-238b6828aa29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:05.400300 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb217a-1928-4191-b237-238b6828aa29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:05.401989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb217a-1928-4191-b237-238b6828aa29 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:05.412762 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1332/2633] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:05.416812 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c2282-a06c-4a9a-b0fe-ebafc8a64319 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:05.426945 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c2282-a06c-4a9a-b0fe-ebafc8a64319 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:05.431956 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f4947-22ec-4024-9d9e-60305cb5f9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:05.432560 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f4947-22ec-4024-9d9e-60305cb5f9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:05.432843 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f4947-22ec-4024-9d9e-60305cb5f9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:05.433174 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f4947-22ec-4024-9d9e-60305cb5f9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:05.433843 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f4947-22ec-4024-9d9e-60305cb5f9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:05.435999 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f4947-22ec-4024-9d9e-60305cb5f9d0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:05.447197 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1302/2634] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:05.452420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb217a-1928-4191-b237-238b6828aa29 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:05.462775 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb217a-1928-4191-b237-238b6828aa29 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:05.467718 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8a2fa-1266-429f-a352-987f19f1c2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:05.468375 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8a2fa-1266-429f-a352-987f19f1c2cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:05.468649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8a2fa-1266-429f-a352-987f19f1c2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:05.468919 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8a2fa-1266-429f-a352-987f19f1c2cb admin admin] PATH_INFO: `/v3/projects/30f711a2e00f4c1f9a1808ce3c8ded22/users/4c97f21894474c709182def686fd8006/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:05.484739 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8a2fa-1266-429f-a352-987f19f1c2cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=30f711a2e00f4c1f9a1808ce3c8ded22, user_id=4c97f21894474c709182def686fd8006, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:05.487403 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8a2fa-1266-429f-a352-987f19f1c2cb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:05.501705 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1333/2635] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:05 2022] PUT /identity/v3/projects/30f711a2e00f4c1f9a1808ce3c8ded22/users/4c97f21894474c709182def686fd8006/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:03:05.514009 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e3994-4140-4139-b550-a7d3705dbb6d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:05.514295 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e3994-4140-4139-b550-a7d3705dbb6d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:05.514568 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e3994-4140-4139-b550-a7d3705dbb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:05.542457 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e86e3994-4140-4139-b550-a7d3705dbb6d None None] MFA Rules not processed for user `4c97f21894474c709182def686fd8006`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:05.544289 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e86e3994-4140-4139-b550-a7d3705dbb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:05.614901 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1303/2636] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:05.621485 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8a2fa-1266-429f-a352-987f19f1c2cb admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:05.689341 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8a2fa-1266-429f-a352-987f19f1c2cb admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:05.694014 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d771a-db84-4496-9a90-b98048ec374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:05.694638 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d771a-db84-4496-9a90-b98048ec374d admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:05.694903 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d771a-db84-4496-9a90-b98048ec374d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:05.695170 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d771a-db84-4496-9a90-b98048ec374d admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:05.695832 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d771a-db84-4496-9a90-b98048ec374d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:05.697780 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d771a-db84-4496-9a90-b98048ec374d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:05.729399 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1334/2637] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:03:05 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:05.731161 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e3994-4140-4139-b550-a7d3705dbb6d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:05.743358 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e3994-4140-4139-b550-a7d3705dbb6d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:05.778158 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:05.807122 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0550662-6c87-402f-9ebf-f2e7b88d7a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:05.807727 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0550662-6c87-402f-9ebf-f2e7b88d7a91 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:05.808160 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0550662-6c87-402f-9ebf-f2e7b88d7a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:05.808316 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0550662-6c87-402f-9ebf-f2e7b88d7a91 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:05.808911 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0550662-6c87-402f-9ebf-f2e7b88d7a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:05.811882 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0550662-6c87-402f-9ebf-f2e7b88d7a91 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:05.833179 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1304/2638] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:03:05 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:05.837247 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d771a-db84-4496-9a90-b98048ec374d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:05.848526 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d771a-db84-4496-9a90-b98048ec374d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:05.853269 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4b045-46bf-4fe9-b728-ac2413f8decc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:05.853867 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4b045-46bf-4fe9-b728-ac2413f8decc admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:05.854148 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4b045-46bf-4fe9-b728-ac2413f8decc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:05.854421 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4b045-46bf-4fe9-b728-ac2413f8decc admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:05.855066 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4b045-46bf-4fe9-b728-ac2413f8decc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:05.857293 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4b045-46bf-4fe9-b728-ac2413f8decc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:05.868305 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1335/2639] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:05.873138 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0550662-6c87-402f-9ebf-f2e7b88d7a91 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:05.883480 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0550662-6c87-402f-9ebf-f2e7b88d7a91 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:05.888453 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d34056-120e-431d-8f62-7c04ceb7287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:05.889135 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d34056-120e-431d-8f62-7c04ceb7287e admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:05.889425 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d34056-120e-431d-8f62-7c04ceb7287e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:05.889700 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d34056-120e-431d-8f62-7c04ceb7287e admin admin] PATH_INFO: `/v3/projects/832038510a4e4829996ac61d4888edfc/users/ef32a11c128f44b1a338df306a3ec60a/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:05.904542 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d34056-120e-431d-8f62-7c04ceb7287e admin admin] RBAC: Authorizing `identity:create_grant(project_id=832038510a4e4829996ac61d4888edfc, user_id=ef32a11c128f44b1a338df306a3ec60a, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:05.907297 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d34056-120e-431d-8f62-7c04ceb7287e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:05.920735 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1305/2640] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:05 2022] PUT /identity/v3/projects/832038510a4e4829996ac61d4888edfc/users/ef32a11c128f44b1a338df306a3ec60a/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:05.925136 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4b045-46bf-4fe9-b728-ac2413f8decc admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:05.936517 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4b045-46bf-4fe9-b728-ac2413f8decc admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:05.970464 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:05.998390 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576a532-7aa1-48db-860b-a057377e1b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:05.998993 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576a532-7aa1-48db-860b-a057377e1b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:05.999268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576a532-7aa1-48db-860b-a057377e1b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:05.999539 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576a532-7aa1-48db-860b-a057377e1b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:06.000183 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576a532-7aa1-48db-860b-a057377e1b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:06.001823 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576a532-7aa1-48db-860b-a057377e1b47 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:06.011526 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1336/2641] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:03:06.016025 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d34056-120e-431d-8f62-7c04ceb7287e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:06.026293 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d34056-120e-431d-8f62-7c04ceb7287e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:06.031431 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162a8cc-1564-4519-926d-97b6a772f0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:06.032074 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162a8cc-1564-4519-926d-97b6a772f0ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:06.032384 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162a8cc-1564-4519-926d-97b6a772f0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:06.032655 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162a8cc-1564-4519-926d-97b6a772f0ba admin admin] PATH_INFO: `/v3/projects/832038510a4e4829996ac61d4888edfc/users/ef32a11c128f44b1a338df306a3ec60a/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:06.034583 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162a8cc-1564-4519-926d-97b6a772f0ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=832038510a4e4829996ac61d4888edfc, user_id=ef32a11c128f44b1a338df306a3ec60a, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:06.037251 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162a8cc-1564-4519-926d-97b6a772f0ba admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:06.048266 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1306/2642] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:06 2022] PUT /identity/v3/projects/832038510a4e4829996ac61d4888edfc/users/ef32a11c128f44b1a338df306a3ec60a/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:06.058372 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f94282-2266-4b55-9650-df24c66604c0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:06.058652 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f94282-2266-4b55-9650-df24c66604c0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:06.058925 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f94282-2266-4b55-9650-df24c66604c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:06.086161 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-69f94282-2266-4b55-9650-df24c66604c0 None None] MFA Rules not processed for user `ef32a11c128f44b1a338df306a3ec60a`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:06.087357 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-69f94282-2266-4b55-9650-df24c66604c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:06.156291 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1337/2643] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:06.167702 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162a8cc-1564-4519-926d-97b6a772f0ba admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:06.170039 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4162a8cc-1564-4519-926d-97b6a772f0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:06.228536 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162a8cc-1564-4519-926d-97b6a772f0ba admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:06.233019 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f91b5-caf6-401c-99d1-5d3bf3b184b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:06.233627 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f91b5-caf6-401c-99d1-5d3bf3b184b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:06.233907 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f91b5-caf6-401c-99d1-5d3bf3b184b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:06.234185 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f91b5-caf6-401c-99d1-5d3bf3b184b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:06.243584 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f91b5-caf6-401c-99d1-5d3bf3b184b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:06.245061 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f91b5-caf6-401c-99d1-5d3bf3b184b0 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:06.255007 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1307/2644] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:06.667514 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f94282-2266-4b55-9650-df24c66604c0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:06.739353 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f94282-2266-4b55-9650-df24c66604c0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:06.744416 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0104580-7c79-4e0e-ad90-4c122bf169e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:06.745107 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0104580-7c79-4e0e-ad90-4c122bf169e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:06.745390 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0104580-7c79-4e0e-ad90-4c122bf169e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:06.745751 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0104580-7c79-4e0e-ad90-4c122bf169e5 admin admin] PATH_INFO: `/v3/users/4c97f21894474c709182def686fd8006` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:06.747374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0104580-7c79-4e0e-ad90-4c122bf169e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c97f21894474c709182def686fd8006)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:06.749346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0104580-7c79-4e0e-ad90-4c122bf169e5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:06.798954 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d0104580-7c79-4e0e-ad90-4c122bf169e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c97f21894474c709182def686fd8006'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:06.799709 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d0104580-7c79-4e0e-ad90-4c122bf169e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c97f21894474c709182def686fd8006'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:06.807922 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:06.813786 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d0104580-7c79-4e0e-ad90-4c122bf169e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c97f21894474c709182def686fd8006'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:06.821566 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d0104580-7c79-4e0e-ad90-4c122bf169e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c97f21894474c709182def686fd8006'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:06.822192 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d0104580-7c79-4e0e-ad90-4c122bf169e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c97f21894474c709182def686fd8006'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:06.835598 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1338/2645] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:03:06 2022] DELETE /identity/v3/users/4c97f21894474c709182def686fd8006 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:06.840468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecd166-3de4-467b-a9cc-3f9361f2737d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:06.841278 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecd166-3de4-467b-a9cc-3f9361f2737d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:06.841874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecd166-3de4-467b-a9cc-3f9361f2737d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:06.861737 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ceecd166-3de4-467b-a9cc-3f9361f2737d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:06.863086 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ceecd166-3de4-467b-a9cc-3f9361f2737d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:06.924154 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1308/2646] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:06.934010 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0104580-7c79-4e0e-ad90-4c122bf169e5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:06.936014 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d0104580-7c79-4e0e-ad90-4c122bf169e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:06.996219 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0104580-7c79-4e0e-ad90-4c122bf169e5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:07.003590 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0bf30-866a-4cda-8b00-e4e5292856f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:07.004610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0bf30-866a-4cda-8b00-e4e5292856f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:07.005152 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0bf30-866a-4cda-8b00-e4e5292856f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:07.005627 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0bf30-866a-4cda-8b00-e4e5292856f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:07.022382 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0bf30-866a-4cda-8b00-e4e5292856f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:07.024358 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0bf30-866a-4cda-8b00-e4e5292856f6 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:07.037919 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1339/2647] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:07.312582 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecd166-3de4-467b-a9cc-3f9361f2737d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:07.314096 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ceecd166-3de4-467b-a9cc-3f9361f2737d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:07.327096 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecd166-3de4-467b-a9cc-3f9361f2737d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:07.331728 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ed68f-34c5-444c-80a2-83e6ae9fb8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:07.332391 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ed68f-34c5-444c-80a2-83e6ae9fb8aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:07.332672 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ed68f-34c5-444c-80a2-83e6ae9fb8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:07.332966 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ed68f-34c5-444c-80a2-83e6ae9fb8aa admin admin] PATH_INFO: `/v3/projects/30f711a2e00f4c1f9a1808ce3c8ded22` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:07.334589 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ed68f-34c5-444c-80a2-83e6ae9fb8aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=30f711a2e00f4c1f9a1808ce3c8ded22)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:07.336575 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ed68f-34c5-444c-80a2-83e6ae9fb8aa admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:07.369675 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:07.388819 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e32ed68f-34c5-444c-80a2-83e6ae9fb8aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30f711a2e00f4c1f9a1808ce3c8ded22', 'request_id': 'req-e32ed68f-34c5-444c-80a2-83e6ae9fb8aa'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:07.395038 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e32ed68f-34c5-444c-80a2-83e6ae9fb8aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30f711a2e00f4c1f9a1808ce3c8ded22', 'request_id': 'req-e32ed68f-34c5-444c-80a2-83e6ae9fb8aa'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:07.402466 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e32ed68f-34c5-444c-80a2-83e6ae9fb8aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30f711a2e00f4c1f9a1808ce3c8ded22', 'request_id': 'req-e32ed68f-34c5-444c-80a2-83e6ae9fb8aa'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:07.415612 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e32ed68f-34c5-444c-80a2-83e6ae9fb8aa admin admin] The token cache is being invalidate because project 30f711a2e00f4c1f9a1808ce3c8ded22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:03:07.415906 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e32ed68f-34c5-444c-80a2-83e6ae9fb8aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:07.416572 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e32ed68f-34c5-444c-80a2-83e6ae9fb8aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:07.418084 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1309/2648] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:03:07 2022] DELETE /identity/v3/projects/30f711a2e00f4c1f9a1808ce3c8ded22 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:07.423693 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0bf30-866a-4cda-8b00-e4e5292856f6 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:07.437637 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0bf30-866a-4cda-8b00-e4e5292856f6 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:07.498777 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a569dba-f841-4280-98bc-878dc0c32509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:07.499405 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a569dba-f841-4280-98bc-878dc0c32509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:07.499691 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a569dba-f841-4280-98bc-878dc0c32509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:07.499956 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a569dba-f841-4280-98bc-878dc0c32509 admin admin] PATH_INFO: `/v3/users/ef32a11c128f44b1a338df306a3ec60a` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:07.501103 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a569dba-f841-4280-98bc-878dc0c32509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef32a11c128f44b1a338df306a3ec60a)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:07.503311 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a569dba-f841-4280-98bc-878dc0c32509 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:07.555094 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6a569dba-f841-4280-98bc-878dc0c32509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef32a11c128f44b1a338df306a3ec60a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:07.555875 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6a569dba-f841-4280-98bc-878dc0c32509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef32a11c128f44b1a338df306a3ec60a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:07.573485 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6a569dba-f841-4280-98bc-878dc0c32509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef32a11c128f44b1a338df306a3ec60a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:07.581371 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6a569dba-f841-4280-98bc-878dc0c32509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef32a11c128f44b1a338df306a3ec60a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:07.582000 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6a569dba-f841-4280-98bc-878dc0c32509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef32a11c128f44b1a338df306a3ec60a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:07.595083 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:07.603126 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1340/2649] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:03:07 2022] DELETE /identity/v3/users/ef32a11c128f44b1a338df306a3ec60a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:07.908914 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ed68f-34c5-444c-80a2-83e6ae9fb8aa admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:07.910485 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e32ed68f-34c5-444c-80a2-83e6ae9fb8aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:07.925739 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ed68f-34c5-444c-80a2-83e6ae9fb8aa admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:07.992425 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef1e60-0b10-4731-a4a9-59bb323a2dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:07.993241 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef1e60-0b10-4731-a4a9-59bb323a2dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:07.993681 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef1e60-0b10-4731-a4a9-59bb323a2dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:07.993941 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef1e60-0b10-4731-a4a9-59bb323a2dc1 admin admin] PATH_INFO: `/v3/projects/832038510a4e4829996ac61d4888edfc` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:07.995118 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef1e60-0b10-4731-a4a9-59bb323a2dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=832038510a4e4829996ac61d4888edfc)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:07.997802 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef1e60-0b10-4731-a4a9-59bb323a2dc1 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:08.051289 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-06ef1e60-0b10-4731-a4a9-59bb323a2dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '832038510a4e4829996ac61d4888edfc', 'request_id': 'req-06ef1e60-0b10-4731-a4a9-59bb323a2dc1'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:08.058051 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-06ef1e60-0b10-4731-a4a9-59bb323a2dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '832038510a4e4829996ac61d4888edfc', 'request_id': 'req-06ef1e60-0b10-4731-a4a9-59bb323a2dc1'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:08.067038 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-06ef1e60-0b10-4731-a4a9-59bb323a2dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '832038510a4e4829996ac61d4888edfc', 'request_id': 'req-06ef1e60-0b10-4731-a4a9-59bb323a2dc1'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:08.078598 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-06ef1e60-0b10-4731-a4a9-59bb323a2dc1 admin admin] The token cache is being invalidate because project 832038510a4e4829996ac61d4888edfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:03:08.078887 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-06ef1e60-0b10-4731-a4a9-59bb323a2dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:08.079546 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-06ef1e60-0b10-4731-a4a9-59bb323a2dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:08.081268 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1310/2650] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:03:07 2022] DELETE /identity/v3/projects/832038510a4e4829996ac61d4888edfc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:08.086055 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c384-249d-4558-909f-f6548bd5092b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:08.086502 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c384-249d-4558-909f-f6548bd5092b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:08.086631 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c384-249d-4558-909f-f6548bd5092b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:08.108346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-33f2c384-249d-4558-909f-f6548bd5092b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:08.109564 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-33f2c384-249d-4558-909f-f6548bd5092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:08.186828 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1341/2651] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:08.196179 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e5ee7-40c8-4392-8e01-a5076322496a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:08.196469 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e5ee7-40c8-4392-8e01-a5076322496a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:08.196737 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e5ee7-40c8-4392-8e01-a5076322496a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:08.218102 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-234e5ee7-40c8-4392-8e01-a5076322496a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:08.219336 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-234e5ee7-40c8-4392-8e01-a5076322496a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:08.228250 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1311/2652] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:08.233392 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2c384-249d-4558-909f-f6548bd5092b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:08.243498 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2c384-249d-4558-909f-f6548bd5092b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:08.248433 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6eba42-2aa7-4723-bdbc-9335d3298b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:08.249066 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6eba42-2aa7-4723-bdbc-9335d3298b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:08.249350 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6eba42-2aa7-4723-bdbc-9335d3298b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:08.249623 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6eba42-2aa7-4723-bdbc-9335d3298b47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:08.250267 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6eba42-2aa7-4723-bdbc-9335d3298b47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:03:08.250582 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6eba42-2aa7-4723-bdbc-9335d3298b47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:08.252176 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6eba42-2aa7-4723-bdbc-9335d3298b47 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:08.264416 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1342/2653] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:03:08.269098 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e5ee7-40c8-4392-8e01-a5076322496a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:08.279058 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e5ee7-40c8-4392-8e01-a5076322496a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:08.283765 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93530caf-7a41-40c6-b292-67125814e7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:08.284360 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93530caf-7a41-40c6-b292-67125814e7d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:08.284637 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93530caf-7a41-40c6-b292-67125814e7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:08.284907 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93530caf-7a41-40c6-b292-67125814e7d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:08.285578 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93530caf-7a41-40c6-b292-67125814e7d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:08.287486 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93530caf-7a41-40c6-b292-67125814e7d1 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:08.316176 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1312/2654] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:03:08 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:08.320514 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6eba42-2aa7-4723-bdbc-9335d3298b47 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:08.330795 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6eba42-2aa7-4723-bdbc-9335d3298b47 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:08.388225 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f0b15-8650-4d52-898e-8c0a28251869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:08.388824 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0b15-8650-4d52-898e-8c0a28251869 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:08.389142 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0b15-8650-4d52-898e-8c0a28251869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:08.389404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0b15-8650-4d52-898e-8c0a28251869 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:08.390037 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f0b15-8650-4d52-898e-8c0a28251869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:08.391951 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f0b15-8650-4d52-898e-8c0a28251869 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:08.417087 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1343/2655] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:03:08 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:08.421176 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93530caf-7a41-40c6-b292-67125814e7d1 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:08.431783 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93530caf-7a41-40c6-b292-67125814e7d1 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:08.436537 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6001c-4bdf-4f41-874c-2a496425053f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:08.437182 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6001c-4bdf-4f41-874c-2a496425053f admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:08.437460 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6001c-4bdf-4f41-874c-2a496425053f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:08.437730 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6001c-4bdf-4f41-874c-2a496425053f admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:08.438368 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6001c-4bdf-4f41-874c-2a496425053f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:08.439971 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6001c-4bdf-4f41-874c-2a496425053f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:08.451189 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1313/2656] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:08.455812 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f0b15-8650-4d52-898e-8c0a28251869 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:08.467888 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f0b15-8650-4d52-898e-8c0a28251869 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:08.472699 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acc14b-a70e-443c-a391-43622d8c24ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:08.473349 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acc14b-a70e-443c-a391-43622d8c24ef admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:08.473629 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acc14b-a70e-443c-a391-43622d8c24ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:08.473903 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acc14b-a70e-443c-a391-43622d8c24ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:08.474580 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acc14b-a70e-443c-a391-43622d8c24ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:08.476179 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acc14b-a70e-443c-a391-43622d8c24ef admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:08.488133 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1344/2657] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:08.493441 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6001c-4bdf-4f41-874c-2a496425053f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:08.501088 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:08.505242 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6001c-4bdf-4f41-874c-2a496425053f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:08.511498 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cd1cd-bf30-497e-8ada-e758cb36abf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:08.512604 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cd1cd-bf30-497e-8ada-e758cb36abf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:08.513091 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cd1cd-bf30-497e-8ada-e758cb36abf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:08.513572 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cd1cd-bf30-497e-8ada-e758cb36abf2 admin admin] PATH_INFO: `/v3/projects/d09627dfc0e0429db62ae75c8406e3d3/users/8adfccc056344261a6e2f19fd5c07676/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:08.529871 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cd1cd-bf30-497e-8ada-e758cb36abf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09627dfc0e0429db62ae75c8406e3d3, user_id=8adfccc056344261a6e2f19fd5c07676, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:08.532666 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cd1cd-bf30-497e-8ada-e758cb36abf2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:08.547205 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1314/2658] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:08 2022] PUT /identity/v3/projects/d09627dfc0e0429db62ae75c8406e3d3/users/8adfccc056344261a6e2f19fd5c07676/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:08.557759 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047620e-2d27-4fb6-aaf1-3dcb28545bfe None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:08.558076 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047620e-2d27-4fb6-aaf1-3dcb28545bfe None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:08.558347 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047620e-2d27-4fb6-aaf1-3dcb28545bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:08.587764 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f047620e-2d27-4fb6-aaf1-3dcb28545bfe None None] MFA Rules not processed for user `8adfccc056344261a6e2f19fd5c07676`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:08.589020 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f047620e-2d27-4fb6-aaf1-3dcb28545bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:08.647365 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:08.660073 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1345/2659] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:08.664511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cd1cd-bf30-497e-8ada-e758cb36abf2 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:08.730503 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cd1cd-bf30-497e-8ada-e758cb36abf2 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:08.736210 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cf540-30eb-45f5-bec9-9e02ae79e07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:08.736811 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cf540-30eb-45f5-bec9-9e02ae79e07e admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:08.737120 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cf540-30eb-45f5-bec9-9e02ae79e07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:08.737531 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cf540-30eb-45f5-bec9-9e02ae79e07e admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:08.738011 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cf540-30eb-45f5-bec9-9e02ae79e07e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:08.739910 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cf540-30eb-45f5-bec9-9e02ae79e07e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:08.769711 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1315/2660] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:03:08 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:08.773769 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047620e-2d27-4fb6-aaf1-3dcb28545bfe None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:08.785680 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047620e-2d27-4fb6-aaf1-3dcb28545bfe None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:08.842658 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b288974-e03a-4f61-bfb3-307f336df664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:08.843256 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b288974-e03a-4f61-bfb3-307f336df664 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:08.843536 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b288974-e03a-4f61-bfb3-307f336df664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:08.843807 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b288974-e03a-4f61-bfb3-307f336df664 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:08.844434 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b288974-e03a-4f61-bfb3-307f336df664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:08.846668 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b288974-e03a-4f61-bfb3-307f336df664 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:08.867651 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1346/2661] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:03:08 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:08.871807 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cf540-30eb-45f5-bec9-9e02ae79e07e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:08.882333 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cf540-30eb-45f5-bec9-9e02ae79e07e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:08.887032 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bda54-6e6b-4dc6-b03e-113c887b12a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:08.888207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bda54-6e6b-4dc6-b03e-113c887b12a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:08.888559 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bda54-6e6b-4dc6-b03e-113c887b12a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:08.888861 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bda54-6e6b-4dc6-b03e-113c887b12a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:08.889542 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687bda54-6e6b-4dc6-b03e-113c887b12a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:08.891144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687bda54-6e6b-4dc6-b03e-113c887b12a3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:08.901843 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1316/2662] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:08.906904 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b288974-e03a-4f61-bfb3-307f336df664 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:08.916920 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b288974-e03a-4f61-bfb3-307f336df664 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:08.922798 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00bf3f-765c-49d3-9928-1382a75acd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:08.923449 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00bf3f-765c-49d3-9928-1382a75acd89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:08.923719 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00bf3f-765c-49d3-9928-1382a75acd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:08.923986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00bf3f-765c-49d3-9928-1382a75acd89 admin admin] PATH_INFO: `/v3/projects/eed02f639f504c32ab60f06ddef207be/users/7f492a7879fd4540a3e6ad695c355ac5/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:08.940036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00bf3f-765c-49d3-9928-1382a75acd89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed02f639f504c32ab60f06ddef207be, user_id=7f492a7879fd4540a3e6ad695c355ac5, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:08.942766 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00bf3f-765c-49d3-9928-1382a75acd89 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:08.956852 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1347/2663] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:08 2022] PUT /identity/v3/projects/eed02f639f504c32ab60f06ddef207be/users/7f492a7879fd4540a3e6ad695c355ac5/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:08.960826 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bda54-6e6b-4dc6-b03e-113c887b12a3 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:08.971146 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bda54-6e6b-4dc6-b03e-113c887b12a3 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:09.035165 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7e062-0246-4169-a280-4ccb356eadc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:09.035768 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7e062-0246-4169-a280-4ccb356eadc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:09.036047 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7e062-0246-4169-a280-4ccb356eadc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:09.036314 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7e062-0246-4169-a280-4ccb356eadc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:09.036954 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7e062-0246-4169-a280-4ccb356eadc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:09.038553 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7e062-0246-4169-a280-4ccb356eadc7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:09.048543 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1317/2664] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:09.052927 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00bf3f-765c-49d3-9928-1382a75acd89 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:09.063851 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00bf3f-765c-49d3-9928-1382a75acd89 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:09.068464 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a163ab-feb8-4269-a95a-1ec6b0cd388c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:09.069144 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a163ab-feb8-4269-a95a-1ec6b0cd388c admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:09.069421 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a163ab-feb8-4269-a95a-1ec6b0cd388c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:09.069725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a163ab-feb8-4269-a95a-1ec6b0cd388c admin admin] PATH_INFO: `/v3/projects/eed02f639f504c32ab60f06ddef207be/users/7f492a7879fd4540a3e6ad695c355ac5/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:09.071588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a163ab-feb8-4269-a95a-1ec6b0cd388c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed02f639f504c32ab60f06ddef207be, user_id=7f492a7879fd4540a3e6ad695c355ac5, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:09.074253 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a163ab-feb8-4269-a95a-1ec6b0cd388c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:09.085343 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1348/2665] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:09 2022] PUT /identity/v3/projects/eed02f639f504c32ab60f06ddef207be/users/7f492a7879fd4540a3e6ad695c355ac5/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:09.096058 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe5f6b-828c-4d7e-a78d-d364d3133c69 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:09.096367 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe5f6b-828c-4d7e-a78d-d364d3133c69 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:09.096672 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe5f6b-828c-4d7e-a78d-d364d3133c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:09.126598 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b4fe5f6b-828c-4d7e-a78d-d364d3133c69 None None] MFA Rules not processed for user `7f492a7879fd4540a3e6ad695c355ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:09.127800 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b4fe5f6b-828c-4d7e-a78d-d364d3133c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:09.172383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:09.210588 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1318/2666] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:09.219063 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a163ab-feb8-4269-a95a-1ec6b0cd388c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:09.220868 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-41a163ab-feb8-4269-a95a-1ec6b0cd388c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:09.287685 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a163ab-feb8-4269-a95a-1ec6b0cd388c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:09.291390 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3de813-2156-4eb7-aa12-0d10e6ff70f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:09.292002 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3de813-2156-4eb7-aa12-0d10e6ff70f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:09.292280 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3de813-2156-4eb7-aa12-0d10e6ff70f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:09.292550 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3de813-2156-4eb7-aa12-0d10e6ff70f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:09.303267 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3de813-2156-4eb7-aa12-0d10e6ff70f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:09.304777 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3de813-2156-4eb7-aa12-0d10e6ff70f6 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:09.315660 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1349/2667] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:09.346454 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe5f6b-828c-4d7e-a78d-d364d3133c69 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:09.419517 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe5f6b-828c-4d7e-a78d-d364d3133c69 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:09.424118 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02911b8-0fdd-4002-91ee-3ea4ce59db89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:09.424742 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02911b8-0fdd-4002-91ee-3ea4ce59db89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:09.425059 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02911b8-0fdd-4002-91ee-3ea4ce59db89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:09.425330 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02911b8-0fdd-4002-91ee-3ea4ce59db89 admin admin] PATH_INFO: `/v3/users/8adfccc056344261a6e2f19fd5c07676` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:09.426443 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02911b8-0fdd-4002-91ee-3ea4ce59db89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8adfccc056344261a6e2f19fd5c07676)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:09.428358 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02911b8-0fdd-4002-91ee-3ea4ce59db89 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:09.476830 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f02911b8-0fdd-4002-91ee-3ea4ce59db89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8adfccc056344261a6e2f19fd5c07676'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:09.477620 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f02911b8-0fdd-4002-91ee-3ea4ce59db89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8adfccc056344261a6e2f19fd5c07676'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:09.486170 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f02911b8-0fdd-4002-91ee-3ea4ce59db89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8adfccc056344261a6e2f19fd5c07676'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:09.486806 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f02911b8-0fdd-4002-91ee-3ea4ce59db89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8adfccc056344261a6e2f19fd5c07676'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:09.494260 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f02911b8-0fdd-4002-91ee-3ea4ce59db89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8adfccc056344261a6e2f19fd5c07676'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:09.511342 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1319/2668] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:03:09 2022] DELETE /identity/v3/users/8adfccc056344261a6e2f19fd5c07676 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:09.516473 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b599784-0161-47ce-938e-c7d9896cdd7a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:09.516761 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b599784-0161-47ce-938e-c7d9896cdd7a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:09.517071 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b599784-0161-47ce-938e-c7d9896cdd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:09.537696 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9b599784-0161-47ce-938e-c7d9896cdd7a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:09.539003 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9b599784-0161-47ce-938e-c7d9896cdd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:09.583763 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:09.604841 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1350/2669] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:09.615343 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02911b8-0fdd-4002-91ee-3ea4ce59db89 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:09.616814 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f02911b8-0fdd-4002-91ee-3ea4ce59db89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:09.675239 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02911b8-0fdd-4002-91ee-3ea4ce59db89 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:09.678863 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10cd32-b658-4f4a-9c2a-b188b6d905eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:09.679496 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10cd32-b658-4f4a-9c2a-b188b6d905eb service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:09.679775 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10cd32-b658-4f4a-9c2a-b188b6d905eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:09.680053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10cd32-b658-4f4a-9c2a-b188b6d905eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:09.690468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10cd32-b658-4f4a-9c2a-b188b6d905eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:09.691922 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10cd32-b658-4f4a-9c2a-b188b6d905eb service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:09.696386 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:09.704623 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1320/2670] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:09.983782 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b599784-0161-47ce-938e-c7d9896cdd7a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:09.985251 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9b599784-0161-47ce-938e-c7d9896cdd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:09.999222 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b599784-0161-47ce-938e-c7d9896cdd7a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:10.004481 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21291de1-95a3-4ba3-8547-f1b2b914b180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:10.005175 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21291de1-95a3-4ba3-8547-f1b2b914b180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:10.005527 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21291de1-95a3-4ba3-8547-f1b2b914b180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:10.005809 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21291de1-95a3-4ba3-8547-f1b2b914b180 admin admin] PATH_INFO: `/v3/projects/d09627dfc0e0429db62ae75c8406e3d3` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:10.006936 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21291de1-95a3-4ba3-8547-f1b2b914b180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09627dfc0e0429db62ae75c8406e3d3)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:10.008865 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21291de1-95a3-4ba3-8547-f1b2b914b180 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:10.057620 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-21291de1-95a3-4ba3-8547-f1b2b914b180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09627dfc0e0429db62ae75c8406e3d3', 'request_id': 'req-21291de1-95a3-4ba3-8547-f1b2b914b180'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:10.064500 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-21291de1-95a3-4ba3-8547-f1b2b914b180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09627dfc0e0429db62ae75c8406e3d3', 'request_id': 'req-21291de1-95a3-4ba3-8547-f1b2b914b180'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:10.074335 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-21291de1-95a3-4ba3-8547-f1b2b914b180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09627dfc0e0429db62ae75c8406e3d3', 'request_id': 'req-21291de1-95a3-4ba3-8547-f1b2b914b180'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:10.086816 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-21291de1-95a3-4ba3-8547-f1b2b914b180 admin admin] The token cache is being invalidate because project d09627dfc0e0429db62ae75c8406e3d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:03:10.087101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-21291de1-95a3-4ba3-8547-f1b2b914b180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:10.087858 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-21291de1-95a3-4ba3-8547-f1b2b914b180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:10.089693 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1351/2671] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:03:09 2022] DELETE /identity/v3/projects/d09627dfc0e0429db62ae75c8406e3d3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:10.093375 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10cd32-b658-4f4a-9c2a-b188b6d905eb service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:10.103234 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10cd32-b658-4f4a-9c2a-b188b6d905eb service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:10.162410 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10b009-038c-427c-8d46-b32b5a77c110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:10.163032 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10b009-038c-427c-8d46-b32b5a77c110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:10.163311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10b009-038c-427c-8d46-b32b5a77c110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:10.163584 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10b009-038c-427c-8d46-b32b5a77c110 admin admin] PATH_INFO: `/v3/users/7f492a7879fd4540a3e6ad695c355ac5` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:10.164688 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10b009-038c-427c-8d46-b32b5a77c110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f492a7879fd4540a3e6ad695c355ac5)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:10.166658 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10b009-038c-427c-8d46-b32b5a77c110 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:10.214279 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7d10b009-038c-427c-8d46-b32b5a77c110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f492a7879fd4540a3e6ad695c355ac5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:10.214938 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7d10b009-038c-427c-8d46-b32b5a77c110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f492a7879fd4540a3e6ad695c355ac5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:10.222350 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7d10b009-038c-427c-8d46-b32b5a77c110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f492a7879fd4540a3e6ad695c355ac5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:10.222959 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7d10b009-038c-427c-8d46-b32b5a77c110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f492a7879fd4540a3e6ad695c355ac5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:10.230582 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7d10b009-038c-427c-8d46-b32b5a77c110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f492a7879fd4540a3e6ad695c355ac5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:10.250072 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1321/2672] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:03:10 2022] DELETE /identity/v3/users/7f492a7879fd4540a3e6ad695c355ac5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:10.548617 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21291de1-95a3-4ba3-8547-f1b2b914b180 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:10.554745 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-21291de1-95a3-4ba3-8547-f1b2b914b180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:10.581101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21291de1-95a3-4ba3-8547-f1b2b914b180 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:10.644969 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769d6e7-c67f-444e-8cdc-ea0d0c25a38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:10.645704 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769d6e7-c67f-444e-8cdc-ea0d0c25a38d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:10.646079 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769d6e7-c67f-444e-8cdc-ea0d0c25a38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:10.646465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769d6e7-c67f-444e-8cdc-ea0d0c25a38d admin admin] PATH_INFO: `/v3/projects/eed02f639f504c32ab60f06ddef207be` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:10.647764 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769d6e7-c67f-444e-8cdc-ea0d0c25a38d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed02f639f504c32ab60f06ddef207be)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:10.650266 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769d6e7-c67f-444e-8cdc-ea0d0c25a38d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:10.706185 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6769d6e7-c67f-444e-8cdc-ea0d0c25a38d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed02f639f504c32ab60f06ddef207be', 'request_id': 'req-6769d6e7-c67f-444e-8cdc-ea0d0c25a38d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:10.713670 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6769d6e7-c67f-444e-8cdc-ea0d0c25a38d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed02f639f504c32ab60f06ddef207be', 'request_id': 'req-6769d6e7-c67f-444e-8cdc-ea0d0c25a38d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:10.722111 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6769d6e7-c67f-444e-8cdc-ea0d0c25a38d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed02f639f504c32ab60f06ddef207be', 'request_id': 'req-6769d6e7-c67f-444e-8cdc-ea0d0c25a38d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:10.733459 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6769d6e7-c67f-444e-8cdc-ea0d0c25a38d admin admin] The token cache is being invalidate because project eed02f639f504c32ab60f06ddef207be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:03:10.733755 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6769d6e7-c67f-444e-8cdc-ea0d0c25a38d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:10.734418 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6769d6e7-c67f-444e-8cdc-ea0d0c25a38d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:10.735906 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1352/2673] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:03:10 2022] DELETE /identity/v3/projects/eed02f639f504c32ab60f06ddef207be => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:10.741113 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bce86c-5585-430f-8266-0e3c807a8de6 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:10.741488 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bce86c-5585-430f-8266-0e3c807a8de6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:10.741774 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bce86c-5585-430f-8266-0e3c807a8de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:10.763354 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d2bce86c-5585-430f-8266-0e3c807a8de6 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:10.764575 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d2bce86c-5585-430f-8266-0e3c807a8de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:10.830684 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1322/2674] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:10.839747 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9e535-0be7-41cd-bd00-25f1ac153347 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:10.840034 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9e535-0be7-41cd-bd00-25f1ac153347 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:10.840308 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9e535-0be7-41cd-bd00-25f1ac153347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:10.848922 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:10.863632 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e3d9e535-0be7-41cd-bd00-25f1ac153347 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:10.864837 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e3d9e535-0be7-41cd-bd00-25f1ac153347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:10.873314 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1353/2675] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:10.877827 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bce86c-5585-430f-8266-0e3c807a8de6 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:10.888156 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bce86c-5585-430f-8266-0e3c807a8de6 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:10.892915 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85fd97-ee81-4d7c-b115-78b4f4756bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:10.893544 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85fd97-ee81-4d7c-b115-78b4f4756bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:10.893824 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85fd97-ee81-4d7c-b115-78b4f4756bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:10.894096 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85fd97-ee81-4d7c-b115-78b4f4756bf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:10.894745 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85fd97-ee81-4d7c-b115-78b4f4756bf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:03:10.895094 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85fd97-ee81-4d7c-b115-78b4f4756bf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:10.896651 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85fd97-ee81-4d7c-b115-78b4f4756bf1 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:10.909541 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1323/2676] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:03:10.913796 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9e535-0be7-41cd-bd00-25f1ac153347 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:10.923295 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9e535-0be7-41cd-bd00-25f1ac153347 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:10.928201 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11398bb2-948d-4810-aca8-0479a68bad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:10.928807 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11398bb2-948d-4810-aca8-0479a68bad85 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:10.929118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11398bb2-948d-4810-aca8-0479a68bad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:10.929389 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11398bb2-948d-4810-aca8-0479a68bad85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:10.930011 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11398bb2-948d-4810-aca8-0479a68bad85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:10.931914 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11398bb2-948d-4810-aca8-0479a68bad85 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:10.959580 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1354/2677] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:03:10 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:10.963787 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85fd97-ee81-4d7c-b115-78b4f4756bf1 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:10.970623 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:10.975056 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85fd97-ee81-4d7c-b115-78b4f4756bf1 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:11.035186 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062b29c-eae5-42b2-9610-d0716acdb578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:11.035792 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062b29c-eae5-42b2-9610-d0716acdb578 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:11.036075 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062b29c-eae5-42b2-9610-d0716acdb578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:11.036343 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062b29c-eae5-42b2-9610-d0716acdb578 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:11.037499 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062b29c-eae5-42b2-9610-d0716acdb578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:11.039429 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062b29c-eae5-42b2-9610-d0716acdb578 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:11.067537 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1324/2678] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:03:10 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:11.071677 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11398bb2-948d-4810-aca8-0479a68bad85 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:11.083036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11398bb2-948d-4810-aca8-0479a68bad85 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:11.087759 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25b1a1-bbac-4276-bbeb-3ccc9fd23c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:11.088351 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25b1a1-bbac-4276-bbeb-3ccc9fd23c90 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:11.088632 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25b1a1-bbac-4276-bbeb-3ccc9fd23c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:11.088905 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25b1a1-bbac-4276-bbeb-3ccc9fd23c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:11.089582 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25b1a1-bbac-4276-bbeb-3ccc9fd23c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:11.092135 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25b1a1-bbac-4276-bbeb-3ccc9fd23c90 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:11.102333 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1355/2679] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:11.106606 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062b29c-eae5-42b2-9610-d0716acdb578 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:11.116989 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062b29c-eae5-42b2-9610-d0716acdb578 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:11.122228 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5b1c0-e2c9-457a-a25f-e03391d83f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:11.123272 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5b1c0-e2c9-457a-a25f-e03391d83f72 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:11.123769 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5b1c0-e2c9-457a-a25f-e03391d83f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:11.124243 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5b1c0-e2c9-457a-a25f-e03391d83f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:11.125430 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5b1c0-e2c9-457a-a25f-e03391d83f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:11.127804 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5b1c0-e2c9-457a-a25f-e03391d83f72 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:11.138770 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1325/2680] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:11.142942 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25b1a1-bbac-4276-bbeb-3ccc9fd23c90 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:11.153647 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25b1a1-bbac-4276-bbeb-3ccc9fd23c90 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:11.158587 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06189d-c106-4030-a640-d2be9e9c4c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:11.159233 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06189d-c106-4030-a640-d2be9e9c4c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:11.159514 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06189d-c106-4030-a640-d2be9e9c4c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:11.159787 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06189d-c106-4030-a640-d2be9e9c4c9f admin admin] PATH_INFO: `/v3/projects/6aa6fb8f8ef343e688498f38321ae4db/users/18c38c17a6824460864660fdae0ad9a8/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:11.174504 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06189d-c106-4030-a640-d2be9e9c4c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa6fb8f8ef343e688498f38321ae4db, user_id=18c38c17a6824460864660fdae0ad9a8, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:11.177210 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06189d-c106-4030-a640-d2be9e9c4c9f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:11.190297 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1356/2681] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:11 2022] PUT /identity/v3/projects/6aa6fb8f8ef343e688498f38321ae4db/users/18c38c17a6824460864660fdae0ad9a8/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:11.201259 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fe428-b633-436c-bbff-50838ccdee0a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:11.201553 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fe428-b633-436c-bbff-50838ccdee0a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:11.201832 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fe428-b633-436c-bbff-50838ccdee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:11.229504 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-547fe428-b633-436c-bbff-50838ccdee0a None None] MFA Rules not processed for user `18c38c17a6824460864660fdae0ad9a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:11.230725 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-547fe428-b633-436c-bbff-50838ccdee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:11.296327 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1326/2682] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:11.300840 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06189d-c106-4030-a640-d2be9e9c4c9f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:11.364162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06189d-c106-4030-a640-d2be9e9c4c9f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:11.369021 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c293a-4fad-4b0f-9041-b407e349139d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:11.369625 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c293a-4fad-4b0f-9041-b407e349139d admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:11.369908 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c293a-4fad-4b0f-9041-b407e349139d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:11.370184 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c293a-4fad-4b0f-9041-b407e349139d admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:11.370856 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c293a-4fad-4b0f-9041-b407e349139d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:11.373335 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c293a-4fad-4b0f-9041-b407e349139d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:11.405282 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1357/2683] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:03:11 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:03:11.409723 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fe428-b633-436c-bbff-50838ccdee0a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:11.425176 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fe428-b633-436c-bbff-50838ccdee0a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:11.485586 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd637c-9eb1-449e-b86e-57628d3d68d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:11.486195 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd637c-9eb1-449e-b86e-57628d3d68d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:11.486477 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd637c-9eb1-449e-b86e-57628d3d68d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:11.486752 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd637c-9eb1-449e-b86e-57628d3d68d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:11.487383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd637c-9eb1-449e-b86e-57628d3d68d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:11.489415 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd637c-9eb1-449e-b86e-57628d3d68d6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:11.515008 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1327/2684] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:03:11 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:11.516214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c293a-4fad-4b0f-9041-b407e349139d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:11.526558 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c293a-4fad-4b0f-9041-b407e349139d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:11.531383 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa035eb9-ad97-4a46-898c-1907a4ce3c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:11.531974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa035eb9-ad97-4a46-898c-1907a4ce3c03 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:11.532250 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa035eb9-ad97-4a46-898c-1907a4ce3c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:11.532517 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa035eb9-ad97-4a46-898c-1907a4ce3c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:11.533202 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa035eb9-ad97-4a46-898c-1907a4ce3c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:11.534869 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa035eb9-ad97-4a46-898c-1907a4ce3c03 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:11.546108 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1358/2685] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:11.550051 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd637c-9eb1-449e-b86e-57628d3d68d6 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:11.555609 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:11.563580 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd637c-9eb1-449e-b86e-57628d3d68d6 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:11.568986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba9b7b-d55d-4860-84db-9593e3a3ae70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:11.569681 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba9b7b-d55d-4860-84db-9593e3a3ae70 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:11.570250 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba9b7b-d55d-4860-84db-9593e3a3ae70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:11.570600 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba9b7b-d55d-4860-84db-9593e3a3ae70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:11.571887 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba9b7b-d55d-4860-84db-9593e3a3ae70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:11.573647 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba9b7b-d55d-4860-84db-9593e3a3ae70 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:11.585605 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1328/2686] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:11.589577 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa035eb9-ad97-4a46-898c-1907a4ce3c03 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:11.600379 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa035eb9-ad97-4a46-898c-1907a4ce3c03 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:11.605188 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f3530-6009-4684-b9b3-eddb50d76734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:11.605856 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f3530-6009-4684-b9b3-eddb50d76734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:11.606930 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f3530-6009-4684-b9b3-eddb50d76734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:11.608198 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f3530-6009-4684-b9b3-eddb50d76734 admin admin] PATH_INFO: `/v3/projects/bd4fab0698c249fb9965f6b114e9cf59/users/8b2b331c50934c729ee8545ca4d596b2/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:11.627188 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f3530-6009-4684-b9b3-eddb50d76734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd4fab0698c249fb9965f6b114e9cf59, user_id=8b2b331c50934c729ee8545ca4d596b2, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:11.629903 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f3530-6009-4684-b9b3-eddb50d76734 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:11.650249 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1359/2687] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:11 2022] PUT /identity/v3/projects/bd4fab0698c249fb9965f6b114e9cf59/users/8b2b331c50934c729ee8545ca4d596b2/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:11.661937 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afdee6-a780-4f1a-85ba-7d2a9fe535c4 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:11.662195 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afdee6-a780-4f1a-85ba-7d2a9fe535c4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:11.662478 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afdee6-a780-4f1a-85ba-7d2a9fe535c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:11.695711 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-86afdee6-a780-4f1a-85ba-7d2a9fe535c4 None None] MFA Rules not processed for user `8b2b331c50934c729ee8545ca4d596b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:11.696933 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-86afdee6-a780-4f1a-85ba-7d2a9fe535c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:11.773902 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1329/2688] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:11.778900 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f3530-6009-4684-b9b3-eddb50d76734 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:11.828298 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:11.842535 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f3530-6009-4684-b9b3-eddb50d76734 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:11.847237 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8a339-f2fc-488d-8a99-05528702a694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:11.847835 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8a339-f2fc-488d-8a99-05528702a694 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:11.848118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8a339-f2fc-488d-8a99-05528702a694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:11.848392 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8a339-f2fc-488d-8a99-05528702a694 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:11.849105 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8a339-f2fc-488d-8a99-05528702a694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:11.851022 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8a339-f2fc-488d-8a99-05528702a694 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:11.881656 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1360/2689] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:03:11 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:11.885571 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afdee6-a780-4f1a-85ba-7d2a9fe535c4 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:11.896249 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afdee6-a780-4f1a-85ba-7d2a9fe535c4 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:11.955976 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d284ab-87fe-46dd-bf50-ea19e0b6ad65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:11.956601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d284ab-87fe-46dd-bf50-ea19e0b6ad65 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:11.956884 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d284ab-87fe-46dd-bf50-ea19e0b6ad65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:11.957188 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d284ab-87fe-46dd-bf50-ea19e0b6ad65 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:11.957837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d284ab-87fe-46dd-bf50-ea19e0b6ad65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:11.959798 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d284ab-87fe-46dd-bf50-ea19e0b6ad65 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:11.986900 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1330/2690] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:03:11 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:11.988208 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8a339-f2fc-488d-8a99-05528702a694 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:11.999311 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8a339-f2fc-488d-8a99-05528702a694 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:12.004334 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf779ebe-0563-4d1f-82cb-02c8f4c5e3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:12.005304 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf779ebe-0563-4d1f-82cb-02c8f4c5e3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:12.005605 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf779ebe-0563-4d1f-82cb-02c8f4c5e3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:12.005925 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf779ebe-0563-4d1f-82cb-02c8f4c5e3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:12.006563 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf779ebe-0563-4d1f-82cb-02c8f4c5e3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:12.008322 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf779ebe-0563-4d1f-82cb-02c8f4c5e3d1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:12.019819 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1361/2691] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:12.024014 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d284ab-87fe-46dd-bf50-ea19e0b6ad65 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:12.034867 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d284ab-87fe-46dd-bf50-ea19e0b6ad65 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:12.040519 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0f567-aa0b-4b4b-b9f3-bd2f607c8ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:12.041263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0f567-aa0b-4b4b-b9f3-bd2f607c8ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:12.041545 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0f567-aa0b-4b4b-b9f3-bd2f607c8ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:12.041819 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0f567-aa0b-4b4b-b9f3-bd2f607c8ec0 admin admin] PATH_INFO: `/v3/projects/e93ad71347ff4a43bf2ecc60b3f168aa/users/d77f9d4d1ec3408fbab92f207a94bdda/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:12.058525 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0f567-aa0b-4b4b-b9f3-bd2f607c8ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93ad71347ff4a43bf2ecc60b3f168aa, user_id=d77f9d4d1ec3408fbab92f207a94bdda, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:12.061295 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0f567-aa0b-4b4b-b9f3-bd2f607c8ec0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:12.082918 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1331/2692] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:12 2022] PUT /identity/v3/projects/e93ad71347ff4a43bf2ecc60b3f168aa/users/d77f9d4d1ec3408fbab92f207a94bdda/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:12.086943 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf779ebe-0563-4d1f-82cb-02c8f4c5e3d1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:12.098073 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf779ebe-0563-4d1f-82cb-02c8f4c5e3d1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:12.162666 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa79dd9-20f4-48be-a267-2637c0c3ba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:12.163412 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa79dd9-20f4-48be-a267-2637c0c3ba3d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:12.163693 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa79dd9-20f4-48be-a267-2637c0c3ba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:12.163993 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa79dd9-20f4-48be-a267-2637c0c3ba3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:12.164628 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa79dd9-20f4-48be-a267-2637c0c3ba3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:12.166267 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa79dd9-20f4-48be-a267-2637c0c3ba3d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:12.177332 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1362/2693] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:03:12.181468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0f567-aa0b-4b4b-b9f3-bd2f607c8ec0 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:12.192169 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0f567-aa0b-4b4b-b9f3-bd2f607c8ec0 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:12.197074 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d716eb-5f9b-4c86-ad58-0cf2b4819e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:12.197729 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d716eb-5f9b-4c86-ad58-0cf2b4819e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:12.198007 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d716eb-5f9b-4c86-ad58-0cf2b4819e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:12.198278 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d716eb-5f9b-4c86-ad58-0cf2b4819e40 admin admin] PATH_INFO: `/v3/projects/e93ad71347ff4a43bf2ecc60b3f168aa/users/d77f9d4d1ec3408fbab92f207a94bdda/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:12.200210 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d716eb-5f9b-4c86-ad58-0cf2b4819e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93ad71347ff4a43bf2ecc60b3f168aa, user_id=d77f9d4d1ec3408fbab92f207a94bdda, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:12.203003 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d716eb-5f9b-4c86-ad58-0cf2b4819e40 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:12.213838 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1332/2694] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:12 2022] PUT /identity/v3/projects/e93ad71347ff4a43bf2ecc60b3f168aa/users/d77f9d4d1ec3408fbab92f207a94bdda/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:12.224722 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd706e-c874-4e9d-939a-9e19145f020a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:12.225044 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd706e-c874-4e9d-939a-9e19145f020a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:12.225294 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd706e-c874-4e9d-939a-9e19145f020a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:12.255897 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d8dd706e-c874-4e9d-939a-9e19145f020a None None] MFA Rules not processed for user `d77f9d4d1ec3408fbab92f207a94bdda`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:12.256532 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d8dd706e-c874-4e9d-939a-9e19145f020a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:12.329251 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1363/2695] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:12.339892 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d716eb-5f9b-4c86-ad58-0cf2b4819e40 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:12.342216 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b8d716eb-5f9b-4c86-ad58-0cf2b4819e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:12.379215 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:12.405505 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d716eb-5f9b-4c86-ad58-0cf2b4819e40 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:12.409432 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f90162-9d38-42bf-9593-988af2df313e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:12.410249 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f90162-9d38-42bf-9593-988af2df313e service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:12.410533 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f90162-9d38-42bf-9593-988af2df313e service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:12.410803 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f90162-9d38-42bf-9593-988af2df313e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:12.423140 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f90162-9d38-42bf-9593-988af2df313e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:12.424585 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f90162-9d38-42bf-9593-988af2df313e service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:12.435160 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1333/2696] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:12.989342 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd706e-c874-4e9d-939a-9e19145f020a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:12.991037 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d8dd706e-c874-4e9d-939a-9e19145f020a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:13.004418 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd706e-c874-4e9d-939a-9e19145f020a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:13.008142 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b3ca0-1bd2-4ae5-9a67-9c30212357bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:13.008845 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b3ca0-1bd2-4ae5-9a67-9c30212357bb service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:13.009149 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b3ca0-1bd2-4ae5-9a67-9c30212357bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:13.009416 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b3ca0-1bd2-4ae5-9a67-9c30212357bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:13.055665 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:13.072020 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b3ca0-1bd2-4ae5-9a67-9c30212357bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:13.073521 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b3ca0-1bd2-4ae5-9a67-9c30212357bb service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:13.084060 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1364/2697] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:17.131121 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f90162-9d38-42bf-9593-988af2df313e service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:17.140591 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f90162-9d38-42bf-9593-988af2df313e service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:17.144196 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebef78-b93e-4ee9-9ef9-558444a93218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:17.144817 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebef78-b93e-4ee9-9ef9-558444a93218 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:17.145133 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebef78-b93e-4ee9-9ef9-558444a93218 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:17.145408 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebef78-b93e-4ee9-9ef9-558444a93218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:17.203872 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebef78-b93e-4ee9-9ef9-558444a93218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:17.205259 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebef78-b93e-4ee9-9ef9-558444a93218 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:17.214296 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1334/2698] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:19.357299 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b3ca0-1bd2-4ae5-9a67-9c30212357bb service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:19.422831 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b3ca0-1bd2-4ae5-9a67-9c30212357bb service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:19.428094 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a518a22-cb8a-4ce7-b286-53e94632c35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:19.428750 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a518a22-cb8a-4ce7-b286-53e94632c35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:19.429112 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a518a22-cb8a-4ce7-b286-53e94632c35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:19.429522 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a518a22-cb8a-4ce7-b286-53e94632c35b admin admin] PATH_INFO: `/v3/users/18c38c17a6824460864660fdae0ad9a8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:19.431116 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a518a22-cb8a-4ce7-b286-53e94632c35b admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c38c17a6824460864660fdae0ad9a8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:19.433157 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a518a22-cb8a-4ce7-b286-53e94632c35b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:19.485554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2a518a22-cb8a-4ce7-b286-53e94632c35b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c38c17a6824460864660fdae0ad9a8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:19.486280 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2a518a22-cb8a-4ce7-b286-53e94632c35b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c38c17a6824460864660fdae0ad9a8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:19.499120 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2a518a22-cb8a-4ce7-b286-53e94632c35b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c38c17a6824460864660fdae0ad9a8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:19.506827 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2a518a22-cb8a-4ce7-b286-53e94632c35b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c38c17a6824460864660fdae0ad9a8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:19.507592 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2a518a22-cb8a-4ce7-b286-53e94632c35b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c38c17a6824460864660fdae0ad9a8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:19.520766 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1365/2699] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:03:19 2022] DELETE /identity/v3/users/18c38c17a6824460864660fdae0ad9a8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:19.525588 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b905a-80db-469f-a959-73b157a9e9b5 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:19.526090 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b905a-80db-469f-a959-73b157a9e9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:19.526275 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b905a-80db-469f-a959-73b157a9e9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:19.546665 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d98b905a-80db-469f-a959-73b157a9e9b5 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:19.547874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d98b905a-80db-469f-a959-73b157a9e9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:19.608375 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1335/2700] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:19.618410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a518a22-cb8a-4ce7-b286-53e94632c35b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:19.619817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2a518a22-cb8a-4ce7-b286-53e94632c35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:19.679637 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a518a22-cb8a-4ce7-b286-53e94632c35b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:19.683245 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6016c-b081-4c62-97fb-0e7f366a6d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:19.684148 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6016c-b081-4c62-97fb-0e7f366a6d34 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:19.684426 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6016c-b081-4c62-97fb-0e7f366a6d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:19.684698 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6016c-b081-4c62-97fb-0e7f366a6d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:19.695832 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6016c-b081-4c62-97fb-0e7f366a6d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:19.697348 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6016c-b081-4c62-97fb-0e7f366a6d34 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:19.707647 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1366/2701] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:20.052028 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b905a-80db-469f-a959-73b157a9e9b5 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:20.054618 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d98b905a-80db-469f-a959-73b157a9e9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:20.068613 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b905a-80db-469f-a959-73b157a9e9b5 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:20.073505 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0680ea-ad03-4697-9cb5-4b0d0ca1c95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:20.074219 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0680ea-ad03-4697-9cb5-4b0d0ca1c95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:20.075165 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0680ea-ad03-4697-9cb5-4b0d0ca1c95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:20.075571 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0680ea-ad03-4697-9cb5-4b0d0ca1c95c admin admin] PATH_INFO: `/v3/projects/6aa6fb8f8ef343e688498f38321ae4db` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:20.077101 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0680ea-ad03-4697-9cb5-4b0d0ca1c95c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa6fb8f8ef343e688498f38321ae4db)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:20.079511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0680ea-ad03-4697-9cb5-4b0d0ca1c95c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:20.148635 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8d0680ea-ad03-4697-9cb5-4b0d0ca1c95c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa6fb8f8ef343e688498f38321ae4db', 'request_id': 'req-8d0680ea-ad03-4697-9cb5-4b0d0ca1c95c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.155857 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8d0680ea-ad03-4697-9cb5-4b0d0ca1c95c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa6fb8f8ef343e688498f38321ae4db', 'request_id': 'req-8d0680ea-ad03-4697-9cb5-4b0d0ca1c95c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.163057 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8d0680ea-ad03-4697-9cb5-4b0d0ca1c95c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa6fb8f8ef343e688498f38321ae4db', 'request_id': 'req-8d0680ea-ad03-4697-9cb5-4b0d0ca1c95c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.170129 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:20.175534 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8d0680ea-ad03-4697-9cb5-4b0d0ca1c95c admin admin] The token cache is being invalidate because project 6aa6fb8f8ef343e688498f38321ae4db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:03:20.175978 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8d0680ea-ad03-4697-9cb5-4b0d0ca1c95c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.177061 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8d0680ea-ad03-4697-9cb5-4b0d0ca1c95c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.178764 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1336/2702] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:03:20 2022] DELETE /identity/v3/projects/6aa6fb8f8ef343e688498f38321ae4db => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:20.182910 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6016c-b081-4c62-97fb-0e7f366a6d34 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:20.189974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:20.195726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6016c-b081-4c62-97fb-0e7f366a6d34 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:20.255850 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220b645-9fb9-4fe6-9b19-bc44404e6197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:20.256468 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220b645-9fb9-4fe6-9b19-bc44404e6197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:20.256758 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220b645-9fb9-4fe6-9b19-bc44404e6197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:20.257058 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220b645-9fb9-4fe6-9b19-bc44404e6197 admin admin] PATH_INFO: `/v3/users/8b2b331c50934c729ee8545ca4d596b2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:20.258329 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220b645-9fb9-4fe6-9b19-bc44404e6197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2b331c50934c729ee8545ca4d596b2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:20.260208 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220b645-9fb9-4fe6-9b19-bc44404e6197 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:20.307377 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d220b645-9fb9-4fe6-9b19-bc44404e6197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2b331c50934c729ee8545ca4d596b2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.308040 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d220b645-9fb9-4fe6-9b19-bc44404e6197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2b331c50934c729ee8545ca4d596b2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.320479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d220b645-9fb9-4fe6-9b19-bc44404e6197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2b331c50934c729ee8545ca4d596b2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.328521 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d220b645-9fb9-4fe6-9b19-bc44404e6197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2b331c50934c729ee8545ca4d596b2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.329224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d220b645-9fb9-4fe6-9b19-bc44404e6197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2b331c50934c729ee8545ca4d596b2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.341521 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1367/2703] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:03:20 2022] DELETE /identity/v3/users/8b2b331c50934c729ee8545ca4d596b2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:20.627937 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0680ea-ad03-4697-9cb5-4b0d0ca1c95c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:20.629574 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8d0680ea-ad03-4697-9cb5-4b0d0ca1c95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:20.644523 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0680ea-ad03-4697-9cb5-4b0d0ca1c95c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:20.706430 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c6e12-3b81-4a71-8cce-f4acbc51bb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:20.707072 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c6e12-3b81-4a71-8cce-f4acbc51bb71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:20.707347 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c6e12-3b81-4a71-8cce-f4acbc51bb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:20.707629 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c6e12-3b81-4a71-8cce-f4acbc51bb71 admin admin] PATH_INFO: `/v3/projects/bd4fab0698c249fb9965f6b114e9cf59` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:20.708733 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c6e12-3b81-4a71-8cce-f4acbc51bb71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd4fab0698c249fb9965f6b114e9cf59)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:20.710676 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c6e12-3b81-4a71-8cce-f4acbc51bb71 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:20.761937 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-861c6e12-3b81-4a71-8cce-f4acbc51bb71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd4fab0698c249fb9965f6b114e9cf59', 'request_id': 'req-861c6e12-3b81-4a71-8cce-f4acbc51bb71'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.769067 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-861c6e12-3b81-4a71-8cce-f4acbc51bb71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd4fab0698c249fb9965f6b114e9cf59', 'request_id': 'req-861c6e12-3b81-4a71-8cce-f4acbc51bb71'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.777218 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-861c6e12-3b81-4a71-8cce-f4acbc51bb71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd4fab0698c249fb9965f6b114e9cf59', 'request_id': 'req-861c6e12-3b81-4a71-8cce-f4acbc51bb71'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.789914 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-861c6e12-3b81-4a71-8cce-f4acbc51bb71 admin admin] The token cache is being invalidate because project bd4fab0698c249fb9965f6b114e9cf59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:03:20.790266 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-861c6e12-3b81-4a71-8cce-f4acbc51bb71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.791142 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-861c6e12-3b81-4a71-8cce-f4acbc51bb71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.796602 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1337/2704] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:03:20 2022] DELETE /identity/v3/projects/bd4fab0698c249fb9965f6b114e9cf59 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:20.799189 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220b645-9fb9-4fe6-9b19-bc44404e6197 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:20.800656 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d220b645-9fb9-4fe6-9b19-bc44404e6197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:20.814324 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220b645-9fb9-4fe6-9b19-bc44404e6197 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:20.879530 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e140c51-5b4d-4f68-afc6-77321d2343cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:20.880079 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e140c51-5b4d-4f68-afc6-77321d2343cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:20.880356 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e140c51-5b4d-4f68-afc6-77321d2343cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:20.880626 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e140c51-5b4d-4f68-afc6-77321d2343cb admin admin] PATH_INFO: `/v3/users/d77f9d4d1ec3408fbab92f207a94bdda` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:20.881776 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e140c51-5b4d-4f68-afc6-77321d2343cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77f9d4d1ec3408fbab92f207a94bdda)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:20.883676 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e140c51-5b4d-4f68-afc6-77321d2343cb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:20.913275 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:20.935602 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4e140c51-5b4d-4f68-afc6-77321d2343cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77f9d4d1ec3408fbab92f207a94bdda'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.936534 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4e140c51-5b4d-4f68-afc6-77321d2343cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77f9d4d1ec3408fbab92f207a94bdda'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.948776 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4e140c51-5b4d-4f68-afc6-77321d2343cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77f9d4d1ec3408fbab92f207a94bdda'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.956497 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4e140c51-5b4d-4f68-afc6-77321d2343cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77f9d4d1ec3408fbab92f207a94bdda'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.957146 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4e140c51-5b4d-4f68-afc6-77321d2343cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77f9d4d1ec3408fbab92f207a94bdda'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:20.970772 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1368/2705] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:03:20 2022] DELETE /identity/v3/users/d77f9d4d1ec3408fbab92f207a94bdda => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:21.252897 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c6e12-3b81-4a71-8cce-f4acbc51bb71 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:21.254549 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-861c6e12-3b81-4a71-8cce-f4acbc51bb71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:21.272530 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c6e12-3b81-4a71-8cce-f4acbc51bb71 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:21.345741 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fb989-6188-417f-b079-8a0508fbba3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:21.346480 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fb989-6188-417f-b079-8a0508fbba3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:21.347390 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fb989-6188-417f-b079-8a0508fbba3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:21.347659 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fb989-6188-417f-b079-8a0508fbba3b admin admin] PATH_INFO: `/v3/projects/e93ad71347ff4a43bf2ecc60b3f168aa` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:21.348852 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fb989-6188-417f-b079-8a0508fbba3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93ad71347ff4a43bf2ecc60b3f168aa)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:21.350922 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fb989-6188-417f-b079-8a0508fbba3b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:21.391148 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:21.408019 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-241fb989-6188-417f-b079-8a0508fbba3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93ad71347ff4a43bf2ecc60b3f168aa', 'request_id': 'req-241fb989-6188-417f-b079-8a0508fbba3b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:21.420256 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-241fb989-6188-417f-b079-8a0508fbba3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93ad71347ff4a43bf2ecc60b3f168aa', 'request_id': 'req-241fb989-6188-417f-b079-8a0508fbba3b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:21.437841 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-241fb989-6188-417f-b079-8a0508fbba3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93ad71347ff4a43bf2ecc60b3f168aa', 'request_id': 'req-241fb989-6188-417f-b079-8a0508fbba3b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:21.451946 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-241fb989-6188-417f-b079-8a0508fbba3b admin admin] The token cache is being invalidate because project e93ad71347ff4a43bf2ecc60b3f168aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:03:21.452248 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-241fb989-6188-417f-b079-8a0508fbba3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:21.452905 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-241fb989-6188-417f-b079-8a0508fbba3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:21.454687 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1338/2706] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:03:21 2022] DELETE /identity/v3/projects/e93ad71347ff4a43bf2ecc60b3f168aa => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:21.460424 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad63b7-9dfb-4885-b712-8dc60e221bf9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:21.460703 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad63b7-9dfb-4885-b712-8dc60e221bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:21.461024 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad63b7-9dfb-4885-b712-8dc60e221bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:21.483394 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0fad63b7-9dfb-4885-b712-8dc60e221bf9 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:21.484647 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0fad63b7-9dfb-4885-b712-8dc60e221bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:21.549516 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1369/2707] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:21.557976 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f6222-0868-4960-bd56-b75366f9c8b2 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:21.558262 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f6222-0868-4960-bd56-b75366f9c8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:21.558566 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f6222-0868-4960-bd56-b75366f9c8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:21.581048 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d56f6222-0868-4960-bd56-b75366f9c8b2 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:21.582292 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d56f6222-0868-4960-bd56-b75366f9c8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:21.591655 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1339/2708] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:21.596194 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad63b7-9dfb-4885-b712-8dc60e221bf9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:21.606811 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad63b7-9dfb-4885-b712-8dc60e221bf9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:21.612273 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e0e17-2cef-451e-bd89-ec846399fd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:21.612911 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e0e17-2cef-451e-bd89-ec846399fd2c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:21.613212 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e0e17-2cef-451e-bd89-ec846399fd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:21.613490 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e0e17-2cef-451e-bd89-ec846399fd2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:21.614140 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e0e17-2cef-451e-bd89-ec846399fd2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:03:21.614442 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e0e17-2cef-451e-bd89-ec846399fd2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:21.616327 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e0e17-2cef-451e-bd89-ec846399fd2c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:21.629853 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1370/2709] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:03:21.634390 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f6222-0868-4960-bd56-b75366f9c8b2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:21.654263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f6222-0868-4960-bd56-b75366f9c8b2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:21.654263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed3aa9-e9d2-49c5-8aa1-6f889f437cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:21.654263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed3aa9-e9d2-49c5-8aa1-6f889f437cce admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:21.654263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed3aa9-e9d2-49c5-8aa1-6f889f437cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:21.655017 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed3aa9-e9d2-49c5-8aa1-6f889f437cce admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:21.655017 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed3aa9-e9d2-49c5-8aa1-6f889f437cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:21.655017 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed3aa9-e9d2-49c5-8aa1-6f889f437cce admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:21.692896 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1340/2710] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:03:21 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:21.697152 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e0e17-2cef-451e-bd89-ec846399fd2c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:21.712141 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e0e17-2cef-451e-bd89-ec846399fd2c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:21.774460 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fbede-b8f0-41e1-b4d2-b3c813c305ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:21.775124 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fbede-b8f0-41e1-b4d2-b3c813c305ee admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:21.775433 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fbede-b8f0-41e1-b4d2-b3c813c305ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:21.775674 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fbede-b8f0-41e1-b4d2-b3c813c305ee admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:21.776315 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900fbede-b8f0-41e1-b4d2-b3c813c305ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:21.778889 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900fbede-b8f0-41e1-b4d2-b3c813c305ee admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:21.801900 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1371/2711] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:03:21 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:03:21.805577 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed3aa9-e9d2-49c5-8aa1-6f889f437cce admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:21.816449 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed3aa9-e9d2-49c5-8aa1-6f889f437cce admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:21.821259 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8fdfc-5aca-447f-b203-2f0a3b8c56db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:21.821857 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8fdfc-5aca-447f-b203-2f0a3b8c56db admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:21.822138 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8fdfc-5aca-447f-b203-2f0a3b8c56db admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:21.822411 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8fdfc-5aca-447f-b203-2f0a3b8c56db admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:21.823053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8fdfc-5aca-447f-b203-2f0a3b8c56db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:21.824688 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8fdfc-5aca-447f-b203-2f0a3b8c56db admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:21.835106 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1341/2712] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:21.839160 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fbede-b8f0-41e1-b4d2-b3c813c305ee admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:21.850496 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fbede-b8f0-41e1-b4d2-b3c813c305ee admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:21.856220 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128356c5-378f-4616-9a19-c798d5664bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:21.857058 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128356c5-378f-4616-9a19-c798d5664bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:21.857373 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128356c5-378f-4616-9a19-c798d5664bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:21.857707 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128356c5-378f-4616-9a19-c798d5664bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:21.858430 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128356c5-378f-4616-9a19-c798d5664bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:21.860840 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128356c5-378f-4616-9a19-c798d5664bc0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:21.874491 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1372/2713] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:21.875779 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8fdfc-5aca-447f-b203-2f0a3b8c56db admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:21.886353 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8fdfc-5aca-447f-b203-2f0a3b8c56db admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:21.892222 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e307a-0e5d-4905-a2a7-8962c96f988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:21.892882 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e307a-0e5d-4905-a2a7-8962c96f988c admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:21.893195 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e307a-0e5d-4905-a2a7-8962c96f988c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:21.893470 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e307a-0e5d-4905-a2a7-8962c96f988c admin admin] PATH_INFO: `/v3/projects/d1a9fc1a687d42609512d6f704d204a3/users/e5890f94356248fcbeeaad770a9e3ca7/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:21.910053 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e307a-0e5d-4905-a2a7-8962c96f988c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1a9fc1a687d42609512d6f704d204a3, user_id=e5890f94356248fcbeeaad770a9e3ca7, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:21.912689 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e307a-0e5d-4905-a2a7-8962c96f988c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:21.927612 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1342/2714] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:21 2022] PUT /identity/v3/projects/d1a9fc1a687d42609512d6f704d204a3/users/e5890f94356248fcbeeaad770a9e3ca7/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:21.941999 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3851ea7-ee56-4c22-a6ee-a5283e8fe4cb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:21.942286 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3851ea7-ee56-4c22-a6ee-a5283e8fe4cb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:21.942558 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3851ea7-ee56-4c22-a6ee-a5283e8fe4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:21.963115 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:21.975674 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e3851ea7-ee56-4c22-a6ee-a5283e8fe4cb None None] MFA Rules not processed for user `e5890f94356248fcbeeaad770a9e3ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:21.976954 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e3851ea7-ee56-4c22-a6ee-a5283e8fe4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:22.047140 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1373/2715] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:22.060065 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e307a-0e5d-4905-a2a7-8962c96f988c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:22.062037 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-404e307a-0e5d-4905-a2a7-8962c96f988c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:22.123181 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e307a-0e5d-4905-a2a7-8962c96f988c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:22.128387 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ff8d3-f0dd-4d95-a315-c35ed5de3b04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:22.129228 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ff8d3-f0dd-4d95-a315-c35ed5de3b04 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:22.129511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ff8d3-f0dd-4d95-a315-c35ed5de3b04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:22.129961 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ff8d3-f0dd-4d95-a315-c35ed5de3b04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:22.139403 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ff8d3-f0dd-4d95-a315-c35ed5de3b04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:22.140978 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ff8d3-f0dd-4d95-a315-c35ed5de3b04 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:22.153387 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1343/2716] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:03:24.783323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3851ea7-ee56-4c22-a6ee-a5283e8fe4cb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:24.845454 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3851ea7-ee56-4c22-a6ee-a5283e8fe4cb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:24.851094 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e827bb-a8d3-4b3b-b76c-896197a8f5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:24.851743 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e827bb-a8d3-4b3b-b76c-896197a8f5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:24.852005 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e827bb-a8d3-4b3b-b76c-896197a8f5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:24.852274 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e827bb-a8d3-4b3b-b76c-896197a8f5bf admin admin] PATH_INFO: `/v3/users/e5890f94356248fcbeeaad770a9e3ca7` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:24.853943 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e827bb-a8d3-4b3b-b76c-896197a8f5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5890f94356248fcbeeaad770a9e3ca7)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:24.856528 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e827bb-a8d3-4b3b-b76c-896197a8f5bf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:24.904385 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a7e827bb-a8d3-4b3b-b76c-896197a8f5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5890f94356248fcbeeaad770a9e3ca7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:24.905081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a7e827bb-a8d3-4b3b-b76c-896197a8f5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5890f94356248fcbeeaad770a9e3ca7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:24.916823 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a7e827bb-a8d3-4b3b-b76c-896197a8f5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5890f94356248fcbeeaad770a9e3ca7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:24.924465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a7e827bb-a8d3-4b3b-b76c-896197a8f5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5890f94356248fcbeeaad770a9e3ca7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:24.925181 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a7e827bb-a8d3-4b3b-b76c-896197a8f5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5890f94356248fcbeeaad770a9e3ca7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:24.938459 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1374/2717] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:03:24 2022] DELETE /identity/v3/users/e5890f94356248fcbeeaad770a9e3ca7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:24.942899 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd8ee3-094e-4fcc-9b78-f0fddf6150ed None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:24.943387 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd8ee3-094e-4fcc-9b78-f0fddf6150ed None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:24.943573 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd8ee3-094e-4fcc-9b78-f0fddf6150ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:24.963293 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-22bd8ee3-094e-4fcc-9b78-f0fddf6150ed None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:24.964493 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-22bd8ee3-094e-4fcc-9b78-f0fddf6150ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:25.017601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:25.028609 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1344/2718] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:03:25.038312 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e827bb-a8d3-4b3b-b76c-896197a8f5bf admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:25.039726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a7e827bb-a8d3-4b3b-b76c-896197a8f5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:25.061298 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:25.100928 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e827bb-a8d3-4b3b-b76c-896197a8f5bf admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:25.104545 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55a45a-a6a1-4d11-8aa6-de67f8f90444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:25.105172 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55a45a-a6a1-4d11-8aa6-de67f8f90444 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:25.106179 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55a45a-a6a1-4d11-8aa6-de67f8f90444 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:25.106465 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55a45a-a6a1-4d11-8aa6-de67f8f90444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:25.115623 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55a45a-a6a1-4d11-8aa6-de67f8f90444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:25.117172 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55a45a-a6a1-4d11-8aa6-de67f8f90444 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:25.131111 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1375/2719] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:25.415817 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd8ee3-094e-4fcc-9b78-f0fddf6150ed None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:25.417301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-22bd8ee3-094e-4fcc-9b78-f0fddf6150ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:25.430504 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd8ee3-094e-4fcc-9b78-f0fddf6150ed None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:25.437125 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655854e-2691-4765-be07-e0168321dc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:25.437871 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655854e-2691-4765-be07-e0168321dc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:25.438158 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655854e-2691-4765-be07-e0168321dc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:25.438433 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655854e-2691-4765-be07-e0168321dc3b admin admin] PATH_INFO: `/v3/projects/d1a9fc1a687d42609512d6f704d204a3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:25.440201 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655854e-2691-4765-be07-e0168321dc3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1a9fc1a687d42609512d6f704d204a3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:25.441731 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655854e-2691-4765-be07-e0168321dc3b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:25.496267 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b655854e-2691-4765-be07-e0168321dc3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1a9fc1a687d42609512d6f704d204a3', 'request_id': 'req-b655854e-2691-4765-be07-e0168321dc3b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:25.502991 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b655854e-2691-4765-be07-e0168321dc3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1a9fc1a687d42609512d6f704d204a3', 'request_id': 'req-b655854e-2691-4765-be07-e0168321dc3b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:25.511309 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b655854e-2691-4765-be07-e0168321dc3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1a9fc1a687d42609512d6f704d204a3', 'request_id': 'req-b655854e-2691-4765-be07-e0168321dc3b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:25.523118 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b655854e-2691-4765-be07-e0168321dc3b admin admin] The token cache is being invalidate because project d1a9fc1a687d42609512d6f704d204a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:03:25.523356 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b655854e-2691-4765-be07-e0168321dc3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:25.524035 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b655854e-2691-4765-be07-e0168321dc3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:25.525542 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1345/2720] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:03:25 2022] DELETE /identity/v3/projects/d1a9fc1a687d42609512d6f704d204a3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:25.531136 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f11c9-7b71-4071-9205-fa61c9341b77 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:25.531430 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f11c9-7b71-4071-9205-fa61c9341b77 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:25.531705 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f11c9-7b71-4071-9205-fa61c9341b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:25.552071 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-405f11c9-7b71-4071-9205-fa61c9341b77 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:25.552838 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-405f11c9-7b71-4071-9205-fa61c9341b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:25.613214 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1376/2721] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:25.621533 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf649b-1e92-4113-aaf6-f5011d4aef52 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:25.621797 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf649b-1e92-4113-aaf6-f5011d4aef52 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:25.622052 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf649b-1e92-4113-aaf6-f5011d4aef52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:25.641929 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-7cdf649b-1e92-4113-aaf6-f5011d4aef52 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:25.643122 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7cdf649b-1e92-4113-aaf6-f5011d4aef52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:25.650942 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1346/2722] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:25.655626 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f11c9-7b71-4071-9205-fa61c9341b77 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:25.665666 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f11c9-7b71-4071-9205-fa61c9341b77 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:25.670948 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff980e-e9f4-479d-b398-004f780b184e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:25.671533 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff980e-e9f4-479d-b398-004f780b184e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:25.671808 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff980e-e9f4-479d-b398-004f780b184e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:25.672080 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff980e-e9f4-479d-b398-004f780b184e admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:25.672736 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff980e-e9f4-479d-b398-004f780b184e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:03:25.673068 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff980e-e9f4-479d-b398-004f780b184e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:25.674647 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff980e-e9f4-479d-b398-004f780b184e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:25.686574 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1377/2723] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:03:25.691058 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf649b-1e92-4113-aaf6-f5011d4aef52 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:25.700578 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf649b-1e92-4113-aaf6-f5011d4aef52 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:25.705324 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593bc1d-1334-45c3-b723-862f513152c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:25.705930 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593bc1d-1334-45c3-b723-862f513152c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:25.706210 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593bc1d-1334-45c3-b723-862f513152c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:25.706485 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593bc1d-1334-45c3-b723-862f513152c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:25.707112 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593bc1d-1334-45c3-b723-862f513152c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:25.709059 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593bc1d-1334-45c3-b723-862f513152c1 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:25.738972 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1347/2724] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:03:25 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:25.743726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff980e-e9f4-479d-b398-004f780b184e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:25.754519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff980e-e9f4-479d-b398-004f780b184e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:25.811737 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a935b-cb1c-408b-9ee0-dc1185b66316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:25.812405 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a935b-cb1c-408b-9ee0-dc1185b66316 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:25.812508 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a935b-cb1c-408b-9ee0-dc1185b66316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:25.812750 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a935b-cb1c-408b-9ee0-dc1185b66316 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:25.813428 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a935b-cb1c-408b-9ee0-dc1185b66316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:25.815382 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a935b-cb1c-408b-9ee0-dc1185b66316 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:25.837536 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1378/2725] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:03:25 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:25.842294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593bc1d-1334-45c3-b723-862f513152c1 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:25.852812 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593bc1d-1334-45c3-b723-862f513152c1 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:25.857747 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8183bf-5a2f-438a-aaa8-c9d44790903c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:25.858336 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8183bf-5a2f-438a-aaa8-c9d44790903c admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:25.858618 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8183bf-5a2f-438a-aaa8-c9d44790903c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:25.858895 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8183bf-5a2f-438a-aaa8-c9d44790903c admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:25.859529 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8183bf-5a2f-438a-aaa8-c9d44790903c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:25.861166 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8183bf-5a2f-438a-aaa8-c9d44790903c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:25.871885 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1348/2726] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:25.876081 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a935b-cb1c-408b-9ee0-dc1185b66316 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:25.887000 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a935b-cb1c-408b-9ee0-dc1185b66316 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:25.892645 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f54f1-5b29-4ff1-97db-e42b84ff78ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:25.893341 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f54f1-5b29-4ff1-97db-e42b84ff78ed admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:25.893626 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f54f1-5b29-4ff1-97db-e42b84ff78ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:25.893902 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f54f1-5b29-4ff1-97db-e42b84ff78ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:25.896145 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f54f1-5b29-4ff1-97db-e42b84ff78ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:25.896145 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f54f1-5b29-4ff1-97db-e42b84ff78ed admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:25.908390 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1379/2727] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:03:25.912867 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8183bf-5a2f-438a-aaa8-c9d44790903c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:25.922757 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8183bf-5a2f-438a-aaa8-c9d44790903c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:25.927392 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b2ca2-2e9f-4384-b958-eca991cc4016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:25.928046 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b2ca2-2e9f-4384-b958-eca991cc4016 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:25.928329 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b2ca2-2e9f-4384-b958-eca991cc4016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:25.928645 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b2ca2-2e9f-4384-b958-eca991cc4016 admin admin] PATH_INFO: `/v3/projects/02f4548c1b4741408d6603bd65617a1d/users/154add74fe544cf4ba7466ad8c890efc/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:25.944689 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b2ca2-2e9f-4384-b958-eca991cc4016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02f4548c1b4741408d6603bd65617a1d, user_id=154add74fe544cf4ba7466ad8c890efc, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:25.947745 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b2ca2-2e9f-4384-b958-eca991cc4016 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:25.966098 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1349/2728] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:25 2022] PUT /identity/v3/projects/02f4548c1b4741408d6603bd65617a1d/users/154add74fe544cf4ba7466ad8c890efc/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:25.976676 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d319f5-ae66-4b73-8231-f707c0df8da6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:25.976984 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d319f5-ae66-4b73-8231-f707c0df8da6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:25.977268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d319f5-ae66-4b73-8231-f707c0df8da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:26.006089 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-32d319f5-ae66-4b73-8231-f707c0df8da6 None None] MFA Rules not processed for user `154add74fe544cf4ba7466ad8c890efc`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:26.007612 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-32d319f5-ae66-4b73-8231-f707c0df8da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:26.020905 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:26.089015 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1380/2729] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:03:26.099873 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b2ca2-2e9f-4384-b958-eca991cc4016 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:26.102327 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5e9b2ca2-2e9f-4384-b958-eca991cc4016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:26.171576 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b2ca2-2e9f-4384-b958-eca991cc4016 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:26.175209 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a12e4d-858c-43c1-8612-f66fa618514f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2920ad41c61b401299ca5ae1714b4031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:26.175812 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a12e4d-858c-43c1-8612-f66fa618514f service glance] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:26.176089 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a12e4d-858c-43c1-8612-f66fa618514f service glance] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:26.176360 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a12e4d-858c-43c1-8612-f66fa618514f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:26.185968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a12e4d-858c-43c1-8612-f66fa618514f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:26.187410 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a12e4d-858c-43c1-8612-f66fa618514f service glance] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:26.196608 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1350/2730] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:36.082820 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=20 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:36.192560 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:37.000248 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab7828-9dec-439f-8e97-c4efd17e1ba3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:37.000529 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab7828-9dec-439f-8e97-c4efd17e1ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:37.000805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab7828-9dec-439f-8e97-c4efd17e1ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:37.021878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e1ab7828-9dec-439f-8e97-c4efd17e1ba3 None None] MFA Rules not processed for user `3fe1c1254c2b4d98942176ce0c0f2502`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:37.023108 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e1ab7828-9dec-439f-8e97-c4efd17e1ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:37.087302 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1381/2731] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:37.411572 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a12e4d-858c-43c1-8612-f66fa618514f service glance] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:37.413110 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a6a12e4d-858c-43c1-8612-f66fa618514f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:37.479813 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a12e4d-858c-43c1-8612-f66fa618514f service glance] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:37.484437 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502c560-3aa3-4609-8cdb-aca8dea761f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:37.485071 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502c560-3aa3-4609-8cdb-aca8dea761f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:37.485347 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502c560-3aa3-4609-8cdb-aca8dea761f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:37.485618 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502c560-3aa3-4609-8cdb-aca8dea761f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:37.487332 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e502c560-3aa3-4609-8cdb-aca8dea761f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:37.497664 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502c560-3aa3-4609-8cdb-aca8dea761f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:37.499125 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502c560-3aa3-4609-8cdb-aca8dea761f5 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:37.507908 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1351/2732] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:47.080628 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=25 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:47.503755 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=26 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:48.006203 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab7828-9dec-439f-8e97-c4efd17e1ba3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:48.083588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab7828-9dec-439f-8e97-c4efd17e1ba3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:48.088884 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd1080-9495-424e-8e45-f1a21578caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:48.089715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd1080-9495-424e-8e45-f1a21578caae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:48.090640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd1080-9495-424e-8e45-f1a21578caae admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:48.091054 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd1080-9495-424e-8e45-f1a21578caae admin admin] PATH_INFO: `/v3/users/154add74fe544cf4ba7466ad8c890efc` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:48.092895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd1080-9495-424e-8e45-f1a21578caae admin admin] RBAC: Authorizing `identity:delete_user(user_id=154add74fe544cf4ba7466ad8c890efc)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:48.094534 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd1080-9495-424e-8e45-f1a21578caae admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:48.151886 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30fd1080-9495-424e-8e45-f1a21578caae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154add74fe544cf4ba7466ad8c890efc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:48.153039 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30fd1080-9495-424e-8e45-f1a21578caae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154add74fe544cf4ba7466ad8c890efc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:48.176036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30fd1080-9495-424e-8e45-f1a21578caae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154add74fe544cf4ba7466ad8c890efc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:48.187374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30fd1080-9495-424e-8e45-f1a21578caae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154add74fe544cf4ba7466ad8c890efc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:48.188011 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30fd1080-9495-424e-8e45-f1a21578caae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154add74fe544cf4ba7466ad8c890efc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:48.207241 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1382/2733] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:03:48 2022] DELETE /identity/v3/users/154add74fe544cf4ba7466ad8c890efc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:48.208789 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da2479-adf4-4441-ba72-cefa727c8e19 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:48.209026 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da2479-adf4-4441-ba72-cefa727c8e19 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:48.209296 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da2479-adf4-4441-ba72-cefa727c8e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:48.231201 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-30da2479-adf4-4441-ba72-cefa727c8e19 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:48.232693 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-30da2479-adf4-4441-ba72-cefa727c8e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:48.300884 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1352/2734] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:48.311395 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd1080-9495-424e-8e45-f1a21578caae admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:48.312818 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-30fd1080-9495-424e-8e45-f1a21578caae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:48.372191 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd1080-9495-424e-8e45-f1a21578caae admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:48.376093 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bd37c-789a-4932-a2c5-e8a6aad17e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:48.376705 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bd37c-789a-4932-a2c5-e8a6aad17e51 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:48.377084 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bd37c-789a-4932-a2c5-e8a6aad17e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:48.377363 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bd37c-789a-4932-a2c5-e8a6aad17e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:48.386684 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bd37c-789a-4932-a2c5-e8a6aad17e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:48.388162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bd37c-789a-4932-a2c5-e8a6aad17e51 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:48.398053 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1383/2735] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:48.700560 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da2479-adf4-4441-ba72-cefa727c8e19 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:48.702109 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-30da2479-adf4-4441-ba72-cefa727c8e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:48.714742 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da2479-adf4-4441-ba72-cefa727c8e19 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:48.720956 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ebc7f-8ac5-4f21-9408-f582de1f4d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:48.721609 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ebc7f-8ac5-4f21-9408-f582de1f4d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:48.721886 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ebc7f-8ac5-4f21-9408-f582de1f4d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:48.722155 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ebc7f-8ac5-4f21-9408-f582de1f4d0e admin admin] PATH_INFO: `/v3/projects/02f4548c1b4741408d6603bd65617a1d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:48.723286 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ebc7f-8ac5-4f21-9408-f582de1f4d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=02f4548c1b4741408d6603bd65617a1d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:48.725520 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ebc7f-8ac5-4f21-9408-f582de1f4d0e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:48.779521 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1c6ebc7f-8ac5-4f21-9408-f582de1f4d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02f4548c1b4741408d6603bd65617a1d', 'request_id': 'req-1c6ebc7f-8ac5-4f21-9408-f582de1f4d0e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:48.786687 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1c6ebc7f-8ac5-4f21-9408-f582de1f4d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02f4548c1b4741408d6603bd65617a1d', 'request_id': 'req-1c6ebc7f-8ac5-4f21-9408-f582de1f4d0e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:48.795590 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1c6ebc7f-8ac5-4f21-9408-f582de1f4d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02f4548c1b4741408d6603bd65617a1d', 'request_id': 'req-1c6ebc7f-8ac5-4f21-9408-f582de1f4d0e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:48.807527 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1c6ebc7f-8ac5-4f21-9408-f582de1f4d0e admin admin] The token cache is being invalidate because project 02f4548c1b4741408d6603bd65617a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:03:48.807821 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1c6ebc7f-8ac5-4f21-9408-f582de1f4d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:48.808470 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1c6ebc7f-8ac5-4f21-9408-f582de1f4d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:48.810224 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1353/2736] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:03:48 2022] DELETE /identity/v3/projects/02f4548c1b4741408d6603bd65617a1d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:48.815374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587387d-e4cc-4fee-93c3-13e687fffbe9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:48.815671 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587387d-e4cc-4fee-93c3-13e687fffbe9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:48.816047 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587387d-e4cc-4fee-93c3-13e687fffbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:48.836479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5587387d-e4cc-4fee-93c3-13e687fffbe9 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:48.837773 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5587387d-e4cc-4fee-93c3-13e687fffbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:48.858538 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:48.904766 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1384/2737] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:48.968762 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92e78e-edc8-4ebb-acdf-ba3a9ae67874 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:48.969081 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92e78e-edc8-4ebb-acdf-ba3a9ae67874 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:48.969363 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92e78e-edc8-4ebb-acdf-ba3a9ae67874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:48.990856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ba92e78e-edc8-4ebb-acdf-ba3a9ae67874 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:48.991998 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ba92e78e-edc8-4ebb-acdf-ba3a9ae67874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:48.999948 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1354/2738] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:49.004182 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587387d-e4cc-4fee-93c3-13e687fffbe9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:49.014412 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587387d-e4cc-4fee-93c3-13e687fffbe9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:49.019025 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578e3a8-6e1e-49d2-80aa-15bbde38e0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:49.019621 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578e3a8-6e1e-49d2-80aa-15bbde38e0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:49.019901 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578e3a8-6e1e-49d2-80aa-15bbde38e0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:49.020174 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578e3a8-6e1e-49d2-80aa-15bbde38e0b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:49.020813 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578e3a8-6e1e-49d2-80aa-15bbde38e0b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:03:49.021149 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578e3a8-6e1e-49d2-80aa-15bbde38e0b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:49.022741 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578e3a8-6e1e-49d2-80aa-15bbde38e0b3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:49.034932 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1385/2739] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:03:49.039208 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92e78e-edc8-4ebb-acdf-ba3a9ae67874 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:49.048735 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92e78e-edc8-4ebb-acdf-ba3a9ae67874 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:49.053549 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d6063-bd67-4c64-8f83-c54c6f2d5e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:49.054136 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d6063-bd67-4c64-8f83-c54c6f2d5e16 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:49.054413 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d6063-bd67-4c64-8f83-c54c6f2d5e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:49.054683 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d6063-bd67-4c64-8f83-c54c6f2d5e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:49.055302 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d6063-bd67-4c64-8f83-c54c6f2d5e16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:49.057241 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d6063-bd67-4c64-8f83-c54c6f2d5e16 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:49.085716 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1355/2740] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:03:49 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:49.089864 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578e3a8-6e1e-49d2-80aa-15bbde38e0b3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:49.100715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578e3a8-6e1e-49d2-80aa-15bbde38e0b3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:49.158805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebaec17-ca42-49cd-a072-55246c6b7ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:49.159410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebaec17-ca42-49cd-a072-55246c6b7ece admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:49.159690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebaec17-ca42-49cd-a072-55246c6b7ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:49.159961 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebaec17-ca42-49cd-a072-55246c6b7ece admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:49.160581 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebaec17-ca42-49cd-a072-55246c6b7ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:49.162549 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebaec17-ca42-49cd-a072-55246c6b7ece admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:49.187574 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1386/2741] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:03:49 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:03:49.189068 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d6063-bd67-4c64-8f83-c54c6f2d5e16 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:49.200550 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d6063-bd67-4c64-8f83-c54c6f2d5e16 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:49.205331 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec5d81-2cce-4a97-99e1-16836e705548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:49.205928 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec5d81-2cce-4a97-99e1-16836e705548 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:49.206210 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec5d81-2cce-4a97-99e1-16836e705548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:49.206512 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec5d81-2cce-4a97-99e1-16836e705548 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:49.207150 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec5d81-2cce-4a97-99e1-16836e705548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:49.208754 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec5d81-2cce-4a97-99e1-16836e705548 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:49.219979 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1356/2742] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:49.224018 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebaec17-ca42-49cd-a072-55246c6b7ece admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:49.234261 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebaec17-ca42-49cd-a072-55246c6b7ece admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:49.238891 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c40e79-2102-4b48-9456-a9e5b846e62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:49.239756 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c40e79-2102-4b48-9456-a9e5b846e62a admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:49.240036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c40e79-2102-4b48-9456-a9e5b846e62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:49.240619 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c40e79-2102-4b48-9456-a9e5b846e62a admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:49.241339 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c40e79-2102-4b48-9456-a9e5b846e62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:49.242875 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c40e79-2102-4b48-9456-a9e5b846e62a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:49.253599 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1387/2743] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:49.257711 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec5d81-2cce-4a97-99e1-16836e705548 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:49.268357 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec5d81-2cce-4a97-99e1-16836e705548 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:49.273108 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8de97-d1aa-4d01-ba79-7b07aab38be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:49.273750 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8de97-d1aa-4d01-ba79-7b07aab38be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:49.274033 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8de97-d1aa-4d01-ba79-7b07aab38be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:49.274311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8de97-d1aa-4d01-ba79-7b07aab38be0 admin admin] PATH_INFO: `/v3/projects/76adee9ec65f48b0b6e582800bc46a62/users/ba7722296ce14931bc49d3c2912e56f0/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:49.289687 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8de97-d1aa-4d01-ba79-7b07aab38be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76adee9ec65f48b0b6e582800bc46a62, user_id=ba7722296ce14931bc49d3c2912e56f0, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:49.292373 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8de97-d1aa-4d01-ba79-7b07aab38be0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:49.305966 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1357/2744] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:49 2022] PUT /identity/v3/projects/76adee9ec65f48b0b6e582800bc46a62/users/ba7722296ce14931bc49d3c2912e56f0/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:49.311573 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9e475-13cb-4264-9d5d-d4f5ebde29b2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:49.311856 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9e475-13cb-4264-9d5d-d4f5ebde29b2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:49.312122 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9e475-13cb-4264-9d5d-d4f5ebde29b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:49.330909 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cdc9e475-13cb-4264-9d5d-d4f5ebde29b2 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:49.332101 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cdc9e475-13cb-4264-9d5d-d4f5ebde29b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:49.391057 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1388/2745] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:49.400871 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8de97-d1aa-4d01-ba79-7b07aab38be0 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:49.403288 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d2d8de97-d1aa-4d01-ba79-7b07aab38be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:49.430255 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:49.469079 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8de97-d1aa-4d01-ba79-7b07aab38be0 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:49.472753 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a674e-95de-4649-8fa1-22a90c3b86fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:49.473385 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a674e-95de-4649-8fa1-22a90c3b86fa service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:49.473666 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a674e-95de-4649-8fa1-22a90c3b86fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:49.473936 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a674e-95de-4649-8fa1-22a90c3b86fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:49.483553 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a674e-95de-4649-8fa1-22a90c3b86fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:49.485017 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a674e-95de-4649-8fa1-22a90c3b86fa service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:49.494695 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1358/2746] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:03:53.558580 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5417e-d397-4b6c-b3ff-d5fe211f8259 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:53.559646 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5417e-d397-4b6c-b3ff-d5fe211f8259 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:53.559827 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5417e-d397-4b6c-b3ff-d5fe211f8259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:53.591680 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-96e5417e-d397-4b6c-b3ff-d5fe211f8259 None None] MFA Rules not processed for user `ba7722296ce14931bc49d3c2912e56f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:53.593011 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-96e5417e-d397-4b6c-b3ff-d5fe211f8259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:53.611655 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:53.669204 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1389/2747] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:53.674125 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a674e-95de-4649-8fa1-22a90c3b86fa service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:53.684158 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a674e-95de-4649-8fa1-22a90c3b86fa service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:53.688782 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f5925-c51e-443b-8766-7898894b2d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:53.689411 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f5925-c51e-443b-8766-7898894b2d9d admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:53.689736 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f5925-c51e-443b-8766-7898894b2d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:53.689965 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f5925-c51e-443b-8766-7898894b2d9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:53.690602 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f5925-c51e-443b-8766-7898894b2d9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:53.692521 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f5925-c51e-443b-8766-7898894b2d9d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:53.723053 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1359/2748] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:03:53 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:53.728753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5417e-d397-4b6c-b3ff-d5fe211f8259 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:53.741950 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5417e-d397-4b6c-b3ff-d5fe211f8259 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:53.827690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ed060-6476-4bc4-ad77-034ba0226029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:53.828346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ed060-6476-4bc4-ad77-034ba0226029 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:53.828653 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ed060-6476-4bc4-ad77-034ba0226029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:53.828842 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ed060-6476-4bc4-ad77-034ba0226029 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:53.829514 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ed060-6476-4bc4-ad77-034ba0226029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:53.831458 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ed060-6476-4bc4-ad77-034ba0226029 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:53.855109 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1390/2749] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:03:53 2022] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:53.859330 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f5925-c51e-443b-8766-7898894b2d9d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:53.870751 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f5925-c51e-443b-8766-7898894b2d9d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:53.875982 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0bdfe-53b9-4f85-b178-36ea5b173c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:53.876630 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0bdfe-53b9-4f85-b178-36ea5b173c1a admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:53.876916 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0bdfe-53b9-4f85-b178-36ea5b173c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:53.877216 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0bdfe-53b9-4f85-b178-36ea5b173c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:53.877863 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0bdfe-53b9-4f85-b178-36ea5b173c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:53.879688 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0bdfe-53b9-4f85-b178-36ea5b173c1a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:53.898010 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1360/2750] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:53.899291 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ed060-6476-4bc4-ad77-034ba0226029 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:53.910578 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ed060-6476-4bc4-ad77-034ba0226029 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:53.915347 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dd1b4-ede8-4a89-8ade-489cd55287c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:53.916010 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dd1b4-ede8-4a89-8ade-489cd55287c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:53.916293 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dd1b4-ede8-4a89-8ade-489cd55287c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:53.916570 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dd1b4-ede8-4a89-8ade-489cd55287c0 admin admin] PATH_INFO: `/v3/projects/cba708a9df6343f2900ac8b455284c3d/users/a0595bd3fb2e47cca0c4df8b7f6edb94/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:53.933440 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dd1b4-ede8-4a89-8ade-489cd55287c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba708a9df6343f2900ac8b455284c3d, user_id=a0595bd3fb2e47cca0c4df8b7f6edb94, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:53.936628 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dd1b4-ede8-4a89-8ade-489cd55287c0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:53.952498 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1391/2751] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:53 2022] PUT /identity/v3/projects/cba708a9df6343f2900ac8b455284c3d/users/a0595bd3fb2e47cca0c4df8b7f6edb94/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:53.956614 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0bdfe-53b9-4f85-b178-36ea5b173c1a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:53.967951 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0bdfe-53b9-4f85-b178-36ea5b173c1a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:54.034776 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc81c00-4410-4b32-9608-6e16a485f1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:54.035609 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc81c00-4410-4b32-9608-6e16a485f1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:54.035609 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc81c00-4410-4b32-9608-6e16a485f1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:54.035870 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc81c00-4410-4b32-9608-6e16a485f1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:54.037081 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc81c00-4410-4b32-9608-6e16a485f1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:54.038455 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc81c00-4410-4b32-9608-6e16a485f1b7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:54.057079 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1361/2752] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:54.061821 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dd1b4-ede8-4a89-8ade-489cd55287c0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:54.073721 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dd1b4-ede8-4a89-8ade-489cd55287c0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:54.080970 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47688f-f602-4e35-b2fd-e4aa6dd28365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:54.081648 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47688f-f602-4e35-b2fd-e4aa6dd28365 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:54.081928 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47688f-f602-4e35-b2fd-e4aa6dd28365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:54.082203 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47688f-f602-4e35-b2fd-e4aa6dd28365 admin admin] PATH_INFO: `/v3/projects/cba708a9df6343f2900ac8b455284c3d/users/a0595bd3fb2e47cca0c4df8b7f6edb94/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:54.084442 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47688f-f602-4e35-b2fd-e4aa6dd28365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba708a9df6343f2900ac8b455284c3d, user_id=a0595bd3fb2e47cca0c4df8b7f6edb94, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:54.087383 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47688f-f602-4e35-b2fd-e4aa6dd28365 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:54.101842 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1392/2753] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:54 2022] PUT /identity/v3/projects/cba708a9df6343f2900ac8b455284c3d/users/a0595bd3fb2e47cca0c4df8b7f6edb94/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:03:58.338896 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c24eae-a8f4-4efd-88f1-73babecb666f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:58.339419 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c24eae-a8f4-4efd-88f1-73babecb666f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:58.339766 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c24eae-a8f4-4efd-88f1-73babecb666f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:58.373195 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-18c24eae-a8f4-4efd-88f1-73babecb666f None None] MFA Rules not processed for user `a0595bd3fb2e47cca0c4df8b7f6edb94`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:58.374505 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-18c24eae-a8f4-4efd-88f1-73babecb666f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:58.452512 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1362/2754] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:03:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:58.465834 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47688f-f602-4e35-b2fd-e4aa6dd28365 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:58.467748 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0a47688f-f602-4e35-b2fd-e4aa6dd28365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:58.537163 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47688f-f602-4e35-b2fd-e4aa6dd28365 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:58.540837 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049823b7-4543-4a05-b783-64dc6b2b0b4e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2920ad41c61b401299ca5ae1714b4031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:58.541477 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049823b7-4543-4a05-b783-64dc6b2b0b4e service glance] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:58.541757 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049823b7-4543-4a05-b783-64dc6b2b0b4e service glance] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:58.542036 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049823b7-4543-4a05-b783-64dc6b2b0b4e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:58.569977 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:58.604264 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049823b7-4543-4a05-b783-64dc6b2b0b4e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:58.606651 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049823b7-4543-4a05-b783-64dc6b2b0b4e service glance] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:58.616838 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1393/2755] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:58.778895 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70aadab-343c-416f-b839-365a937b8a06 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:58.779592 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70aadab-343c-416f-b839-365a937b8a06 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:58.780001 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70aadab-343c-416f-b839-365a937b8a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:58.804813 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d70aadab-343c-416f-b839-365a937b8a06 None None] MFA Rules not processed for user `42dcae7ba3c241eb8d7d0894aadb467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:58.806358 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d70aadab-343c-416f-b839-365a937b8a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:58.813916 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:58.881218 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1363/2756] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Oct 2 01:03:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:58.968829 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049823b7-4543-4a05-b783-64dc6b2b0b4e service glance] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:58.970333 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-049823b7-4543-4a05-b783-64dc6b2b0b4e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:59.079776 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049823b7-4543-4a05-b783-64dc6b2b0b4e service glance] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:59.084848 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e245e4-c604-437e-a500-d776b921ae57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784579d2ddf4cc99fe0e1d109e5cdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:59.085522 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e245e4-c604-437e-a500-d776b921ae57 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:59.085800 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e245e4-c604-437e-a500-d776b921ae57 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:59.086068 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e245e4-c604-437e-a500-d776b921ae57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:59.095400 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e245e4-c604-437e-a500-d776b921ae57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:59.097262 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e245e4-c604-437e-a500-d776b921ae57 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:59.107129 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1394/2757] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Oct 2 01:03:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:04:08.140018 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59e154-2aa6-4ff4-854e-7532c05988f0 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:08.140576 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59e154-2aa6-4ff4-854e-7532c05988f0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:08.140576 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59e154-2aa6-4ff4-854e-7532c05988f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:08.169982 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3a59e154-2aa6-4ff4-854e-7532c05988f0 None None] MFA Rules not processed for user `ba7722296ce14931bc49d3c2912e56f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:08.171188 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3a59e154-2aa6-4ff4-854e-7532c05988f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:08.194758 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1364/2758] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:04:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:09.102617 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=48 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:10.196985 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24fdbb-6823-4dda-843d-6f0561e20f2f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:10.197588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24fdbb-6823-4dda-843d-6f0561e20f2f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:10.197708 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24fdbb-6823-4dda-843d-6f0561e20f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:10.230299 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3f24fdbb-6823-4dda-843d-6f0561e20f2f None None] MFA Rules not processed for user `42dcae7ba3c241eb8d7d0894aadb467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:10.232397 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3f24fdbb-6823-4dda-843d-6f0561e20f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:10.266939 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1395/2759] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Oct 2 01:04:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:10.280521 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59e154-2aa6-4ff4-854e-7532c05988f0 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:10.301153 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59e154-2aa6-4ff4-854e-7532c05988f0 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:10.306642 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf113677-b052-438b-a402-5ddf182fea37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784579d2ddf4cc99fe0e1d109e5cdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:10.307328 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf113677-b052-438b-a402-5ddf182fea37 service swift] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:10.308258 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf113677-b052-438b-a402-5ddf182fea37 service swift] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:10.308724 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf113677-b052-438b-a402-5ddf182fea37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:10.317738 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf113677-b052-438b-a402-5ddf182fea37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:10.319349 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf113677-b052-438b-a402-5ddf182fea37 service swift] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:10.327997 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1365/2760] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Oct 2 01:04:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:04:18.909967 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24fdbb-6823-4dda-843d-6f0561e20f2f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:18.911466 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3f24fdbb-6823-4dda-843d-6f0561e20f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:19.008917 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24fdbb-6823-4dda-843d-6f0561e20f2f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:19.014784 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31799241-75b4-4730-bf31-79ea0bd9835c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78481cceebd4138b893eba7e51c9c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:19.015399 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31799241-75b4-4730-bf31-79ea0bd9835c service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:19.015683 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31799241-75b4-4730-bf31-79ea0bd9835c service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:19.015960 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31799241-75b4-4730-bf31-79ea0bd9835c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:19.017797 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-31799241-75b4-4730-bf31-79ea0bd9835c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:19.031079 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31799241-75b4-4730-bf31-79ea0bd9835c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:19.032682 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31799241-75b4-4730-bf31-79ea0bd9835c service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:19.043633 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1396/2761] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:20.324440 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=44 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:29.039200 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=58 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:34.019713 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf113677-b052-438b-a402-5ddf182fea37 service swift] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:34.021274 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cf113677-b052-438b-a402-5ddf182fea37 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:34.121740 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf113677-b052-438b-a402-5ddf182fea37 service swift] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:34.125778 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e7d1a-c1b3-4bd9-a915-e9e3f077da41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:34.126408 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e7d1a-c1b3-4bd9-a915-e9e3f077da41 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:34.126687 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e7d1a-c1b3-4bd9-a915-e9e3f077da41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:34.126963 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e7d1a-c1b3-4bd9-a915-e9e3f077da41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:34.138638 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e7d1a-c1b3-4bd9-a915-e9e3f077da41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:34.140123 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e7d1a-c1b3-4bd9-a915-e9e3f077da41 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:34.150948 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1366/2762] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:37.061163 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546307b4-e892-4f13-8761-4fe53f7f6e1c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:37.062515 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546307b4-e892-4f13-8761-4fe53f7f6e1c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:37.062515 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546307b4-e892-4f13-8761-4fe53f7f6e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:37.084150 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-546307b4-e892-4f13-8761-4fe53f7f6e1c None None] MFA Rules not processed for user `3fe1c1254c2b4d98942176ce0c0f2502`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:37.086552 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-546307b4-e892-4f13-8761-4fe53f7f6e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:37.189435 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1397/2763] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:04:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:04:44.146066 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=35 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:47.180753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=25 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:55.105161 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e7d1a-c1b3-4bd9-a915-e9e3f077da41 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:55.106837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-be5e7d1a-c1b3-4bd9-a915-e9e3f077da41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:55.217577 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e7d1a-c1b3-4bd9-a915-e9e3f077da41 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:55.222268 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8341ec-cba5-4a92-91eb-a3f7e731acee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:55.222890 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8341ec-cba5-4a92-91eb-a3f7e731acee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:55.223170 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8341ec-cba5-4a92-91eb-a3f7e731acee admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:55.223439 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8341ec-cba5-4a92-91eb-a3f7e731acee admin admin] PATH_INFO: `/v3/users/9d9b96e5011b41fe8a496252e77f4be6` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:55.224548 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8341ec-cba5-4a92-91eb-a3f7e731acee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d9b96e5011b41fe8a496252e77f4be6)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:55.226506 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8341ec-cba5-4a92-91eb-a3f7e731acee admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:55.274667 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ac8341ec-cba5-4a92-91eb-a3f7e731acee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d9b96e5011b41fe8a496252e77f4be6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:55.275339 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ac8341ec-cba5-4a92-91eb-a3f7e731acee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d9b96e5011b41fe8a496252e77f4be6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:55.283179 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ac8341ec-cba5-4a92-91eb-a3f7e731acee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d9b96e5011b41fe8a496252e77f4be6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:55.283858 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ac8341ec-cba5-4a92-91eb-a3f7e731acee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d9b96e5011b41fe8a496252e77f4be6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:55.290993 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ac8341ec-cba5-4a92-91eb-a3f7e731acee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d9b96e5011b41fe8a496252e77f4be6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:55.310013 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1367/2764] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:04:55 2022] DELETE /identity/v3/users/9d9b96e5011b41fe8a496252e77f4be6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:04:55.487372 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546307b4-e892-4f13-8761-4fe53f7f6e1c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:55.504386 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546307b4-e892-4f13-8761-4fe53f7f6e1c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:55.563261 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305e003-a19e-464e-ac50-68330da84f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:55.563891 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305e003-a19e-464e-ac50-68330da84f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:55.564168 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305e003-a19e-464e-ac50-68330da84f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:55.564454 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305e003-a19e-464e-ac50-68330da84f3f admin admin] PATH_INFO: `/v3/projects/a79ddf414b9f4b0aa6a09cd54c747e08` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:55.565563 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305e003-a19e-464e-ac50-68330da84f3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a79ddf414b9f4b0aa6a09cd54c747e08)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:55.567526 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305e003-a19e-464e-ac50-68330da84f3f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:55.614577 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d305e003-a19e-464e-ac50-68330da84f3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'request_id': 'req-d305e003-a19e-464e-ac50-68330da84f3f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:55.621065 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d305e003-a19e-464e-ac50-68330da84f3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'request_id': 'req-d305e003-a19e-464e-ac50-68330da84f3f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:55.628843 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d305e003-a19e-464e-ac50-68330da84f3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a79ddf414b9f4b0aa6a09cd54c747e08', 'request_id': 'req-d305e003-a19e-464e-ac50-68330da84f3f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:55.639540 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d305e003-a19e-464e-ac50-68330da84f3f admin admin] The token cache is being invalidate because project a79ddf414b9f4b0aa6a09cd54c747e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:04:55.639832 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d305e003-a19e-464e-ac50-68330da84f3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:55.640457 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d305e003-a19e-464e-ac50-68330da84f3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:55.642056 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1398/2765] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:55 2022] DELETE /identity/v3/projects/a79ddf414b9f4b0aa6a09cd54c747e08 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:55.646180 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8341ec-cba5-4a92-91eb-a3f7e731acee admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:55.647659 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ac8341ec-cba5-4a92-91eb-a3f7e731acee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:55.661772 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8341ec-cba5-4a92-91eb-a3f7e731acee admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:55.708651 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:55.721227 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c9549-9e8c-4dd6-bcd6-29fe5664c938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:55.721856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c9549-9e8c-4dd6-bcd6-29fe5664c938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:55.722136 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c9549-9e8c-4dd6-bcd6-29fe5664c938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:55.722413 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c9549-9e8c-4dd6-bcd6-29fe5664c938 admin admin] PATH_INFO: `/v3/users/694139f94dd34239ae244dcd83c1e7af` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:55.723568 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c9549-9e8c-4dd6-bcd6-29fe5664c938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=694139f94dd34239ae244dcd83c1e7af)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:55.725532 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c9549-9e8c-4dd6-bcd6-29fe5664c938 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:55.775323 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-105c9549-9e8c-4dd6-bcd6-29fe5664c938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '694139f94dd34239ae244dcd83c1e7af'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:55.776488 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-105c9549-9e8c-4dd6-bcd6-29fe5664c938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '694139f94dd34239ae244dcd83c1e7af'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:55.784015 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-105c9549-9e8c-4dd6-bcd6-29fe5664c938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '694139f94dd34239ae244dcd83c1e7af'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:55.784687 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-105c9549-9e8c-4dd6-bcd6-29fe5664c938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '694139f94dd34239ae244dcd83c1e7af'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:55.792373 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-105c9549-9e8c-4dd6-bcd6-29fe5664c938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '694139f94dd34239ae244dcd83c1e7af'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:55.810001 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1368/2766] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:04:55 2022] DELETE /identity/v3/users/694139f94dd34239ae244dcd83c1e7af => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:55.985984 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305e003-a19e-464e-ac50-68330da84f3f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:55.987512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d305e003-a19e-464e-ac50-68330da84f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:56.001396 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305e003-a19e-464e-ac50-68330da84f3f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:56.072365 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05bcab-97b8-4a0b-a197-e6c3c3569f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:56.073672 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05bcab-97b8-4a0b-a197-e6c3c3569f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:56.074061 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05bcab-97b8-4a0b-a197-e6c3c3569f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:56.074343 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05bcab-97b8-4a0b-a197-e6c3c3569f10 admin admin] PATH_INFO: `/v3/projects/a4845cfa017b4ed6a620414d033e1362` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:56.075495 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05bcab-97b8-4a0b-a197-e6c3c3569f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4845cfa017b4ed6a620414d033e1362)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:56.077610 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05bcab-97b8-4a0b-a197-e6c3c3569f10 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:56.116555 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:56.133053 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc05bcab-97b8-4a0b-a197-e6c3c3569f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4845cfa017b4ed6a620414d033e1362', 'request_id': 'req-bc05bcab-97b8-4a0b-a197-e6c3c3569f10'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:56.141708 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc05bcab-97b8-4a0b-a197-e6c3c3569f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4845cfa017b4ed6a620414d033e1362', 'request_id': 'req-bc05bcab-97b8-4a0b-a197-e6c3c3569f10'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:56.149323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc05bcab-97b8-4a0b-a197-e6c3c3569f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4845cfa017b4ed6a620414d033e1362', 'request_id': 'req-bc05bcab-97b8-4a0b-a197-e6c3c3569f10'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:56.159833 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc05bcab-97b8-4a0b-a197-e6c3c3569f10 admin admin] The token cache is being invalidate because project a4845cfa017b4ed6a620414d033e1362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:04:56.160122 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc05bcab-97b8-4a0b-a197-e6c3c3569f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:56.160750 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc05bcab-97b8-4a0b-a197-e6c3c3569f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:56.162272 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1399/2767] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:55 2022] DELETE /identity/v3/projects/a4845cfa017b4ed6a620414d033e1362 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:05.806393 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=30,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:06.156732 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:40.432091 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c9549-9e8c-4dd6-bcd6-29fe5664c938 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:40.433574 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-105c9549-9e8c-4dd6-bcd6-29fe5664c938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:40.447732 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c9549-9e8c-4dd6-bcd6-29fe5664c938 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:40.512206 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53540e78-e046-4d1f-aa04-b39cb15ecede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:40.512852 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53540e78-e046-4d1f-aa04-b39cb15ecede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:40.513286 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53540e78-e046-4d1f-aa04-b39cb15ecede admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:40.513558 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53540e78-e046-4d1f-aa04-b39cb15ecede admin admin] PATH_INFO: `/v3/users/3fe1c1254c2b4d98942176ce0c0f2502` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:40.514807 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53540e78-e046-4d1f-aa04-b39cb15ecede admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe1c1254c2b4d98942176ce0c0f2502)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:40.516852 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53540e78-e046-4d1f-aa04-b39cb15ecede admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:40.568100 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-53540e78-e046-4d1f-aa04-b39cb15ecede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe1c1254c2b4d98942176ce0c0f2502'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:40.568743 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-53540e78-e046-4d1f-aa04-b39cb15ecede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe1c1254c2b4d98942176ce0c0f2502'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:40.576285 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-53540e78-e046-4d1f-aa04-b39cb15ecede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe1c1254c2b4d98942176ce0c0f2502'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:40.577001 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-53540e78-e046-4d1f-aa04-b39cb15ecede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe1c1254c2b4d98942176ce0c0f2502'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:40.583951 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-53540e78-e046-4d1f-aa04-b39cb15ecede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe1c1254c2b4d98942176ce0c0f2502'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:40.601809 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1369/2768] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:05:40 2022] DELETE /identity/v3/users/3fe1c1254c2b4d98942176ce0c0f2502 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:40.776743 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05bcab-97b8-4a0b-a197-e6c3c3569f10 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:40.778320 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bc05bcab-97b8-4a0b-a197-e6c3c3569f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:40.792439 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05bcab-97b8-4a0b-a197-e6c3c3569f10 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:40.855738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba1d66-0230-41c3-ae82-4bacf6c662f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:40.856373 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba1d66-0230-41c3-ae82-4bacf6c662f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:40.856654 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba1d66-0230-41c3-ae82-4bacf6c662f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:40.857368 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba1d66-0230-41c3-ae82-4bacf6c662f6 admin admin] PATH_INFO: `/v3/projects/3b55505c96e44c6790ae56842ac5269a` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:40.858551 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba1d66-0230-41c3-ae82-4bacf6c662f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b55505c96e44c6790ae56842ac5269a)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:40.860474 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba1d66-0230-41c3-ae82-4bacf6c662f6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:40.910029 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6ba1d66-0230-41c3-ae82-4bacf6c662f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b55505c96e44c6790ae56842ac5269a', 'request_id': 'req-b6ba1d66-0230-41c3-ae82-4bacf6c662f6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:40.916270 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6ba1d66-0230-41c3-ae82-4bacf6c662f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b55505c96e44c6790ae56842ac5269a', 'request_id': 'req-b6ba1d66-0230-41c3-ae82-4bacf6c662f6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:40.923935 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6ba1d66-0230-41c3-ae82-4bacf6c662f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b55505c96e44c6790ae56842ac5269a', 'request_id': 'req-b6ba1d66-0230-41c3-ae82-4bacf6c662f6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:40.934879 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6ba1d66-0230-41c3-ae82-4bacf6c662f6 admin admin] The token cache is being invalidate because project 3b55505c96e44c6790ae56842ac5269a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:05:40.935235 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6ba1d66-0230-41c3-ae82-4bacf6c662f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:40.936056 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6ba1d66-0230-41c3-ae82-4bacf6c662f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:40.937581 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1400/2769] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:40 2022] DELETE /identity/v3/projects/3b55505c96e44c6790ae56842ac5269a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:40.943006 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2fe98-b790-4084-8579-789108c11bbd None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:40.943277 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2fe98-b790-4084-8579-789108c11bbd None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:40.943551 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2fe98-b790-4084-8579-789108c11bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:41.002537 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-59e2fe98-b790-4084-8579-789108c11bbd None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:41.003667 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-59e2fe98-b790-4084-8579-789108c11bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:41.047992 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:41.065489 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1370/2770] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:41.073427 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8110bb-92f4-41bc-b13e-69a5b64b99b8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:41.073718 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8110bb-92f4-41bc-b13e-69a5b64b99b8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:41.073996 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8110bb-92f4-41bc-b13e-69a5b64b99b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:41.094113 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-df8110bb-92f4-41bc-b13e-69a5b64b99b8 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:41.095332 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-df8110bb-92f4-41bc-b13e-69a5b64b99b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:41.103249 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1401/2771] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:41.107464 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2fe98-b790-4084-8579-789108c11bbd None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:41.117540 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2fe98-b790-4084-8579-789108c11bbd None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:41.122256 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa816915-33de-4326-89fa-9a6a9b340725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:41.123528 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa816915-33de-4326-89fa-9a6a9b340725 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:41.123812 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa816915-33de-4326-89fa-9a6a9b340725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:41.124091 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa816915-33de-4326-89fa-9a6a9b340725 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:41.124732 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa816915-33de-4326-89fa-9a6a9b340725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:05:41.125077 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa816915-33de-4326-89fa-9a6a9b340725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:41.126722 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa816915-33de-4326-89fa-9a6a9b340725 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:41.140731 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1371/2772] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:05:41.145724 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8110bb-92f4-41bc-b13e-69a5b64b99b8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:41.155660 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8110bb-92f4-41bc-b13e-69a5b64b99b8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:41.160268 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722041d-2806-4833-838e-61cfab2d52e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:41.160861 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722041d-2806-4833-838e-61cfab2d52e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:41.161193 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722041d-2806-4833-838e-61cfab2d52e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:41.161463 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722041d-2806-4833-838e-61cfab2d52e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:41.162083 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722041d-2806-4833-838e-61cfab2d52e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:41.163974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722041d-2806-4833-838e-61cfab2d52e9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:41.191453 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1402/2773] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:05:41 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:05:41.195631 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa816915-33de-4326-89fa-9a6a9b340725 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:41.206281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa816915-33de-4326-89fa-9a6a9b340725 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:41.264011 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e92596-1296-41ce-a201-39ae812eb66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:41.264533 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e92596-1296-41ce-a201-39ae812eb66c admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:41.264816 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e92596-1296-41ce-a201-39ae812eb66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:41.265127 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e92596-1296-41ce-a201-39ae812eb66c admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:41.265752 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e92596-1296-41ce-a201-39ae812eb66c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:41.267701 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e92596-1296-41ce-a201-39ae812eb66c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:41.289012 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1372/2774] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:05:41 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:05:41.293183 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722041d-2806-4833-838e-61cfab2d52e9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:41.303620 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722041d-2806-4833-838e-61cfab2d52e9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:41.308200 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355f8b8-8837-452e-88d1-df40a874d013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:41.308794 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355f8b8-8837-452e-88d1-df40a874d013 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:41.309117 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355f8b8-8837-452e-88d1-df40a874d013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:41.309387 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355f8b8-8837-452e-88d1-df40a874d013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:41.310650 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355f8b8-8837-452e-88d1-df40a874d013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:41.312363 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355f8b8-8837-452e-88d1-df40a874d013 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:41.323069 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1403/2775] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:05:41.328468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e92596-1296-41ce-a201-39ae812eb66c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:41.338817 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e92596-1296-41ce-a201-39ae812eb66c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:41.343645 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910283ac-4571-40a2-bc1e-fc9606fb644f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:41.344374 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910283ac-4571-40a2-bc1e-fc9606fb644f admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:41.344655 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910283ac-4571-40a2-bc1e-fc9606fb644f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:41.344924 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910283ac-4571-40a2-bc1e-fc9606fb644f admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:41.345593 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910283ac-4571-40a2-bc1e-fc9606fb644f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:41.347266 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910283ac-4571-40a2-bc1e-fc9606fb644f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:41.359274 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1373/2776] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:05:41.363815 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355f8b8-8837-452e-88d1-df40a874d013 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:41.374994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355f8b8-8837-452e-88d1-df40a874d013 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:41.379800 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9f263-ab16-42aa-96d6-b2231858f2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:41.380464 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9f263-ab16-42aa-96d6-b2231858f2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:41.380742 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9f263-ab16-42aa-96d6-b2231858f2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:41.381040 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9f263-ab16-42aa-96d6-b2231858f2d6 admin admin] PATH_INFO: `/v3/projects/a409758dec004af8a4bde7a72a2bdd45/users/1feb47f53492458cb66f9cc8018b1464/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:41.396390 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9f263-ab16-42aa-96d6-b2231858f2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a409758dec004af8a4bde7a72a2bdd45, user_id=1feb47f53492458cb66f9cc8018b1464, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:41.399076 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9f263-ab16-42aa-96d6-b2231858f2d6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:41.413097 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1404/2777] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:05:41 2022] PUT /identity/v3/projects/a409758dec004af8a4bde7a72a2bdd45/users/1feb47f53492458cb66f9cc8018b1464/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:41.425146 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7a7de-ebb2-4722-ae04-4d4eede67d8a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:41.425441 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7a7de-ebb2-4722-ae04-4d4eede67d8a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:41.425719 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7a7de-ebb2-4722-ae04-4d4eede67d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:41.456141 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-62b7a7de-ebb2-4722-ae04-4d4eede67d8a None None] MFA Rules not processed for user `1feb47f53492458cb66f9cc8018b1464`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:41.457405 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-62b7a7de-ebb2-4722-ae04-4d4eede67d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:41.522703 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1374/2778] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:05:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:41.527187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9f263-ab16-42aa-96d6-b2231858f2d6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:41.557270 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:41.590956 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9f263-ab16-42aa-96d6-b2231858f2d6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:41.595734 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b9a0d-f387-47cd-9afa-33df306493b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:41.596330 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b9a0d-f387-47cd-9afa-33df306493b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:41.596606 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b9a0d-f387-47cd-9afa-33df306493b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:41.596876 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b9a0d-f387-47cd-9afa-33df306493b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:41.597530 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b9a0d-f387-47cd-9afa-33df306493b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:41.599423 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b9a0d-f387-47cd-9afa-33df306493b0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:41.626956 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1405/2779] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:05:41 2022] POST /identity/v3/projects => generated 363 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:05:41.631131 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7a7de-ebb2-4722-ae04-4d4eede67d8a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:41.642296 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7a7de-ebb2-4722-ae04-4d4eede67d8a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:41.684165 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:41.701239 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58387cee-4759-4cff-815a-dc72e611a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:41.701852 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58387cee-4759-4cff-815a-dc72e611a848 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:41.702139 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58387cee-4759-4cff-815a-dc72e611a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:41.702414 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58387cee-4759-4cff-815a-dc72e611a848 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:41.703040 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58387cee-4759-4cff-815a-dc72e611a848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:41.704992 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58387cee-4759-4cff-815a-dc72e611a848 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:41.726330 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1375/2780] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:05:41 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:05:41.730984 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b9a0d-f387-47cd-9afa-33df306493b0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:41.743447 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b9a0d-f387-47cd-9afa-33df306493b0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:41.749211 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913b160-64bf-4880-869c-605bc82e3000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:41.749928 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913b160-64bf-4880-869c-605bc82e3000 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:41.750214 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913b160-64bf-4880-869c-605bc82e3000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:41.750487 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913b160-64bf-4880-869c-605bc82e3000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:41.751170 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913b160-64bf-4880-869c-605bc82e3000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:41.752775 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913b160-64bf-4880-869c-605bc82e3000 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:41.763743 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1406/2781] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:05:41.768809 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58387cee-4759-4cff-815a-dc72e611a848 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:41.779596 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58387cee-4759-4cff-815a-dc72e611a848 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:41.784101 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30376c-e066-4043-bb8f-5626e878abe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:41.784748 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30376c-e066-4043-bb8f-5626e878abe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:41.785062 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30376c-e066-4043-bb8f-5626e878abe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:41.785336 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30376c-e066-4043-bb8f-5626e878abe4 admin admin] PATH_INFO: `/v3/projects/8e5acd95ce10452cb4f7e4abfbfe550c/users/6d414730ee2640e49606ac3ddf0f1d82/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:41.801047 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30376c-e066-4043-bb8f-5626e878abe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5acd95ce10452cb4f7e4abfbfe550c, user_id=6d414730ee2640e49606ac3ddf0f1d82, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:41.803710 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30376c-e066-4043-bb8f-5626e878abe4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:41.816545 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1376/2782] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:05:41 2022] PUT /identity/v3/projects/8e5acd95ce10452cb4f7e4abfbfe550c/users/6d414730ee2640e49606ac3ddf0f1d82/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:41.820549 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913b160-64bf-4880-869c-605bc82e3000 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:41.830974 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913b160-64bf-4880-869c-605bc82e3000 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:41.888017 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8f30e-4d97-4ebb-91b4-ef7801d53ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:41.889294 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8f30e-4d97-4ebb-91b4-ef7801d53ffe admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:41.889601 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8f30e-4d97-4ebb-91b4-ef7801d53ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:41.889878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8f30e-4d97-4ebb-91b4-ef7801d53ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:41.890562 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8f30e-4d97-4ebb-91b4-ef7801d53ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:41.892160 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8f30e-4d97-4ebb-91b4-ef7801d53ffe admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:41.901979 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1407/2783] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:05:41.906137 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30376c-e066-4043-bb8f-5626e878abe4 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:41.916289 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30376c-e066-4043-bb8f-5626e878abe4 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:41.921873 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10608fa-24c0-4292-b6dd-ac809aa01538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:41.922517 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10608fa-24c0-4292-b6dd-ac809aa01538 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:41.922800 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10608fa-24c0-4292-b6dd-ac809aa01538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:41.923075 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10608fa-24c0-4292-b6dd-ac809aa01538 admin admin] PATH_INFO: `/v3/projects/8e5acd95ce10452cb4f7e4abfbfe550c/users/6d414730ee2640e49606ac3ddf0f1d82/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:41.924998 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10608fa-24c0-4292-b6dd-ac809aa01538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5acd95ce10452cb4f7e4abfbfe550c, user_id=6d414730ee2640e49606ac3ddf0f1d82, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:41.927653 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10608fa-24c0-4292-b6dd-ac809aa01538 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:41.938878 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1377/2784] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:05:41 2022] PUT /identity/v3/projects/8e5acd95ce10452cb4f7e4abfbfe550c/users/6d414730ee2640e49606ac3ddf0f1d82/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:41.949344 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381695c-b521-4fd9-82bb-380480b75c8c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:41.949640 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381695c-b521-4fd9-82bb-380480b75c8c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:41.949904 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381695c-b521-4fd9-82bb-380480b75c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:41.979411 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2381695c-b521-4fd9-82bb-380480b75c8c None None] MFA Rules not processed for user `6d414730ee2640e49606ac3ddf0f1d82`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:41.980621 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2381695c-b521-4fd9-82bb-380480b75c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:42.052076 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1408/2785] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:05:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:42.064343 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10608fa-24c0-4292-b6dd-ac809aa01538 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:42.066243 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c10608fa-24c0-4292-b6dd-ac809aa01538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:42.152481 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10608fa-24c0-4292-b6dd-ac809aa01538 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:42.156748 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab96e8a-1414-4d11-9079-ee603534e411 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:42.159743 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab96e8a-1414-4d11-9079-ee603534e411 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:42.162214 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab96e8a-1414-4d11-9079-ee603534e411 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:42.162491 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab96e8a-1414-4d11-9079-ee603534e411 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:42.174997 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab96e8a-1414-4d11-9079-ee603534e411 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:42.176447 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab96e8a-1414-4d11-9079-ee603534e411 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:42.186988 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1378/2786] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:05:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:05:42.264613 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381695c-b521-4fd9-82bb-380480b75c8c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:42.276224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381695c-b521-4fd9-82bb-380480b75c8c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:42.279895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9d3da-6930-459a-b8f9-9cfe141af41a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:42.280494 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9d3da-6930-459a-b8f9-9cfe141af41a service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:42.280808 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9d3da-6930-459a-b8f9-9cfe141af41a service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:42.281118 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9d3da-6930-459a-b8f9-9cfe141af41a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:42.300588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:42.338875 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9d3da-6930-459a-b8f9-9cfe141af41a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:42.340234 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9d3da-6930-459a-b8f9-9cfe141af41a service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:42.349142 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1409/2787] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:05:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:05:49.422023 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab96e8a-1414-4d11-9079-ee603534e411 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:49.487508 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab96e8a-1414-4d11-9079-ee603534e411 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:49.492390 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af650f-a423-494e-b5e0-94a07c974bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:49.493188 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af650f-a423-494e-b5e0-94a07c974bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:49.493309 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af650f-a423-494e-b5e0-94a07c974bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:49.493582 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af650f-a423-494e-b5e0-94a07c974bbd admin admin] PATH_INFO: `/v3/users/1feb47f53492458cb66f9cc8018b1464` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:49.494776 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af650f-a423-494e-b5e0-94a07c974bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1feb47f53492458cb66f9cc8018b1464)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:49.496868 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af650f-a423-494e-b5e0-94a07c974bbd admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:49.527693 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:49.563677 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-68af650f-a423-494e-b5e0-94a07c974bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1feb47f53492458cb66f9cc8018b1464'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:49.564741 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-68af650f-a423-494e-b5e0-94a07c974bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1feb47f53492458cb66f9cc8018b1464'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:49.574981 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-68af650f-a423-494e-b5e0-94a07c974bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1feb47f53492458cb66f9cc8018b1464'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:49.584085 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-68af650f-a423-494e-b5e0-94a07c974bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1feb47f53492458cb66f9cc8018b1464'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:49.594718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-68af650f-a423-494e-b5e0-94a07c974bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1feb47f53492458cb66f9cc8018b1464'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:49.620203 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1379/2788] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:05:49 2022] DELETE /identity/v3/users/1feb47f53492458cb66f9cc8018b1464 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:49.624782 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a6608-e275-4ad3-8dbd-6bce74cb0d3e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:49.625417 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a6608-e275-4ad3-8dbd-6bce74cb0d3e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:49.625525 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a6608-e275-4ad3-8dbd-6bce74cb0d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:49.646647 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f75a6608-e275-4ad3-8dbd-6bce74cb0d3e None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:49.647896 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f75a6608-e275-4ad3-8dbd-6bce74cb0d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:49.734435 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1410/2789] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:49.758168 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af650f-a423-494e-b5e0-94a07c974bbd admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:49.760081 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-68af650f-a423-494e-b5e0-94a07c974bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:49.873717 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af650f-a423-494e-b5e0-94a07c974bbd admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:49.880226 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d67e3-6bf1-4cac-804d-a57a079bb514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:49.881864 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d67e3-6bf1-4cac-804d-a57a079bb514 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:49.882387 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d67e3-6bf1-4cac-804d-a57a079bb514 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:49.883406 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d67e3-6bf1-4cac-804d-a57a079bb514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:49.897996 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d67e3-6bf1-4cac-804d-a57a079bb514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:49.899858 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d67e3-6bf1-4cac-804d-a57a079bb514 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:49.913458 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1380/2790] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:05:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:05:50.824455 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a6608-e275-4ad3-8dbd-6bce74cb0d3e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:50.826681 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f75a6608-e275-4ad3-8dbd-6bce74cb0d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:50.839149 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a6608-e275-4ad3-8dbd-6bce74cb0d3e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:50.856696 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce21ce-6dee-41ac-844b-8e37d41c81f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:50.858195 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce21ce-6dee-41ac-844b-8e37d41c81f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:50.859016 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce21ce-6dee-41ac-844b-8e37d41c81f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:50.859345 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce21ce-6dee-41ac-844b-8e37d41c81f8 admin admin] PATH_INFO: `/v3/projects/a409758dec004af8a4bde7a72a2bdd45` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:50.860968 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce21ce-6dee-41ac-844b-8e37d41c81f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a409758dec004af8a4bde7a72a2bdd45)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:50.864179 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce21ce-6dee-41ac-844b-8e37d41c81f8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:50.916187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-83ce21ce-6dee-41ac-844b-8e37d41c81f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a409758dec004af8a4bde7a72a2bdd45', 'request_id': 'req-83ce21ce-6dee-41ac-844b-8e37d41c81f8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:50.924416 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-83ce21ce-6dee-41ac-844b-8e37d41c81f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a409758dec004af8a4bde7a72a2bdd45', 'request_id': 'req-83ce21ce-6dee-41ac-844b-8e37d41c81f8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:50.933878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-83ce21ce-6dee-41ac-844b-8e37d41c81f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a409758dec004af8a4bde7a72a2bdd45', 'request_id': 'req-83ce21ce-6dee-41ac-844b-8e37d41c81f8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:50.945968 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-83ce21ce-6dee-41ac-844b-8e37d41c81f8 admin admin] The token cache is being invalidate because project a409758dec004af8a4bde7a72a2bdd45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:05:50.946187 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-83ce21ce-6dee-41ac-844b-8e37d41c81f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:50.946835 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-83ce21ce-6dee-41ac-844b-8e37d41c81f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:50.948625 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1411/2791] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:50 2022] DELETE /identity/v3/projects/a409758dec004af8a4bde7a72a2bdd45 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:50.952856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d67e3-6bf1-4cac-804d-a57a079bb514 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:50.962874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d67e3-6bf1-4cac-804d-a57a079bb514 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:51.037048 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c38b67-4591-437f-997d-6cd4f427e703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:51.037702 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c38b67-4591-437f-997d-6cd4f427e703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:51.037979 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c38b67-4591-437f-997d-6cd4f427e703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:51.038251 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c38b67-4591-437f-997d-6cd4f427e703 admin admin] PATH_INFO: `/v3/users/6d414730ee2640e49606ac3ddf0f1d82` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:51.039445 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c38b67-4591-437f-997d-6cd4f427e703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d414730ee2640e49606ac3ddf0f1d82)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:51.042495 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c38b67-4591-437f-997d-6cd4f427e703 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:51.100147 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:51.103636 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-26c38b67-4591-437f-997d-6cd4f427e703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d414730ee2640e49606ac3ddf0f1d82'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:51.105908 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-26c38b67-4591-437f-997d-6cd4f427e703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d414730ee2640e49606ac3ddf0f1d82'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:51.119523 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-26c38b67-4591-437f-997d-6cd4f427e703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d414730ee2640e49606ac3ddf0f1d82'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:51.120715 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-26c38b67-4591-437f-997d-6cd4f427e703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d414730ee2640e49606ac3ddf0f1d82'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:51.134176 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-26c38b67-4591-437f-997d-6cd4f427e703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d414730ee2640e49606ac3ddf0f1d82'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:51.160374 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1381/2792] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:05:50 2022] DELETE /identity/v3/users/6d414730ee2640e49606ac3ddf0f1d82 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:51.516076 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce21ce-6dee-41ac-844b-8e37d41c81f8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:51.517726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-83ce21ce-6dee-41ac-844b-8e37d41c81f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:51.533165 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce21ce-6dee-41ac-844b-8e37d41c81f8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:51.581351 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:51.602092 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a88a8-69ba-4929-a1f7-19acaf48ac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:51.602745 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a88a8-69ba-4929-a1f7-19acaf48ac3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:51.603022 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a88a8-69ba-4929-a1f7-19acaf48ac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:51.603344 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a88a8-69ba-4929-a1f7-19acaf48ac3b admin admin] PATH_INFO: `/v3/projects/8e5acd95ce10452cb4f7e4abfbfe550c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:51.604476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a88a8-69ba-4929-a1f7-19acaf48ac3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5acd95ce10452cb4f7e4abfbfe550c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:51.606485 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a88a8-69ba-4929-a1f7-19acaf48ac3b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:51.676239 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-598a88a8-69ba-4929-a1f7-19acaf48ac3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5acd95ce10452cb4f7e4abfbfe550c', 'request_id': 'req-598a88a8-69ba-4929-a1f7-19acaf48ac3b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:51.689433 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-598a88a8-69ba-4929-a1f7-19acaf48ac3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5acd95ce10452cb4f7e4abfbfe550c', 'request_id': 'req-598a88a8-69ba-4929-a1f7-19acaf48ac3b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:51.697910 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-598a88a8-69ba-4929-a1f7-19acaf48ac3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5acd95ce10452cb4f7e4abfbfe550c', 'request_id': 'req-598a88a8-69ba-4929-a1f7-19acaf48ac3b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:51.709830 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-598a88a8-69ba-4929-a1f7-19acaf48ac3b admin admin] The token cache is being invalidate because project 8e5acd95ce10452cb4f7e4abfbfe550c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:05:51.710137 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-598a88a8-69ba-4929-a1f7-19acaf48ac3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:51.711042 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-598a88a8-69ba-4929-a1f7-19acaf48ac3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:51.713386 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1412/2793] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:51 2022] DELETE /identity/v3/projects/8e5acd95ce10452cb4f7e4abfbfe550c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:51.720040 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c00a0-a7b9-43e6-918d-1f3010fd543a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:51.720040 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c00a0-a7b9-43e6-918d-1f3010fd543a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:51.720535 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c00a0-a7b9-43e6-918d-1f3010fd543a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:51.756801 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-249c00a0-a7b9-43e6-918d-1f3010fd543a None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:51.759010 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-249c00a0-a7b9-43e6-918d-1f3010fd543a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:51.846098 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1382/2794] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:51.847833 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131fd5c-ce71-4932-8d66-8a6866b4be8e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:51.848297 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131fd5c-ce71-4932-8d66-8a6866b4be8e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:51.849216 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131fd5c-ce71-4932-8d66-8a6866b4be8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:51.874825 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d131fd5c-ce71-4932-8d66-8a6866b4be8e None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:51.876504 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d131fd5c-ce71-4932-8d66-8a6866b4be8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:51.885243 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1413/2795] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:05:51.890619 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c00a0-a7b9-43e6-918d-1f3010fd543a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:51.903667 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c00a0-a7b9-43e6-918d-1f3010fd543a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:51.909507 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a07449-605c-4b4a-ada3-084b3c8e6b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:51.910686 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a07449-605c-4b4a-ada3-084b3c8e6b45 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:51.911271 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a07449-605c-4b4a-ada3-084b3c8e6b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:51.911904 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a07449-605c-4b4a-ada3-084b3c8e6b45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:51.912887 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a07449-605c-4b4a-ada3-084b3c8e6b45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:05:51.913475 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a07449-605c-4b4a-ada3-084b3c8e6b45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:51.916276 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a07449-605c-4b4a-ada3-084b3c8e6b45 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:51.932549 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1383/2796] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:05:51.939937 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131fd5c-ce71-4932-8d66-8a6866b4be8e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:51.951413 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131fd5c-ce71-4932-8d66-8a6866b4be8e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:51.956183 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5454b-5640-4b89-97df-211092051494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:51.956794 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5454b-5640-4b89-97df-211092051494 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:51.957113 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5454b-5640-4b89-97df-211092051494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:51.957387 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5454b-5640-4b89-97df-211092051494 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:51.958021 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5454b-5640-4b89-97df-211092051494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:51.960010 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5454b-5640-4b89-97df-211092051494 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:51.993029 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1414/2797] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:05:51 2022] POST /identity/v3/projects => generated 401 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:05:51.994986 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a07449-605c-4b4a-ada3-084b3c8e6b45 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:52.006422 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a07449-605c-4b4a-ada3-084b3c8e6b45 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:52.068067 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581a559-dcd4-4a41-a88f-6f47451f6f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:52.068695 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581a559-dcd4-4a41-a88f-6f47451f6f4d admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.069003 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581a559-dcd4-4a41-a88f-6f47451f6f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.069280 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581a559-dcd4-4a41-a88f-6f47451f6f4d admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.069918 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581a559-dcd4-4a41-a88f-6f47451f6f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:52.071854 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581a559-dcd4-4a41-a88f-6f47451f6f4d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:52.094789 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1384/2798] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:05:51 2022] POST /identity/v3/users => generated 301 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:05:52.099050 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5454b-5640-4b89-97df-211092051494 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:52.110410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5454b-5640-4b89-97df-211092051494 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:52.115409 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bebac-8bbc-4eb7-9a87-50ff4cb59187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:52.116011 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bebac-8bbc-4eb7-9a87-50ff4cb59187 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.116470 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bebac-8bbc-4eb7-9a87-50ff4cb59187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.116733 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bebac-8bbc-4eb7-9a87-50ff4cb59187 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.117441 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bebac-8bbc-4eb7-9a87-50ff4cb59187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:52.119042 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bebac-8bbc-4eb7-9a87-50ff4cb59187 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:52.129943 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1415/2799] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:05:52.134172 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581a559-dcd4-4a41-a88f-6f47451f6f4d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:52.146207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581a559-dcd4-4a41-a88f-6f47451f6f4d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:52.151256 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5da8fe-7223-40d8-8f5e-480a023f0888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:52.151855 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5da8fe-7223-40d8-8f5e-480a023f0888 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.152144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5da8fe-7223-40d8-8f5e-480a023f0888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.152418 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5da8fe-7223-40d8-8f5e-480a023f0888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.153091 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5da8fe-7223-40d8-8f5e-480a023f0888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:52.154773 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5da8fe-7223-40d8-8f5e-480a023f0888 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:52.166289 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1385/2800] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:05:52.171063 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bebac-8bbc-4eb7-9a87-50ff4cb59187 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:52.181716 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bebac-8bbc-4eb7-9a87-50ff4cb59187 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:52.188233 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b8813-2924-4ba8-903f-a929fd1f9c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:52.189074 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b8813-2924-4ba8-903f-a929fd1f9c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.189426 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b8813-2924-4ba8-903f-a929fd1f9c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.189818 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b8813-2924-4ba8-903f-a929fd1f9c17 admin admin] PATH_INFO: `/v3/projects/bf3b9d8b4d344753a8dda155c1cf44b6/users/02528df470d94dc8a344fe21208adc32/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.208299 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b8813-2924-4ba8-903f-a929fd1f9c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3b9d8b4d344753a8dda155c1cf44b6, user_id=02528df470d94dc8a344fe21208adc32, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:52.211041 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b8813-2924-4ba8-903f-a929fd1f9c17 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:52.224918 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1416/2801] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:05:52 2022] PUT /identity/v3/projects/bf3b9d8b4d344753a8dda155c1cf44b6/users/02528df470d94dc8a344fe21208adc32/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:05:52.237604 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b02ee3-bb2a-46c9-b042-b4171828582e None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.237890 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b02ee3-bb2a-46c9-b042-b4171828582e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.238167 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b02ee3-bb2a-46c9-b042-b4171828582e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.267395 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e6b02ee3-bb2a-46c9-b042-b4171828582e None None] MFA Rules not processed for user `02528df470d94dc8a344fe21208adc32`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:52.268619 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e6b02ee3-bb2a-46c9-b042-b4171828582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:52.282233 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:52.338287 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1386/2802] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:05:52 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:05:52.344034 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b8813-2924-4ba8-903f-a929fd1f9c17 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:52.411207 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b8813-2924-4ba8-903f-a929fd1f9c17 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:52.417377 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cbce6-411d-4f15-9531-5e5357ac7ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:52.417989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cbce6-411d-4f15-9531-5e5357ac7ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.418272 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cbce6-411d-4f15-9531-5e5357ac7ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.418547 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cbce6-411d-4f15-9531-5e5357ac7ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.419879 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cbce6-411d-4f15-9531-5e5357ac7ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:52.422007 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cbce6-411d-4f15-9531-5e5357ac7ab3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:52.438522 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:52.457271 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1417/2803] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:05:52 2022] POST /identity/v3/projects => generated 401 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:05:52.460038 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b02ee3-bb2a-46c9-b042-b4171828582e None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:52.471600 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b02ee3-bb2a-46c9-b042-b4171828582e None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:52.541760 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59234e6e-2013-470d-91d8-0300e46fec16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:52.542411 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59234e6e-2013-470d-91d8-0300e46fec16 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.542693 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59234e6e-2013-470d-91d8-0300e46fec16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.542968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59234e6e-2013-470d-91d8-0300e46fec16 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.543601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59234e6e-2013-470d-91d8-0300e46fec16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:52.546155 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59234e6e-2013-470d-91d8-0300e46fec16 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:52.568712 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1387/2804] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:05:52 2022] POST /identity/v3/users => generated 307 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:05:52.573451 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cbce6-411d-4f15-9531-5e5357ac7ab3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:52.584887 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cbce6-411d-4f15-9531-5e5357ac7ab3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:52.590005 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5085bd-580b-44ff-9777-95d8bcf61593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:52.590697 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5085bd-580b-44ff-9777-95d8bcf61593 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.591586 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5085bd-580b-44ff-9777-95d8bcf61593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.592075 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5085bd-580b-44ff-9777-95d8bcf61593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.592881 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5085bd-580b-44ff-9777-95d8bcf61593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:52.594598 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5085bd-580b-44ff-9777-95d8bcf61593 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:52.607338 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1418/2805] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:05:52.611719 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59234e6e-2013-470d-91d8-0300e46fec16 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:52.622105 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59234e6e-2013-470d-91d8-0300e46fec16 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:52.627147 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05034f-4077-43dd-9c33-097bcede25ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:52.627804 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05034f-4077-43dd-9c33-097bcede25ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.628529 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05034f-4077-43dd-9c33-097bcede25ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.628816 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05034f-4077-43dd-9c33-097bcede25ea admin admin] PATH_INFO: `/v3/projects/12c80fa4b3844b04b661f7dbac2656c9/users/4887197bc9214789bc38f682f9999e6d/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.644488 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05034f-4077-43dd-9c33-097bcede25ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c80fa4b3844b04b661f7dbac2656c9, user_id=4887197bc9214789bc38f682f9999e6d, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:52.647392 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05034f-4077-43dd-9c33-097bcede25ea admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:52.663223 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1388/2806] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:05:52 2022] PUT /identity/v3/projects/12c80fa4b3844b04b661f7dbac2656c9/users/4887197bc9214789bc38f682f9999e6d/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:52.667485 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5085bd-580b-44ff-9777-95d8bcf61593 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:52.677678 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5085bd-580b-44ff-9777-95d8bcf61593 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:52.739449 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bae19a-d73c-4986-84e3-eef3d96bff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:52.740014 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bae19a-d73c-4986-84e3-eef3d96bff20 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.740578 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bae19a-d73c-4986-84e3-eef3d96bff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.740958 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bae19a-d73c-4986-84e3-eef3d96bff20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.741692 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bae19a-d73c-4986-84e3-eef3d96bff20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:52.743620 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bae19a-d73c-4986-84e3-eef3d96bff20 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:52.754199 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1419/2807] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:05:52.758657 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05034f-4077-43dd-9c33-097bcede25ea admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:52.769704 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05034f-4077-43dd-9c33-097bcede25ea admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:52.774332 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57731a2-d022-4b75-93f0-18c4db1ee1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:52.774978 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57731a2-d022-4b75-93f0-18c4db1ee1df admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.775254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57731a2-d022-4b75-93f0-18c4db1ee1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.775519 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57731a2-d022-4b75-93f0-18c4db1ee1df admin admin] PATH_INFO: `/v3/projects/12c80fa4b3844b04b661f7dbac2656c9/users/4887197bc9214789bc38f682f9999e6d/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.777426 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57731a2-d022-4b75-93f0-18c4db1ee1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c80fa4b3844b04b661f7dbac2656c9, user_id=4887197bc9214789bc38f682f9999e6d, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:52.780909 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57731a2-d022-4b75-93f0-18c4db1ee1df admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:52.791509 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1389/2808] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:05:52 2022] PUT /identity/v3/projects/12c80fa4b3844b04b661f7dbac2656c9/users/4887197bc9214789bc38f682f9999e6d/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:52.801960 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e35a08-ddfc-4221-b833-fb6433b44f02 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.802231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e35a08-ddfc-4221-b833-fb6433b44f02 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.802524 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e35a08-ddfc-4221-b833-fb6433b44f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.832467 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c0e35a08-ddfc-4221-b833-fb6433b44f02 None None] MFA Rules not processed for user `4887197bc9214789bc38f682f9999e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:52.833726 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c0e35a08-ddfc-4221-b833-fb6433b44f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:52.902175 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1420/2809] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:05:52 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:52.914058 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57731a2-d022-4b75-93f0-18c4db1ee1df admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:52.915776 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f57731a2-d022-4b75-93f0-18c4db1ee1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:52.977363 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57731a2-d022-4b75-93f0-18c4db1ee1df admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:52.981175 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ab414-c2e2-4718-8e63-68ed20fd7ee7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:52.981789 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ab414-c2e2-4718-8e63-68ed20fd7ee7 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.982067 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ab414-c2e2-4718-8e63-68ed20fd7ee7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.982339 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ab414-c2e2-4718-8e63-68ed20fd7ee7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.991894 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ab414-c2e2-4718-8e63-68ed20fd7ee7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:52.993297 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ab414-c2e2-4718-8e63-68ed20fd7ee7 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:53.004060 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1390/2810] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:05:52 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:05:53.083172 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e35a08-ddfc-4221-b833-fb6433b44f02 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:53.093072 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e35a08-ddfc-4221-b833-fb6433b44f02 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:53.096680 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b7a91-c26f-42fa-b285-fdbb4bd6d366 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:53.097308 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b7a91-c26f-42fa-b285-fdbb4bd6d366 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:53.097599 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b7a91-c26f-42fa-b285-fdbb4bd6d366 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:53.097869 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b7a91-c26f-42fa-b285-fdbb4bd6d366 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:53.155415 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b7a91-c26f-42fa-b285-fdbb4bd6d366 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:53.156869 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b7a91-c26f-42fa-b285-fdbb4bd6d366 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:53.165822 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1421/2811] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:05:53 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:05:57.288134 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ab414-c2e2-4718-8e63-68ed20fd7ee7 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:57.303850 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:57.331405 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4139bea-b54a-4b7f-a1ce-043f51ec5f95 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:57.331909 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4139bea-b54a-4b7f-a1ce-043f51ec5f95 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:57.332105 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4139bea-b54a-4b7f-a1ce-043f51ec5f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:57.341438 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:57.353135 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a4139bea-b54a-4b7f-a1ce-043f51ec5f95 None None] MFA Rules not processed for user `42dcae7ba3c241eb8d7d0894aadb467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:57.354376 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a4139bea-b54a-4b7f-a1ce-043f51ec5f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:57.359749 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ab414-c2e2-4718-8e63-68ed20fd7ee7 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:57.364731 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba95d77-de0b-4b3a-9d5c-df7db2cb28dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:57.365424 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba95d77-de0b-4b3a-9d5c-df7db2cb28dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:57.365703 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba95d77-de0b-4b3a-9d5c-df7db2cb28dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:57.365975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba95d77-de0b-4b3a-9d5c-df7db2cb28dc admin admin] PATH_INFO: `/v3/users/02528df470d94dc8a344fe21208adc32` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:57.367900 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba95d77-de0b-4b3a-9d5c-df7db2cb28dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=02528df470d94dc8a344fe21208adc32)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:57.369971 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba95d77-de0b-4b3a-9d5c-df7db2cb28dc admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:57.415867 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1422/2812] 10.222.0.26 () {58 vars in 967 bytes} [Sun Oct 2 01:05:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:05:57.420497 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1ba95d77-de0b-4b3a-9d5c-df7db2cb28dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02528df470d94dc8a344fe21208adc32'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:57.421719 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1ba95d77-de0b-4b3a-9d5c-df7db2cb28dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02528df470d94dc8a344fe21208adc32'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:57.430686 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1ba95d77-de0b-4b3a-9d5c-df7db2cb28dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02528df470d94dc8a344fe21208adc32'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:57.431342 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1ba95d77-de0b-4b3a-9d5c-df7db2cb28dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02528df470d94dc8a344fe21208adc32'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:57.439560 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1ba95d77-de0b-4b3a-9d5c-df7db2cb28dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02528df470d94dc8a344fe21208adc32'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:57.463851 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1391/2813] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:05:57 2022] DELETE /identity/v3/users/02528df470d94dc8a344fe21208adc32 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:57.469443 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a117be-9834-4845-bb46-a965fe584c59 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:57.469735 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a117be-9834-4845-bb46-a965fe584c59 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:57.470004 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a117be-9834-4845-bb46-a965fe584c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:57.473638 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba95d77-de0b-4b3a-9d5c-df7db2cb28dc admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:57.475063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1ba95d77-de0b-4b3a-9d5c-df7db2cb28dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:57.489293 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c0a117be-9834-4845-bb46-a965fe584c59 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:57.490482 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c0a117be-9834-4845-bb46-a965fe584c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:57.548281 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba95d77-de0b-4b3a-9d5c-df7db2cb28dc admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:57.550585 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1423/2814] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:05:57.553756 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4211f6f-9a7a-4cda-b94d-0a421464df20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784579d2ddf4cc99fe0e1d109e5cdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:57.554665 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211f6f-9a7a-4cda-b94d-0a421464df20 service swift] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:57.554665 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211f6f-9a7a-4cda-b94d-0a421464df20 service swift] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:57.554901 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211f6f-9a7a-4cda-b94d-0a421464df20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:57.556706 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d4211f6f-9a7a-4cda-b94d-0a421464df20 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:57.560592 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a117be-9834-4845-bb46-a965fe584c59 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:57.562548 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c0a117be-9834-4845-bb46-a965fe584c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:57.590229 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:57.625608 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4211f6f-9a7a-4cda-b94d-0a421464df20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:57.627226 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4211f6f-9a7a-4cda-b94d-0a421464df20 service swift] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:57.628824 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a117be-9834-4845-bb46-a965fe584c59 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:57.632467 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d092be-a106-47c5-a502-05eadddc22b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:57.633099 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d092be-a106-47c5-a502-05eadddc22b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:57.633377 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d092be-a106-47c5-a502-05eadddc22b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:57.633647 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d092be-a106-47c5-a502-05eadddc22b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:57.635724 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1392/2815] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Oct 2 01:05:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 01:05:57.645249 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d092be-a106-47c5-a502-05eadddc22b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:57.646747 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d092be-a106-47c5-a502-05eadddc22b6 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:57.657271 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1424/2816] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:05:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:05:57.962247 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4211f6f-9a7a-4cda-b94d-0a421464df20 service swift] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:57.964197 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d4211f6f-9a7a-4cda-b94d-0a421464df20 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:57.986158 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4211f6f-9a7a-4cda-b94d-0a421464df20 service swift] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:57.991254 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16030cef-fd49-49f2-94d1-bfe0cf3af2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:57.991970 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16030cef-fd49-49f2-94d1-bfe0cf3af2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:57.992166 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16030cef-fd49-49f2-94d1-bfe0cf3af2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:57.992466 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16030cef-fd49-49f2-94d1-bfe0cf3af2d4 admin admin] PATH_INFO: `/v3/projects/bf3b9d8b4d344753a8dda155c1cf44b6` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:57.993660 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16030cef-fd49-49f2-94d1-bfe0cf3af2d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3b9d8b4d344753a8dda155c1cf44b6)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:57.995662 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16030cef-fd49-49f2-94d1-bfe0cf3af2d4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:58.053275 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-16030cef-fd49-49f2-94d1-bfe0cf3af2d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3b9d8b4d344753a8dda155c1cf44b6', 'request_id': 'req-16030cef-fd49-49f2-94d1-bfe0cf3af2d4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:58.060480 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-16030cef-fd49-49f2-94d1-bfe0cf3af2d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3b9d8b4d344753a8dda155c1cf44b6', 'request_id': 'req-16030cef-fd49-49f2-94d1-bfe0cf3af2d4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:58.069493 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-16030cef-fd49-49f2-94d1-bfe0cf3af2d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3b9d8b4d344753a8dda155c1cf44b6', 'request_id': 'req-16030cef-fd49-49f2-94d1-bfe0cf3af2d4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:58.080691 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-16030cef-fd49-49f2-94d1-bfe0cf3af2d4 admin admin] The token cache is being invalidate because project bf3b9d8b4d344753a8dda155c1cf44b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:05:58.081029 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-16030cef-fd49-49f2-94d1-bfe0cf3af2d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:58.081682 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-16030cef-fd49-49f2-94d1-bfe0cf3af2d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:58.083163 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1393/2817] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:57 2022] DELETE /identity/v3/projects/bf3b9d8b4d344753a8dda155c1cf44b6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:58.087186 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d092be-a106-47c5-a502-05eadddc22b6 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:58.097520 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d092be-a106-47c5-a502-05eadddc22b6 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:58.148814 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:58.158514 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5ef9b-7b27-4bad-a8f3-76cf241939d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:58.159246 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5ef9b-7b27-4bad-a8f3-76cf241939d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:58.159532 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5ef9b-7b27-4bad-a8f3-76cf241939d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:58.159802 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5ef9b-7b27-4bad-a8f3-76cf241939d9 admin admin] PATH_INFO: `/v3/users/4887197bc9214789bc38f682f9999e6d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:58.160977 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5ef9b-7b27-4bad-a8f3-76cf241939d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4887197bc9214789bc38f682f9999e6d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:58.162932 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5ef9b-7b27-4bad-a8f3-76cf241939d9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:58.220280 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-deb5ef9b-7b27-4bad-a8f3-76cf241939d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4887197bc9214789bc38f682f9999e6d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:58.220911 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-deb5ef9b-7b27-4bad-a8f3-76cf241939d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4887197bc9214789bc38f682f9999e6d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:58.235179 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-deb5ef9b-7b27-4bad-a8f3-76cf241939d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4887197bc9214789bc38f682f9999e6d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:58.244122 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-deb5ef9b-7b27-4bad-a8f3-76cf241939d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4887197bc9214789bc38f682f9999e6d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:58.244791 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-deb5ef9b-7b27-4bad-a8f3-76cf241939d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4887197bc9214789bc38f682f9999e6d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:58.258582 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1425/2818] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:05:58 2022] DELETE /identity/v3/users/4887197bc9214789bc38f682f9999e6d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:58.568363 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16030cef-fd49-49f2-94d1-bfe0cf3af2d4 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:58.570406 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-16030cef-fd49-49f2-94d1-bfe0cf3af2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:58.591784 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16030cef-fd49-49f2-94d1-bfe0cf3af2d4 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:58.657882 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34321f-6f55-4a5a-92c5-45aea3254ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:58.658896 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34321f-6f55-4a5a-92c5-45aea3254ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:58.658896 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34321f-6f55-4a5a-92c5-45aea3254ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:58.659132 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34321f-6f55-4a5a-92c5-45aea3254ee2 admin admin] PATH_INFO: `/v3/projects/12c80fa4b3844b04b661f7dbac2656c9` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:58.660576 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34321f-6f55-4a5a-92c5-45aea3254ee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c80fa4b3844b04b661f7dbac2656c9)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:58.662217 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34321f-6f55-4a5a-92c5-45aea3254ee2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:58.713530 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3c34321f-6f55-4a5a-92c5-45aea3254ee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c80fa4b3844b04b661f7dbac2656c9', 'request_id': 'req-3c34321f-6f55-4a5a-92c5-45aea3254ee2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:58.721267 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3c34321f-6f55-4a5a-92c5-45aea3254ee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c80fa4b3844b04b661f7dbac2656c9', 'request_id': 'req-3c34321f-6f55-4a5a-92c5-45aea3254ee2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:58.723956 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:58.730945 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3c34321f-6f55-4a5a-92c5-45aea3254ee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c80fa4b3844b04b661f7dbac2656c9', 'request_id': 'req-3c34321f-6f55-4a5a-92c5-45aea3254ee2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:58.744063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3c34321f-6f55-4a5a-92c5-45aea3254ee2 admin admin] The token cache is being invalidate because project 12c80fa4b3844b04b661f7dbac2656c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:05:58.744266 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3c34321f-6f55-4a5a-92c5-45aea3254ee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:58.744982 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3c34321f-6f55-4a5a-92c5-45aea3254ee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:58.746473 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1394/2819] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:58 2022] DELETE /identity/v3/projects/12c80fa4b3844b04b661f7dbac2656c9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:58.752323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9778c-aaaa-400a-9fb7-e54f5d6556a9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:58.752790 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9778c-aaaa-400a-9fb7-e54f5d6556a9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:58.752904 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9778c-aaaa-400a-9fb7-e54f5d6556a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:58.772895 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-03b9778c-aaaa-400a-9fb7-e54f5d6556a9 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:58.774132 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-03b9778c-aaaa-400a-9fb7-e54f5d6556a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:58.835953 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1426/2820] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:58.844874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22374a5-ab37-477a-b4f5-552fe7a0b6a4 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:58.845189 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22374a5-ab37-477a-b4f5-552fe7a0b6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:58.845464 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22374a5-ab37-477a-b4f5-552fe7a0b6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:58.866170 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e22374a5-ab37-477a-b4f5-552fe7a0b6a4 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:58.867386 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e22374a5-ab37-477a-b4f5-552fe7a0b6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:58.875713 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1395/2821] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:05:58.879860 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9778c-aaaa-400a-9fb7-e54f5d6556a9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:58.890938 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9778c-aaaa-400a-9fb7-e54f5d6556a9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:58.895597 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06fa06-99a7-4175-af32-eb4e3c5394a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:58.896205 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06fa06-99a7-4175-af32-eb4e3c5394a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:58.896489 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06fa06-99a7-4175-af32-eb4e3c5394a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:58.896762 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06fa06-99a7-4175-af32-eb4e3c5394a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:58.897562 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06fa06-99a7-4175-af32-eb4e3c5394a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:05:58.897874 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06fa06-99a7-4175-af32-eb4e3c5394a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:58.899474 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06fa06-99a7-4175-af32-eb4e3c5394a1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:58.912094 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1427/2822] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:05:58.916539 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22374a5-ab37-477a-b4f5-552fe7a0b6a4 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:58.926480 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22374a5-ab37-477a-b4f5-552fe7a0b6a4 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:58.931158 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2045b-3161-480e-940d-ff3454686cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:58.931753 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2045b-3161-480e-940d-ff3454686cbb admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:58.932023 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2045b-3161-480e-940d-ff3454686cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:58.932290 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2045b-3161-480e-940d-ff3454686cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:58.932910 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2045b-3161-480e-940d-ff3454686cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:58.934867 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2045b-3161-480e-940d-ff3454686cbb admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:58.963195 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1396/2823] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:05:58 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:05:58.967656 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06fa06-99a7-4175-af32-eb4e3c5394a1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:58.980446 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06fa06-99a7-4175-af32-eb4e3c5394a1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:59.041767 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0e6fe-aa84-48b1-83fd-dd466398560b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:59.042279 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0e6fe-aa84-48b1-83fd-dd466398560b admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:59.042554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0e6fe-aa84-48b1-83fd-dd466398560b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:59.042823 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0e6fe-aa84-48b1-83fd-dd466398560b admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:59.043440 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0e6fe-aa84-48b1-83fd-dd466398560b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:59.045626 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0e6fe-aa84-48b1-83fd-dd466398560b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:59.054664 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:59.070602 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1428/2824] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:05:58 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:05:59.074820 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2045b-3161-480e-940d-ff3454686cbb admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:59.085734 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2045b-3161-480e-940d-ff3454686cbb admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:59.090280 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3e178-8794-4689-9f80-bf9a97c6ec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:59.090873 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3e178-8794-4689-9f80-bf9a97c6ec84 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:59.091152 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3e178-8794-4689-9f80-bf9a97c6ec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:59.091423 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3e178-8794-4689-9f80-bf9a97c6ec84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:59.092063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3e178-8794-4689-9f80-bf9a97c6ec84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:59.094664 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3e178-8794-4689-9f80-bf9a97c6ec84 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:59.104768 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1397/2825] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:05:59.109063 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0e6fe-aa84-48b1-83fd-dd466398560b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:59.120065 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0e6fe-aa84-48b1-83fd-dd466398560b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:59.126486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e5628-3568-4b8c-8697-33eb90f8a4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:59.127099 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e5628-3568-4b8c-8697-33eb90f8a4ab admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:59.127374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e5628-3568-4b8c-8697-33eb90f8a4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:59.127639 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e5628-3568-4b8c-8697-33eb90f8a4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:59.128280 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e5628-3568-4b8c-8697-33eb90f8a4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:59.129906 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e5628-3568-4b8c-8697-33eb90f8a4ab admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:59.142126 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1429/2826] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:05:59.146837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3e178-8794-4689-9f80-bf9a97c6ec84 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:59.160701 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3e178-8794-4689-9f80-bf9a97c6ec84 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:59.166720 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78670940-31d7-4426-9178-43443aba56be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:59.167270 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78670940-31d7-4426-9178-43443aba56be admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:59.167557 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78670940-31d7-4426-9178-43443aba56be admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:59.167982 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78670940-31d7-4426-9178-43443aba56be admin admin] PATH_INFO: `/v3/projects/3a2167e91dd74e5bb76faf6ed2e8113a/users/7d8b17548a3949958cb7911d91c135db/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:59.185730 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78670940-31d7-4426-9178-43443aba56be admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2167e91dd74e5bb76faf6ed2e8113a, user_id=7d8b17548a3949958cb7911d91c135db, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:59.189043 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78670940-31d7-4426-9178-43443aba56be admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:59.222006 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1398/2827] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:05:59 2022] PUT /identity/v3/projects/3a2167e91dd74e5bb76faf6ed2e8113a/users/7d8b17548a3949958cb7911d91c135db/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:59.278221 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7f132-cb42-4814-8941-23182645d565 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:59.278504 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7f132-cb42-4814-8941-23182645d565 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:59.278767 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7f132-cb42-4814-8941-23182645d565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:59.309370 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ecc7f132-cb42-4814-8941-23182645d565 None None] MFA Rules not processed for user `7d8b17548a3949958cb7911d91c135db`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:59.310523 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ecc7f132-cb42-4814-8941-23182645d565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:59.382846 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1430/2828] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:05:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:59.387393 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78670940-31d7-4426-9178-43443aba56be admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:59.456908 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78670940-31d7-4426-9178-43443aba56be admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:59.461511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60f5ee-c488-4323-8367-0836c7442df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:59.462107 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60f5ee-c488-4323-8367-0836c7442df2 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:59.462383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60f5ee-c488-4323-8367-0836c7442df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:59.462652 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60f5ee-c488-4323-8367-0836c7442df2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:59.463276 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60f5ee-c488-4323-8367-0836c7442df2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:59.465205 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60f5ee-c488-4323-8367-0836c7442df2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:59.494252 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1399/2829] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:05:59 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:05:59.498399 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7f132-cb42-4814-8941-23182645d565 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:59.510051 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7f132-cb42-4814-8941-23182645d565 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:59.569972 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23def3e9-c401-48f9-aba0-bbf89d0d2349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:59.570479 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23def3e9-c401-48f9-aba0-bbf89d0d2349 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:59.570755 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23def3e9-c401-48f9-aba0-bbf89d0d2349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:59.571023 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23def3e9-c401-48f9-aba0-bbf89d0d2349 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:59.571649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23def3e9-c401-48f9-aba0-bbf89d0d2349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:59.573612 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23def3e9-c401-48f9-aba0-bbf89d0d2349 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:59.596366 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1431/2830] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:05:59 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:05:59.601096 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60f5ee-c488-4323-8367-0836c7442df2 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:59.612172 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60f5ee-c488-4323-8367-0836c7442df2 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:59.617131 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef2bdd-9e92-427d-aaf6-d3bc9f3eedd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:59.617752 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef2bdd-9e92-427d-aaf6-d3bc9f3eedd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:59.618027 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef2bdd-9e92-427d-aaf6-d3bc9f3eedd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:59.618293 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef2bdd-9e92-427d-aaf6-d3bc9f3eedd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:59.618925 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef2bdd-9e92-427d-aaf6-d3bc9f3eedd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:59.620634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef2bdd-9e92-427d-aaf6-d3bc9f3eedd4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:59.632440 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1400/2831] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:05:59.636534 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23def3e9-c401-48f9-aba0-bbf89d0d2349 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:59.647413 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23def3e9-c401-48f9-aba0-bbf89d0d2349 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:59.652167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406dbe1-d1f3-47ae-b46e-05952587d39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:59.652775 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406dbe1-d1f3-47ae-b46e-05952587d39c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:59.653088 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406dbe1-d1f3-47ae-b46e-05952587d39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:59.653366 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406dbe1-d1f3-47ae-b46e-05952587d39c admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:59.654009 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406dbe1-d1f3-47ae-b46e-05952587d39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:59.656160 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406dbe1-d1f3-47ae-b46e-05952587d39c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:59.675119 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1432/2832] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:05:59.676279 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef2bdd-9e92-427d-aaf6-d3bc9f3eedd4 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:59.692454 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef2bdd-9e92-427d-aaf6-d3bc9f3eedd4 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:59.697403 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c121a6-c3e7-4954-861a-204fd6abb7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:59.698064 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c121a6-c3e7-4954-861a-204fd6abb7cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:59.698349 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c121a6-c3e7-4954-861a-204fd6abb7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:59.698625 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c121a6-c3e7-4954-861a-204fd6abb7cd admin admin] PATH_INFO: `/v3/projects/2bf7b2f715d24b18b93d7eb2ff43ea88/users/3481beacee744d6cad62abab6fda262d/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:59.716382 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c121a6-c3e7-4954-861a-204fd6abb7cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf7b2f715d24b18b93d7eb2ff43ea88, user_id=3481beacee744d6cad62abab6fda262d, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:59.720067 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c121a6-c3e7-4954-861a-204fd6abb7cd admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:59.736997 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1401/2833] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:05:59 2022] PUT /identity/v3/projects/2bf7b2f715d24b18b93d7eb2ff43ea88/users/3481beacee744d6cad62abab6fda262d/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:59.747059 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604213c-86a2-4e27-8fd9-954e62103a1d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:59.747643 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604213c-86a2-4e27-8fd9-954e62103a1d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:59.747922 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604213c-86a2-4e27-8fd9-954e62103a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:59.782354 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4604213c-86a2-4e27-8fd9-954e62103a1d None None] MFA Rules not processed for user `3481beacee744d6cad62abab6fda262d`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:59.783596 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4604213c-86a2-4e27-8fd9-954e62103a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:59.824866 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:59.860982 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1433/2834] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:05:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:05:59.865477 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c121a6-c3e7-4954-861a-204fd6abb7cd admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:59.903170 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:59.941102 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c121a6-c3e7-4954-861a-204fd6abb7cd admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:59.947957 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b3f6c-0113-4cc0-9c66-c87d73b1c43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:59.948859 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b3f6c-0113-4cc0-9c66-c87d73b1c43b admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:59.949313 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b3f6c-0113-4cc0-9c66-c87d73b1c43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:59.949747 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b3f6c-0113-4cc0-9c66-c87d73b1c43b admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:59.950759 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b3f6c-0113-4cc0-9c66-c87d73b1c43b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:59.953161 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b3f6c-0113-4cc0-9c66-c87d73b1c43b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:59.991605 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1402/2835] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:05:59 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:05:59.992418 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604213c-86a2-4e27-8fd9-954e62103a1d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:00.006343 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604213c-86a2-4e27-8fd9-954e62103a1d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:00.094805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140f049-9fda-4774-aca7-a683a276a1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:00.095344 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140f049-9fda-4774-aca7-a683a276a1ce admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:00.095644 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140f049-9fda-4774-aca7-a683a276a1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:00.095939 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140f049-9fda-4774-aca7-a683a276a1ce admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:00.096841 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140f049-9fda-4774-aca7-a683a276a1ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:00.098666 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140f049-9fda-4774-aca7-a683a276a1ce admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:00.126809 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1434/2836] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:05:59 2022] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:06:00.130995 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b3f6c-0113-4cc0-9c66-c87d73b1c43b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:00.143131 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b3f6c-0113-4cc0-9c66-c87d73b1c43b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:00.148337 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99ff5a-a94c-4d93-b357-6095e36031b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:00.149049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99ff5a-a94c-4d93-b357-6095e36031b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:00.149402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99ff5a-a94c-4d93-b357-6095e36031b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:00.149746 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99ff5a-a94c-4d93-b357-6095e36031b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:00.150490 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99ff5a-a94c-4d93-b357-6095e36031b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:00.152166 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99ff5a-a94c-4d93-b357-6095e36031b7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:00.167559 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1403/2837] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:00.169148 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140f049-9fda-4774-aca7-a683a276a1ce admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:00.181269 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140f049-9fda-4774-aca7-a683a276a1ce admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:00.188275 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c810260-46b1-4e46-ab1e-542dd86692af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:00.189483 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c810260-46b1-4e46-ab1e-542dd86692af admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:00.189483 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c810260-46b1-4e46-ab1e-542dd86692af admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:00.189960 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c810260-46b1-4e46-ab1e-542dd86692af admin admin] PATH_INFO: `/v3/projects/d4771215fe9b4244ac7e0d7f3ca663f0/users/7fca3fde20044be1a8902af50b416d97/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:00.206274 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c810260-46b1-4e46-ab1e-542dd86692af admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4771215fe9b4244ac7e0d7f3ca663f0, user_id=7fca3fde20044be1a8902af50b416d97, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:00.209253 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c810260-46b1-4e46-ab1e-542dd86692af admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:00.228893 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1435/2838] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:06:00 2022] PUT /identity/v3/projects/d4771215fe9b4244ac7e0d7f3ca663f0/users/7fca3fde20044be1a8902af50b416d97/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:06:00.233231 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99ff5a-a94c-4d93-b357-6095e36031b7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:00.246983 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99ff5a-a94c-4d93-b357-6095e36031b7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:00.312463 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c13587-d1a4-4196-8e60-d8b2f233a7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:00.313206 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c13587-d1a4-4196-8e60-d8b2f233a7dc admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:00.313488 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c13587-d1a4-4196-8e60-d8b2f233a7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:00.313794 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c13587-d1a4-4196-8e60-d8b2f233a7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:00.314437 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c13587-d1a4-4196-8e60-d8b2f233a7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:00.316080 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c13587-d1a4-4196-8e60-d8b2f233a7dc admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:00.326336 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1404/2839] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:00.331411 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c810260-46b1-4e46-ab1e-542dd86692af admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:00.342016 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c810260-46b1-4e46-ab1e-542dd86692af admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:00.346964 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7bbed-8c81-45d4-b0e5-bb6944f3c4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:00.347631 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7bbed-8c81-45d4-b0e5-bb6944f3c4c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:00.347981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7bbed-8c81-45d4-b0e5-bb6944f3c4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:00.348321 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7bbed-8c81-45d4-b0e5-bb6944f3c4c0 admin admin] PATH_INFO: `/v3/projects/d4771215fe9b4244ac7e0d7f3ca663f0/users/7fca3fde20044be1a8902af50b416d97/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:00.350371 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7bbed-8c81-45d4-b0e5-bb6944f3c4c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4771215fe9b4244ac7e0d7f3ca663f0, user_id=7fca3fde20044be1a8902af50b416d97, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:00.353163 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7bbed-8c81-45d4-b0e5-bb6944f3c4c0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:00.364842 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1436/2840] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:06:00 2022] PUT /identity/v3/projects/d4771215fe9b4244ac7e0d7f3ca663f0/users/7fca3fde20044be1a8902af50b416d97/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:00.377148 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebeacec-65c4-4013-8f23-74eb8935e9a2 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:00.377388 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebeacec-65c4-4013-8f23-74eb8935e9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:00.377871 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebeacec-65c4-4013-8f23-74eb8935e9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:00.407152 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6ebeacec-65c4-4013-8f23-74eb8935e9a2 None None] MFA Rules not processed for user `7fca3fde20044be1a8902af50b416d97`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:00.408623 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6ebeacec-65c4-4013-8f23-74eb8935e9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:00.498518 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1405/2841] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:06:00.510098 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7bbed-8c81-45d4-b0e5-bb6944f3c4c0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:00.511951 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-10c7bbed-8c81-45d4-b0e5-bb6944f3c4c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:00.583701 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7bbed-8c81-45d4-b0e5-bb6944f3c4c0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:00.587581 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a38ca6-6a9e-48fb-b48d-0b07d10e56b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:00.588227 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a38ca6-6a9e-48fb-b48d-0b07d10e56b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:00.588654 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a38ca6-6a9e-48fb-b48d-0b07d10e56b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:00.588922 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a38ca6-6a9e-48fb-b48d-0b07d10e56b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:00.600905 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a38ca6-6a9e-48fb-b48d-0b07d10e56b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:00.602440 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a38ca6-6a9e-48fb-b48d-0b07d10e56b8 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:00.614808 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1437/2842] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:00.664123 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebeacec-65c4-4013-8f23-74eb8935e9a2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:00.664123 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6ebeacec-65c4-4013-8f23-74eb8935e9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:00.676311 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebeacec-65c4-4013-8f23-74eb8935e9a2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:00.680185 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddc20f-a99a-4d40-a4a4-7b0af541b7c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:00.680733 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddc20f-a99a-4d40-a4a4-7b0af541b7c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:00.681036 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddc20f-a99a-4d40-a4a4-7b0af541b7c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:00.681313 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddc20f-a99a-4d40-a4a4-7b0af541b7c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:00.708117 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:00.751355 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddc20f-a99a-4d40-a4a4-7b0af541b7c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:00.752975 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddc20f-a99a-4d40-a4a4-7b0af541b7c5 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:00.763119 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1406/2843] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:03.865080 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a38ca6-6a9e-48fb-b48d-0b07d10e56b8 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:03.902009 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:03.945273 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a38ca6-6a9e-48fb-b48d-0b07d10e56b8 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:03.949779 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9f02e-81e4-449c-ae50-c702ad24a561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:03.950425 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9f02e-81e4-449c-ae50-c702ad24a561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:03.950687 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9f02e-81e4-449c-ae50-c702ad24a561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:03.950957 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9f02e-81e4-449c-ae50-c702ad24a561 admin admin] PATH_INFO: `/v3/users/7d8b17548a3949958cb7911d91c135db` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:03.952319 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9f02e-81e4-449c-ae50-c702ad24a561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d8b17548a3949958cb7911d91c135db)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:03.954470 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9f02e-81e4-449c-ae50-c702ad24a561 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:04.009463 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-29b9f02e-81e4-449c-ae50-c702ad24a561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d8b17548a3949958cb7911d91c135db'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.010074 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-29b9f02e-81e4-449c-ae50-c702ad24a561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d8b17548a3949958cb7911d91c135db'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.023486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-29b9f02e-81e4-449c-ae50-c702ad24a561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d8b17548a3949958cb7911d91c135db'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.033902 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-29b9f02e-81e4-449c-ae50-c702ad24a561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d8b17548a3949958cb7911d91c135db'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.034527 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-29b9f02e-81e4-449c-ae50-c702ad24a561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d8b17548a3949958cb7911d91c135db'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.050074 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1438/2844] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:03 2022] DELETE /identity/v3/users/7d8b17548a3949958cb7911d91c135db => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:04.056067 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22aeb3c-14df-454d-8eaa-291f04723b5d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:04.056548 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22aeb3c-14df-454d-8eaa-291f04723b5d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:04.057022 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22aeb3c-14df-454d-8eaa-291f04723b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:04.080660 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a22aeb3c-14df-454d-8eaa-291f04723b5d None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:04.081792 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a22aeb3c-14df-454d-8eaa-291f04723b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:04.168680 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1407/2845] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:04.181054 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9f02e-81e4-449c-ae50-c702ad24a561 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:04.183410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-29b9f02e-81e4-449c-ae50-c702ad24a561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:04.264270 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9f02e-81e4-449c-ae50-c702ad24a561 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:04.268515 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b71f28-4744-4ee6-a148-8ac6472ec6c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:04.269486 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71f28-4744-4ee6-a148-8ac6472ec6c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:04.269829 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71f28-4744-4ee6-a148-8ac6472ec6c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:04.270621 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71f28-4744-4ee6-a148-8ac6472ec6c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:04.284204 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b71f28-4744-4ee6-a148-8ac6472ec6c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:04.286368 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b71f28-4744-4ee6-a148-8ac6472ec6c6 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:04.310430 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1439/2846] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:04.600669 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22aeb3c-14df-454d-8eaa-291f04723b5d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:04.602347 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a22aeb3c-14df-454d-8eaa-291f04723b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:04.626776 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22aeb3c-14df-454d-8eaa-291f04723b5d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:04.635753 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339a0d5-7b6f-470d-afdc-dbea6653f021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:04.641613 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339a0d5-7b6f-470d-afdc-dbea6653f021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:04.643058 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339a0d5-7b6f-470d-afdc-dbea6653f021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:04.643507 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339a0d5-7b6f-470d-afdc-dbea6653f021 admin admin] PATH_INFO: `/v3/users/ba7722296ce14931bc49d3c2912e56f0` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:04.646991 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339a0d5-7b6f-470d-afdc-dbea6653f021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba7722296ce14931bc49d3c2912e56f0)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:04.650492 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339a0d5-7b6f-470d-afdc-dbea6653f021 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:04.725221 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7339a0d5-7b6f-470d-afdc-dbea6653f021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba7722296ce14931bc49d3c2912e56f0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.726223 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7339a0d5-7b6f-470d-afdc-dbea6653f021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba7722296ce14931bc49d3c2912e56f0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.740353 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7339a0d5-7b6f-470d-afdc-dbea6653f021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba7722296ce14931bc49d3c2912e56f0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.741095 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7339a0d5-7b6f-470d-afdc-dbea6653f021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba7722296ce14931bc49d3c2912e56f0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.761117 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7339a0d5-7b6f-470d-afdc-dbea6653f021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba7722296ce14931bc49d3c2912e56f0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.767697 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b71f28-4744-4ee6-a148-8ac6472ec6c6 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:04.769779 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-48b71f28-4744-4ee6-a148-8ac6472ec6c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:04.790537 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b71f28-4744-4ee6-a148-8ac6472ec6c6 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:04.792622 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1408/2847] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:04 2022] DELETE /identity/v3/users/ba7722296ce14931bc49d3c2912e56f0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:04.854983 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:04.867613 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10e42b-ecb1-4fdc-b324-344532ee9634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:04.868294 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10e42b-ecb1-4fdc-b324-344532ee9634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:04.868512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10e42b-ecb1-4fdc-b324-344532ee9634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:04.868994 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10e42b-ecb1-4fdc-b324-344532ee9634 admin admin] PATH_INFO: `/v3/projects/3a2167e91dd74e5bb76faf6ed2e8113a` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:04.870335 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10e42b-ecb1-4fdc-b324-344532ee9634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2167e91dd74e5bb76faf6ed2e8113a)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:04.872259 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10e42b-ecb1-4fdc-b324-344532ee9634 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:04.923281 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0d10e42b-ecb1-4fdc-b324-344532ee9634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2167e91dd74e5bb76faf6ed2e8113a', 'request_id': 'req-0d10e42b-ecb1-4fdc-b324-344532ee9634'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.929635 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0d10e42b-ecb1-4fdc-b324-344532ee9634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2167e91dd74e5bb76faf6ed2e8113a', 'request_id': 'req-0d10e42b-ecb1-4fdc-b324-344532ee9634'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.938441 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0d10e42b-ecb1-4fdc-b324-344532ee9634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2167e91dd74e5bb76faf6ed2e8113a', 'request_id': 'req-0d10e42b-ecb1-4fdc-b324-344532ee9634'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.949330 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0d10e42b-ecb1-4fdc-b324-344532ee9634 admin admin] The token cache is being invalidate because project 3a2167e91dd74e5bb76faf6ed2e8113a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:04.949616 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0d10e42b-ecb1-4fdc-b324-344532ee9634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.950249 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0d10e42b-ecb1-4fdc-b324-344532ee9634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.951720 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1440/2848] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:04 2022] DELETE /identity/v3/projects/3a2167e91dd74e5bb76faf6ed2e8113a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:04.955888 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339a0d5-7b6f-470d-afdc-dbea6653f021 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:04.958033 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7339a0d5-7b6f-470d-afdc-dbea6653f021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:04.972201 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339a0d5-7b6f-470d-afdc-dbea6653f021 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:04.990172 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10e42b-ecb1-4fdc-b324-344532ee9634 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:04.991632 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0d10e42b-ecb1-4fdc-b324-344532ee9634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:05.021464 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:05.055832 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353ec49-5cd7-41d4-8495-a9ee0b44ea8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:05.056903 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353ec49-5cd7-41d4-8495-a9ee0b44ea8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:05.057468 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353ec49-5cd7-41d4-8495-a9ee0b44ea8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:05.057568 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353ec49-5cd7-41d4-8495-a9ee0b44ea8c admin admin] PATH_INFO: `/v3/users/3481beacee744d6cad62abab6fda262d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:05.058990 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353ec49-5cd7-41d4-8495-a9ee0b44ea8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3481beacee744d6cad62abab6fda262d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:05.060953 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353ec49-5cd7-41d4-8495-a9ee0b44ea8c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:05.075906 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10e42b-ecb1-4fdc-b324-344532ee9634 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:05.080931 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada4b49-8ef9-46f0-ab2d-15ceae80d34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:05.082267 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada4b49-8ef9-46f0-ab2d-15ceae80d34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:05.082547 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada4b49-8ef9-46f0-ab2d-15ceae80d34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:05.082823 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada4b49-8ef9-46f0-ab2d-15ceae80d34c admin admin] PATH_INFO: `/v3/projects/76adee9ec65f48b0b6e582800bc46a62` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:05.084094 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada4b49-8ef9-46f0-ab2d-15ceae80d34c admin admin] RBAC: Authorizing `identity:delete_project(project_id=76adee9ec65f48b0b6e582800bc46a62)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:05.086057 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada4b49-8ef9-46f0-ab2d-15ceae80d34c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:05.110565 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3353ec49-5cd7-41d4-8495-a9ee0b44ea8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3481beacee744d6cad62abab6fda262d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.111236 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3353ec49-5cd7-41d4-8495-a9ee0b44ea8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3481beacee744d6cad62abab6fda262d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.118944 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3353ec49-5cd7-41d4-8495-a9ee0b44ea8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3481beacee744d6cad62abab6fda262d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.119648 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3353ec49-5cd7-41d4-8495-a9ee0b44ea8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3481beacee744d6cad62abab6fda262d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.127105 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3353ec49-5cd7-41d4-8495-a9ee0b44ea8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3481beacee744d6cad62abab6fda262d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.136573 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4ada4b49-8ef9-46f0-ab2d-15ceae80d34c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76adee9ec65f48b0b6e582800bc46a62', 'request_id': 'req-4ada4b49-8ef9-46f0-ab2d-15ceae80d34c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.145132 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1409/2849] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:04 2022] DELETE /identity/v3/users/3481beacee744d6cad62abab6fda262d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:05.146371 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4ada4b49-8ef9-46f0-ab2d-15ceae80d34c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76adee9ec65f48b0b6e582800bc46a62', 'request_id': 'req-4ada4b49-8ef9-46f0-ab2d-15ceae80d34c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.155091 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4ada4b49-8ef9-46f0-ab2d-15ceae80d34c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76adee9ec65f48b0b6e582800bc46a62', 'request_id': 'req-4ada4b49-8ef9-46f0-ab2d-15ceae80d34c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.167350 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4ada4b49-8ef9-46f0-ab2d-15ceae80d34c admin admin] The token cache is being invalidate because project 76adee9ec65f48b0b6e582800bc46a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:05.167846 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4ada4b49-8ef9-46f0-ab2d-15ceae80d34c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.168530 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4ada4b49-8ef9-46f0-ab2d-15ceae80d34c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.170167 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1441/2850] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:04 2022] DELETE /identity/v3/projects/76adee9ec65f48b0b6e582800bc46a62 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:05.174812 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353ec49-5cd7-41d4-8495-a9ee0b44ea8c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:05.176262 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3353ec49-5cd7-41d4-8495-a9ee0b44ea8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:05.248077 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353ec49-5cd7-41d4-8495-a9ee0b44ea8c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:05.256558 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37275205-d2e1-4061-aad5-95edc814881a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:05.257230 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37275205-d2e1-4061-aad5-95edc814881a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:05.257512 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37275205-d2e1-4061-aad5-95edc814881a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:05.257791 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37275205-d2e1-4061-aad5-95edc814881a admin admin] PATH_INFO: `/v3/users/a0595bd3fb2e47cca0c4df8b7f6edb94` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:05.258935 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37275205-d2e1-4061-aad5-95edc814881a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0595bd3fb2e47cca0c4df8b7f6edb94)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:05.260865 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37275205-d2e1-4061-aad5-95edc814881a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:05.315969 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-37275205-d2e1-4061-aad5-95edc814881a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0595bd3fb2e47cca0c4df8b7f6edb94'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.316736 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-37275205-d2e1-4061-aad5-95edc814881a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0595bd3fb2e47cca0c4df8b7f6edb94'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.325461 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-37275205-d2e1-4061-aad5-95edc814881a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0595bd3fb2e47cca0c4df8b7f6edb94'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.326100 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-37275205-d2e1-4061-aad5-95edc814881a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0595bd3fb2e47cca0c4df8b7f6edb94'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.331954 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:05.335093 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-37275205-d2e1-4061-aad5-95edc814881a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0595bd3fb2e47cca0c4df8b7f6edb94'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.356219 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1410/2851] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:05 2022] DELETE /identity/v3/users/a0595bd3fb2e47cca0c4df8b7f6edb94 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:05.466483 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada4b49-8ef9-46f0-ab2d-15ceae80d34c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:05.468659 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4ada4b49-8ef9-46f0-ab2d-15ceae80d34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:05.487146 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:05.547527 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada4b49-8ef9-46f0-ab2d-15ceae80d34c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:05.603990 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37275205-d2e1-4061-aad5-95edc814881a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:05.606062 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-37275205-d2e1-4061-aad5-95edc814881a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:05.626811 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac93f4-6a12-4287-a12d-5dc5160e0112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:05.627471 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac93f4-6a12-4287-a12d-5dc5160e0112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:05.627753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac93f4-6a12-4287-a12d-5dc5160e0112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:05.628025 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac93f4-6a12-4287-a12d-5dc5160e0112 admin admin] PATH_INFO: `/v3/projects/2bf7b2f715d24b18b93d7eb2ff43ea88` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:05.629706 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac93f4-6a12-4287-a12d-5dc5160e0112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf7b2f715d24b18b93d7eb2ff43ea88)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:05.631259 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac93f4-6a12-4287-a12d-5dc5160e0112 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:05.692103 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37275205-d2e1-4061-aad5-95edc814881a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:05.694219 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-96ac93f4-6a12-4287-a12d-5dc5160e0112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf7b2f715d24b18b93d7eb2ff43ea88', 'request_id': 'req-96ac93f4-6a12-4287-a12d-5dc5160e0112'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.701463 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-96ac93f4-6a12-4287-a12d-5dc5160e0112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf7b2f715d24b18b93d7eb2ff43ea88', 'request_id': 'req-96ac93f4-6a12-4287-a12d-5dc5160e0112'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.711330 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-96ac93f4-6a12-4287-a12d-5dc5160e0112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf7b2f715d24b18b93d7eb2ff43ea88', 'request_id': 'req-96ac93f4-6a12-4287-a12d-5dc5160e0112'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.724805 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-96ac93f4-6a12-4287-a12d-5dc5160e0112 admin admin] The token cache is being invalidate because project 2bf7b2f715d24b18b93d7eb2ff43ea88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:05.725132 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-96ac93f4-6a12-4287-a12d-5dc5160e0112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.726048 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-96ac93f4-6a12-4287-a12d-5dc5160e0112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.727579 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1442/2852] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:05 2022] DELETE /identity/v3/projects/2bf7b2f715d24b18b93d7eb2ff43ea88 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:05.731500 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac93f4-6a12-4287-a12d-5dc5160e0112 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:05.732857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-96ac93f4-6a12-4287-a12d-5dc5160e0112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:05.758887 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8df70-0ada-4b68-9289-834a3169a523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:05.759527 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8df70-0ada-4b68-9289-834a3169a523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:05.759810 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8df70-0ada-4b68-9289-834a3169a523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:05.760087 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8df70-0ada-4b68-9289-834a3169a523 admin admin] PATH_INFO: `/v3/projects/cba708a9df6343f2900ac8b455284c3d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:05.761273 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8df70-0ada-4b68-9289-834a3169a523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cba708a9df6343f2900ac8b455284c3d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:05.763270 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8df70-0ada-4b68-9289-834a3169a523 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:05.791113 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:05.808304 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac93f4-6a12-4287-a12d-5dc5160e0112 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:05.815245 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-dbd8df70-0ada-4b68-9289-834a3169a523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cba708a9df6343f2900ac8b455284c3d', 'request_id': 'req-dbd8df70-0ada-4b68-9289-834a3169a523'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.821562 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-dbd8df70-0ada-4b68-9289-834a3169a523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cba708a9df6343f2900ac8b455284c3d', 'request_id': 'req-dbd8df70-0ada-4b68-9289-834a3169a523'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.829485 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-dbd8df70-0ada-4b68-9289-834a3169a523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cba708a9df6343f2900ac8b455284c3d', 'request_id': 'req-dbd8df70-0ada-4b68-9289-834a3169a523'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.840872 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-dbd8df70-0ada-4b68-9289-834a3169a523 admin admin] The token cache is being invalidate because project cba708a9df6343f2900ac8b455284c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:05.841198 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-dbd8df70-0ada-4b68-9289-834a3169a523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.841861 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-dbd8df70-0ada-4b68-9289-834a3169a523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.844075 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1411/2853] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:05 2022] DELETE /identity/v3/projects/cba708a9df6343f2900ac8b455284c3d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:06:05.872066 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5921e4-526c-484f-853e-a1cba96e2767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:05.872857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5921e4-526c-484f-853e-a1cba96e2767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:05.873162 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5921e4-526c-484f-853e-a1cba96e2767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:05.873606 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5921e4-526c-484f-853e-a1cba96e2767 admin admin] PATH_INFO: `/v3/users/7fca3fde20044be1a8902af50b416d97` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:05.875266 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5921e4-526c-484f-853e-a1cba96e2767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fca3fde20044be1a8902af50b416d97)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:05.877354 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5921e4-526c-484f-853e-a1cba96e2767 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:05.931888 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-aa5921e4-526c-484f-853e-a1cba96e2767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fca3fde20044be1a8902af50b416d97'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.932603 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-aa5921e4-526c-484f-853e-a1cba96e2767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fca3fde20044be1a8902af50b416d97'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.945951 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-aa5921e4-526c-484f-853e-a1cba96e2767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fca3fde20044be1a8902af50b416d97'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.954573 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-aa5921e4-526c-484f-853e-a1cba96e2767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fca3fde20044be1a8902af50b416d97'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.955229 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-aa5921e4-526c-484f-853e-a1cba96e2767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fca3fde20044be1a8902af50b416d97'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:05.973306 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1443/2854] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:05 2022] DELETE /identity/v3/users/7fca3fde20044be1a8902af50b416d97 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:06:06.261019 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8df70-0ada-4b68-9289-834a3169a523 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:06.262511 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-dbd8df70-0ada-4b68-9289-834a3169a523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:06.275964 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8df70-0ada-4b68-9289-834a3169a523 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:06.286478 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:06.337980 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dd6bb-682b-43d6-b8b2-9adafaa0b54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:06.338620 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dd6bb-682b-43d6-b8b2-9adafaa0b54f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.338904 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dd6bb-682b-43d6-b8b2-9adafaa0b54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.339180 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dd6bb-682b-43d6-b8b2-9adafaa0b54f admin admin] PATH_INFO: `/v3/projects/d4771215fe9b4244ac7e0d7f3ca663f0` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.340294 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778dd6bb-682b-43d6-b8b2-9adafaa0b54f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4771215fe9b4244ac7e0d7f3ca663f0)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:06.342239 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778dd6bb-682b-43d6-b8b2-9adafaa0b54f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:06.391556 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-778dd6bb-682b-43d6-b8b2-9adafaa0b54f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4771215fe9b4244ac7e0d7f3ca663f0', 'request_id': 'req-778dd6bb-682b-43d6-b8b2-9adafaa0b54f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:06.397838 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-778dd6bb-682b-43d6-b8b2-9adafaa0b54f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4771215fe9b4244ac7e0d7f3ca663f0', 'request_id': 'req-778dd6bb-682b-43d6-b8b2-9adafaa0b54f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:06.405543 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-778dd6bb-682b-43d6-b8b2-9adafaa0b54f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4771215fe9b4244ac7e0d7f3ca663f0', 'request_id': 'req-778dd6bb-682b-43d6-b8b2-9adafaa0b54f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:06.420381 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-778dd6bb-682b-43d6-b8b2-9adafaa0b54f admin admin] The token cache is being invalidate because project d4771215fe9b4244ac7e0d7f3ca663f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:06.420670 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-778dd6bb-682b-43d6-b8b2-9adafaa0b54f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:06.421888 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-778dd6bb-682b-43d6-b8b2-9adafaa0b54f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:06.423389 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1412/2855] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:06 2022] DELETE /identity/v3/projects/d4771215fe9b4244ac7e0d7f3ca663f0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:06.429581 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f930d98-1060-47a5-9c4f-3c53d60ff6b3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.429894 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f930d98-1060-47a5-9c4f-3c53d60ff6b3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.430166 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f930d98-1060-47a5-9c4f-3c53d60ff6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.450648 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4f930d98-1060-47a5-9c4f-3c53d60ff6b3 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:06.451893 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4f930d98-1060-47a5-9c4f-3c53d60ff6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:06.512749 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1444/2856] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:06.521094 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b271d42-7548-4655-a369-dd538c841ce7 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.521375 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b271d42-7548-4655-a369-dd538c841ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.521642 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b271d42-7548-4655-a369-dd538c841ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.542413 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5b271d42-7548-4655-a369-dd538c841ce7 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:06.543624 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5b271d42-7548-4655-a369-dd538c841ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:06.552046 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1413/2857] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:06.556627 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f930d98-1060-47a5-9c4f-3c53d60ff6b3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:06.566527 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f930d98-1060-47a5-9c4f-3c53d60ff6b3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:06.571083 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8ca3c-1794-4ff7-a375-5318038a97eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:06.571677 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8ca3c-1794-4ff7-a375-5318038a97eb admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.571958 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8ca3c-1794-4ff7-a375-5318038a97eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.572232 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8ca3c-1794-4ff7-a375-5318038a97eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.572874 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8ca3c-1794-4ff7-a375-5318038a97eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:06:06.573206 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8ca3c-1794-4ff7-a375-5318038a97eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:06.574811 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8ca3c-1794-4ff7-a375-5318038a97eb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:06.586849 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1445/2858] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:06:06.591389 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b271d42-7548-4655-a369-dd538c841ce7 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:06.601580 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b271d42-7548-4655-a369-dd538c841ce7 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:06.606310 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a9aef-9045-4d05-80f8-8a9bd5a8eaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:06.606896 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a9aef-9045-4d05-80f8-8a9bd5a8eaef admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.607177 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a9aef-9045-4d05-80f8-8a9bd5a8eaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.607452 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a9aef-9045-4d05-80f8-8a9bd5a8eaef admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.608108 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a9aef-9045-4d05-80f8-8a9bd5a8eaef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:06.610720 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a9aef-9045-4d05-80f8-8a9bd5a8eaef admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:06.648530 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1414/2859] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:06:06 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:06.652761 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8ca3c-1794-4ff7-a375-5318038a97eb admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:06.659851 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:06.663934 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8ca3c-1794-4ff7-a375-5318038a97eb admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:06.725572 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396e237-7ab0-43a6-b666-3f8bdc2b1161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:06.726203 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396e237-7ab0-43a6-b666-3f8bdc2b1161 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.726476 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396e237-7ab0-43a6-b666-3f8bdc2b1161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.726749 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396e237-7ab0-43a6-b666-3f8bdc2b1161 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.727427 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396e237-7ab0-43a6-b666-3f8bdc2b1161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:06.729312 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396e237-7ab0-43a6-b666-3f8bdc2b1161 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:06.759314 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1446/2860] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:06:06 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:06.763354 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a9aef-9045-4d05-80f8-8a9bd5a8eaef admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:06.774368 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a9aef-9045-4d05-80f8-8a9bd5a8eaef admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:06.779129 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f805e-d7f9-4cee-bf2b-aa46c1e2cf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:06.779719 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f805e-d7f9-4cee-bf2b-aa46c1e2cf6b admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.779999 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f805e-d7f9-4cee-bf2b-aa46c1e2cf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.781353 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f805e-d7f9-4cee-bf2b-aa46c1e2cf6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.782301 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f805e-d7f9-4cee-bf2b-aa46c1e2cf6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:06.783906 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f805e-d7f9-4cee-bf2b-aa46c1e2cf6b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:06.794077 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1415/2861] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:06.798693 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396e237-7ab0-43a6-b666-3f8bdc2b1161 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:06.808782 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396e237-7ab0-43a6-b666-3f8bdc2b1161 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:06.813532 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756921a-fcef-4e1c-be32-8592e3e73cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:06.814133 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756921a-fcef-4e1c-be32-8592e3e73cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.814411 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756921a-fcef-4e1c-be32-8592e3e73cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.814681 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756921a-fcef-4e1c-be32-8592e3e73cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.815318 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756921a-fcef-4e1c-be32-8592e3e73cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:06.816918 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756921a-fcef-4e1c-be32-8592e3e73cc2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:06.828356 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1447/2862] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:06.832575 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f805e-d7f9-4cee-bf2b-aa46c1e2cf6b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:06.843571 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f805e-d7f9-4cee-bf2b-aa46c1e2cf6b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:06.848383 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c1ac5-115c-4b05-a546-bb67e7353bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:06.849118 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c1ac5-115c-4b05-a546-bb67e7353bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.849357 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c1ac5-115c-4b05-a546-bb67e7353bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.849634 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c1ac5-115c-4b05-a546-bb67e7353bbb admin admin] PATH_INFO: `/v3/projects/a92651d55cf24f45aad190f4c0f13731/users/3b773d60c3274cd3b0c1f5e75a4cb668/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.865314 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c1ac5-115c-4b05-a546-bb67e7353bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92651d55cf24f45aad190f4c0f13731, user_id=3b773d60c3274cd3b0c1f5e75a4cb668, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:06.867974 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c1ac5-115c-4b05-a546-bb67e7353bbb admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:06.882026 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1416/2863] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:06:06 2022] PUT /identity/v3/projects/a92651d55cf24f45aad190f4c0f13731/users/3b773d60c3274cd3b0c1f5e75a4cb668/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:06.894288 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688090f6-c00b-4f4a-8104-b8139d0caa8c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.894761 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688090f6-c00b-4f4a-8104-b8139d0caa8c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.894890 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688090f6-c00b-4f4a-8104-b8139d0caa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.923668 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-688090f6-c00b-4f4a-8104-b8139d0caa8c None None] MFA Rules not processed for user `3b773d60c3274cd3b0c1f5e75a4cb668`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:06.924885 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-688090f6-c00b-4f4a-8104-b8139d0caa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:06.989793 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1448/2864] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:06.994406 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c1ac5-115c-4b05-a546-bb67e7353bbb admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:07.029856 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:07.064265 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c1ac5-115c-4b05-a546-bb67e7353bbb admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:07.070000 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8db58-1c9e-4de5-b039-5380362ee96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:07.070609 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8db58-1c9e-4de5-b039-5380362ee96e admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:07.070890 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8db58-1c9e-4de5-b039-5380362ee96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:07.071162 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8db58-1c9e-4de5-b039-5380362ee96e admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:07.071876 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8db58-1c9e-4de5-b039-5380362ee96e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:07.073762 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8db58-1c9e-4de5-b039-5380362ee96e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:07.101739 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1417/2865] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:06:06 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:07.105851 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688090f6-c00b-4f4a-8104-b8139d0caa8c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:07.117147 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688090f6-c00b-4f4a-8104-b8139d0caa8c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:07.174346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993027f-6247-4bd9-89c1-caf9b915393c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:07.174947 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993027f-6247-4bd9-89c1-caf9b915393c admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:07.175223 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993027f-6247-4bd9-89c1-caf9b915393c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:07.175492 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993027f-6247-4bd9-89c1-caf9b915393c admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:07.176136 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993027f-6247-4bd9-89c1-caf9b915393c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:07.178080 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993027f-6247-4bd9-89c1-caf9b915393c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:07.199067 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1449/2866] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:06:07 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:07.203864 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8db58-1c9e-4de5-b039-5380362ee96e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:07.214240 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8db58-1c9e-4de5-b039-5380362ee96e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:07.219514 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77219394-18ae-44f7-b8c1-231b01f9b72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:07.220128 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77219394-18ae-44f7-b8c1-231b01f9b72f admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:07.220408 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77219394-18ae-44f7-b8c1-231b01f9b72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:07.220684 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77219394-18ae-44f7-b8c1-231b01f9b72f admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:07.221378 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77219394-18ae-44f7-b8c1-231b01f9b72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:07.222970 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77219394-18ae-44f7-b8c1-231b01f9b72f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:07.234045 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1418/2867] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:07.238231 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993027f-6247-4bd9-89c1-caf9b915393c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:07.243663 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:07.250549 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993027f-6247-4bd9-89c1-caf9b915393c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:07.255498 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cc347-6f3a-4e3d-8851-f64c8cdf3975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:07.256154 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cc347-6f3a-4e3d-8851-f64c8cdf3975 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:07.256454 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cc347-6f3a-4e3d-8851-f64c8cdf3975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:07.256724 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cc347-6f3a-4e3d-8851-f64c8cdf3975 admin admin] PATH_INFO: `/v3/projects/8b7f4dd7bcd240bcab92e99c024a0760/users/6434d066dfe948c8af44a73af52a50d1/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:07.272740 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cc347-6f3a-4e3d-8851-f64c8cdf3975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7f4dd7bcd240bcab92e99c024a0760, user_id=6434d066dfe948c8af44a73af52a50d1, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:07.275441 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cc347-6f3a-4e3d-8851-f64c8cdf3975 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:07.288827 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1450/2868] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:06:07 2022] PUT /identity/v3/projects/8b7f4dd7bcd240bcab92e99c024a0760/users/6434d066dfe948c8af44a73af52a50d1/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:07.292849 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77219394-18ae-44f7-b8c1-231b01f9b72f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:07.303021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77219394-18ae-44f7-b8c1-231b01f9b72f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:07.359768 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988e4e0-2616-4ccf-b32c-2660e0428dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:07.360380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988e4e0-2616-4ccf-b32c-2660e0428dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:07.360668 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988e4e0-2616-4ccf-b32c-2660e0428dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:07.360968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988e4e0-2616-4ccf-b32c-2660e0428dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:07.361610 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988e4e0-2616-4ccf-b32c-2660e0428dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:07.363223 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988e4e0-2616-4ccf-b32c-2660e0428dc4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:07.373563 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1419/2869] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:07.378271 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cc347-6f3a-4e3d-8851-f64c8cdf3975 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:07.388496 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cc347-6f3a-4e3d-8851-f64c8cdf3975 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:07.393923 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4d2bb-c2d7-4de5-92f1-80ae5d5eed0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:07.394562 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4d2bb-c2d7-4de5-92f1-80ae5d5eed0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:07.394840 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4d2bb-c2d7-4de5-92f1-80ae5d5eed0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:07.395111 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4d2bb-c2d7-4de5-92f1-80ae5d5eed0d admin admin] PATH_INFO: `/v3/projects/8b7f4dd7bcd240bcab92e99c024a0760/users/6434d066dfe948c8af44a73af52a50d1/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:07.397073 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4d2bb-c2d7-4de5-92f1-80ae5d5eed0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7f4dd7bcd240bcab92e99c024a0760, user_id=6434d066dfe948c8af44a73af52a50d1, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:07.399723 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4d2bb-c2d7-4de5-92f1-80ae5d5eed0d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:07.410346 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1451/2870] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:06:07 2022] PUT /identity/v3/projects/8b7f4dd7bcd240bcab92e99c024a0760/users/6434d066dfe948c8af44a73af52a50d1/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:07.421748 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46b721-7070-4725-bc63-3126b661c4d3 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:07.422032 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46b721-7070-4725-bc63-3126b661c4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:07.422305 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46b721-7070-4725-bc63-3126b661c4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:07.451701 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-2e46b721-7070-4725-bc63-3126b661c4d3 None None] MFA Rules not processed for user `6434d066dfe948c8af44a73af52a50d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:07.453682 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2e46b721-7070-4725-bc63-3126b661c4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:07.523248 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1420/2871] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:07.534262 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4d2bb-c2d7-4de5-92f1-80ae5d5eed0d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:07.536029 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d8b4d2bb-c2d7-4de5-92f1-80ae5d5eed0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:07.595983 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4d2bb-c2d7-4de5-92f1-80ae5d5eed0d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:07.599706 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037a0c5-0e97-4f73-8fae-eef080726a80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:07.600309 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037a0c5-0e97-4f73-8fae-eef080726a80 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:07.600590 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037a0c5-0e97-4f73-8fae-eef080726a80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:07.600863 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037a0c5-0e97-4f73-8fae-eef080726a80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:07.610803 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037a0c5-0e97-4f73-8fae-eef080726a80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:07.612304 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037a0c5-0e97-4f73-8fae-eef080726a80 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:07.622134 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1452/2872] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:08.186573 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46b721-7070-4725-bc63-3126b661c4d3 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:08.215839 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:08.249933 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46b721-7070-4725-bc63-3126b661c4d3 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:08.254405 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e0801-ceb3-4d74-bc56-d651529b06a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:08.255022 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e0801-ceb3-4d74-bc56-d651529b06a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:08.255299 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e0801-ceb3-4d74-bc56-d651529b06a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:08.255564 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e0801-ceb3-4d74-bc56-d651529b06a5 admin admin] PATH_INFO: `/v3/users/3b773d60c3274cd3b0c1f5e75a4cb668` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:08.256655 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e0801-ceb3-4d74-bc56-d651529b06a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b773d60c3274cd3b0c1f5e75a4cb668)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:08.258601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e0801-ceb3-4d74-bc56-d651529b06a5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:08.307184 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b63e0801-ceb3-4d74-bc56-d651529b06a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b773d60c3274cd3b0c1f5e75a4cb668'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:08.307846 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b63e0801-ceb3-4d74-bc56-d651529b06a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b773d60c3274cd3b0c1f5e75a4cb668'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:08.315135 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b63e0801-ceb3-4d74-bc56-d651529b06a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b773d60c3274cd3b0c1f5e75a4cb668'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:08.315767 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b63e0801-ceb3-4d74-bc56-d651529b06a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b773d60c3274cd3b0c1f5e75a4cb668'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:08.322766 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b63e0801-ceb3-4d74-bc56-d651529b06a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b773d60c3274cd3b0c1f5e75a4cb668'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:08.340261 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1421/2873] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:08 2022] DELETE /identity/v3/users/3b773d60c3274cd3b0c1f5e75a4cb668 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:08.345364 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918216a-deb5-4de3-b79e-6608a39437f2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:08.345868 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918216a-deb5-4de3-b79e-6608a39437f2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:08.346031 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918216a-deb5-4de3-b79e-6608a39437f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:08.364986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c918216a-deb5-4de3-b79e-6608a39437f2 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:08.366196 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c918216a-deb5-4de3-b79e-6608a39437f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:08.426228 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1453/2874] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:08.436007 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e0801-ceb3-4d74-bc56-d651529b06a5 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:08.437684 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b63e0801-ceb3-4d74-bc56-d651529b06a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:08.496456 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e0801-ceb3-4d74-bc56-d651529b06a5 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:08.500421 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098fb5a-f318-49a7-a5a7-1f9b581be185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:08.501088 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098fb5a-f318-49a7-a5a7-1f9b581be185 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:08.501397 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098fb5a-f318-49a7-a5a7-1f9b581be185 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:08.501671 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098fb5a-f318-49a7-a5a7-1f9b581be185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:08.511392 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098fb5a-f318-49a7-a5a7-1f9b581be185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:08.512873 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098fb5a-f318-49a7-a5a7-1f9b581be185 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:08.523236 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1422/2875] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:08.794245 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918216a-deb5-4de3-b79e-6608a39437f2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:08.795711 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c918216a-deb5-4de3-b79e-6608a39437f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:08.808601 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918216a-deb5-4de3-b79e-6608a39437f2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:08.814058 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9530e4-f27b-48e9-a18f-47a2dcf6fe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:08.814701 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9530e4-f27b-48e9-a18f-47a2dcf6fe96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:08.814978 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9530e4-f27b-48e9-a18f-47a2dcf6fe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:08.815252 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9530e4-f27b-48e9-a18f-47a2dcf6fe96 admin admin] PATH_INFO: `/v3/projects/a92651d55cf24f45aad190f4c0f13731` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:08.816414 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9530e4-f27b-48e9-a18f-47a2dcf6fe96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92651d55cf24f45aad190f4c0f13731)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:08.825431 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9530e4-f27b-48e9-a18f-47a2dcf6fe96 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:08.873440 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8b9530e4-f27b-48e9-a18f-47a2dcf6fe96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92651d55cf24f45aad190f4c0f13731', 'request_id': 'req-8b9530e4-f27b-48e9-a18f-47a2dcf6fe96'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:08.880522 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8b9530e4-f27b-48e9-a18f-47a2dcf6fe96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92651d55cf24f45aad190f4c0f13731', 'request_id': 'req-8b9530e4-f27b-48e9-a18f-47a2dcf6fe96'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:08.887750 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8b9530e4-f27b-48e9-a18f-47a2dcf6fe96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92651d55cf24f45aad190f4c0f13731', 'request_id': 'req-8b9530e4-f27b-48e9-a18f-47a2dcf6fe96'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:08.890333 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:08.900380 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8b9530e4-f27b-48e9-a18f-47a2dcf6fe96 admin admin] The token cache is being invalidate because project a92651d55cf24f45aad190f4c0f13731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:08.900671 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8b9530e4-f27b-48e9-a18f-47a2dcf6fe96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:08.901325 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8b9530e4-f27b-48e9-a18f-47a2dcf6fe96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:08.902815 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1454/2876] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:08 2022] DELETE /identity/v3/projects/a92651d55cf24f45aad190f4c0f13731 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:08.907319 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098fb5a-f318-49a7-a5a7-1f9b581be185 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:08.917312 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098fb5a-f318-49a7-a5a7-1f9b581be185 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:08.963957 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:08.977604 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1bb26-32e1-4799-bd57-52cb9359bc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:08.978255 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1bb26-32e1-4799-bd57-52cb9359bc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:08.978527 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1bb26-32e1-4799-bd57-52cb9359bc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:08.978794 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1bb26-32e1-4799-bd57-52cb9359bc0d admin admin] PATH_INFO: `/v3/users/6434d066dfe948c8af44a73af52a50d1` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:08.980040 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1bb26-32e1-4799-bd57-52cb9359bc0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6434d066dfe948c8af44a73af52a50d1)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:08.982323 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1bb26-32e1-4799-bd57-52cb9359bc0d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:09.028766 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24c1bb26-32e1-4799-bd57-52cb9359bc0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6434d066dfe948c8af44a73af52a50d1'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:09.029438 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24c1bb26-32e1-4799-bd57-52cb9359bc0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6434d066dfe948c8af44a73af52a50d1'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:09.036540 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24c1bb26-32e1-4799-bd57-52cb9359bc0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6434d066dfe948c8af44a73af52a50d1'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:09.037178 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24c1bb26-32e1-4799-bd57-52cb9359bc0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6434d066dfe948c8af44a73af52a50d1'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:09.044171 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24c1bb26-32e1-4799-bd57-52cb9359bc0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6434d066dfe948c8af44a73af52a50d1'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:09.061930 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1423/2877] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:08 2022] DELETE /identity/v3/users/6434d066dfe948c8af44a73af52a50d1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:09.339095 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9530e4-f27b-48e9-a18f-47a2dcf6fe96 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:09.340602 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8b9530e4-f27b-48e9-a18f-47a2dcf6fe96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:09.354208 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9530e4-f27b-48e9-a18f-47a2dcf6fe96 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:09.418502 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c17aa0-96b4-4cf2-8883-90cf3839b582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:09.419138 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c17aa0-96b4-4cf2-8883-90cf3839b582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:09.419419 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c17aa0-96b4-4cf2-8883-90cf3839b582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:09.419693 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c17aa0-96b4-4cf2-8883-90cf3839b582 admin admin] PATH_INFO: `/v3/projects/8b7f4dd7bcd240bcab92e99c024a0760` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:09.421354 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c17aa0-96b4-4cf2-8883-90cf3839b582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b7f4dd7bcd240bcab92e99c024a0760)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:09.423321 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c17aa0-96b4-4cf2-8883-90cf3839b582 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:09.470196 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-76c17aa0-96b4-4cf2-8883-90cf3839b582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7f4dd7bcd240bcab92e99c024a0760', 'request_id': 'req-76c17aa0-96b4-4cf2-8883-90cf3839b582'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:09.476215 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-76c17aa0-96b4-4cf2-8883-90cf3839b582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7f4dd7bcd240bcab92e99c024a0760', 'request_id': 'req-76c17aa0-96b4-4cf2-8883-90cf3839b582'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:09.484058 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-76c17aa0-96b4-4cf2-8883-90cf3839b582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7f4dd7bcd240bcab92e99c024a0760', 'request_id': 'req-76c17aa0-96b4-4cf2-8883-90cf3839b582'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:09.495404 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-76c17aa0-96b4-4cf2-8883-90cf3839b582 admin admin] The token cache is being invalidate because project 8b7f4dd7bcd240bcab92e99c024a0760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:09.495691 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-76c17aa0-96b4-4cf2-8883-90cf3839b582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:09.496323 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-76c17aa0-96b4-4cf2-8883-90cf3839b582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:09.497902 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1455/2878] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:09 2022] DELETE /identity/v3/projects/8b7f4dd7bcd240bcab92e99c024a0760 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:09.502874 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb53f4-2694-452f-9144-f96b7a493df2 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:09.503387 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb53f4-2694-452f-9144-f96b7a493df2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:09.503510 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb53f4-2694-452f-9144-f96b7a493df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:09.522885 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5edb53f4-2694-452f-9144-f96b7a493df2 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:09.524098 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5edb53f4-2694-452f-9144-f96b7a493df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:09.585881 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1424/2879] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:09.594354 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca16063-6649-4056-84ca-fd99bd188a89 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:09.594649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca16063-6649-4056-84ca-fd99bd188a89 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:09.594924 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca16063-6649-4056-84ca-fd99bd188a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:09.616218 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5ca16063-6649-4056-84ca-fd99bd188a89 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:09.617484 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5ca16063-6649-4056-84ca-fd99bd188a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:09.625592 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1456/2880] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:09.629913 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb53f4-2694-452f-9144-f96b7a493df2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:09.640049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb53f4-2694-452f-9144-f96b7a493df2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:09.644789 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d506569-da92-4fcf-ab97-a16ed5e9c51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:09.645407 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d506569-da92-4fcf-ab97-a16ed5e9c51c admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:09.645687 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d506569-da92-4fcf-ab97-a16ed5e9c51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:09.645956 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d506569-da92-4fcf-ab97-a16ed5e9c51c admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:09.646594 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d506569-da92-4fcf-ab97-a16ed5e9c51c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:06:09.646893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d506569-da92-4fcf-ab97-a16ed5e9c51c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:09.648485 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d506569-da92-4fcf-ab97-a16ed5e9c51c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:09.660804 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1425/2881] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:06:09.665294 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca16063-6649-4056-84ca-fd99bd188a89 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:09.675192 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca16063-6649-4056-84ca-fd99bd188a89 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:09.679817 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e70fa-6ae5-41a7-81a2-7671e19a69a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:09.680425 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e70fa-6ae5-41a7-81a2-7671e19a69a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:09.680690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e70fa-6ae5-41a7-81a2-7671e19a69a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:09.680976 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e70fa-6ae5-41a7-81a2-7671e19a69a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:09.681601 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e70fa-6ae5-41a7-81a2-7671e19a69a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:09.683495 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e70fa-6ae5-41a7-81a2-7671e19a69a1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:09.710871 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1457/2882] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:06:09 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:09.715123 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d506569-da92-4fcf-ab97-a16ed5e9c51c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:09.726324 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d506569-da92-4fcf-ab97-a16ed5e9c51c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:09.777202 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:09.786586 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d36435-032b-452c-91ba-d70c724eb062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:09.787436 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d36435-032b-452c-91ba-d70c724eb062 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:09.787883 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d36435-032b-452c-91ba-d70c724eb062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:09.788207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d36435-032b-452c-91ba-d70c724eb062 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:09.789033 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d36435-032b-452c-91ba-d70c724eb062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:09.790957 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d36435-032b-452c-91ba-d70c724eb062 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:09.812695 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1426/2883] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:06:09 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:09.816894 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e70fa-6ae5-41a7-81a2-7671e19a69a1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:09.827738 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e70fa-6ae5-41a7-81a2-7671e19a69a1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:09.832701 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58802219-6b16-490c-940c-dc2da1ae4396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:09.833417 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58802219-6b16-490c-940c-dc2da1ae4396 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:09.833632 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58802219-6b16-490c-940c-dc2da1ae4396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:09.833907 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58802219-6b16-490c-940c-dc2da1ae4396 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:09.834548 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58802219-6b16-490c-940c-dc2da1ae4396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:09.836189 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58802219-6b16-490c-940c-dc2da1ae4396 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:09.846938 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1458/2884] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:09.850865 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d36435-032b-452c-91ba-d70c724eb062 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:09.861783 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d36435-032b-452c-91ba-d70c724eb062 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:09.866605 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614fac3-ca20-4295-8113-0fb289b8f7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:09.867193 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614fac3-ca20-4295-8113-0fb289b8f7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:09.867471 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614fac3-ca20-4295-8113-0fb289b8f7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:09.867739 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614fac3-ca20-4295-8113-0fb289b8f7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:09.868367 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614fac3-ca20-4295-8113-0fb289b8f7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:09.869983 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614fac3-ca20-4295-8113-0fb289b8f7b2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:09.881116 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1427/2885] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:09.885981 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58802219-6b16-490c-940c-dc2da1ae4396 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:09.896702 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58802219-6b16-490c-940c-dc2da1ae4396 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:09.904137 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c07d3-6230-4a17-9962-892430dd6e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:09.905984 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c07d3-6230-4a17-9962-892430dd6e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:09.906716 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c07d3-6230-4a17-9962-892430dd6e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:09.907215 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c07d3-6230-4a17-9962-892430dd6e16 admin admin] PATH_INFO: `/v3/projects/0ddc8c8da2bd44df9ae538a314fa8fc8/users/4a9d1c2bec3d4ced855415a7373240d0/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:09.925554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c07d3-6230-4a17-9962-892430dd6e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddc8c8da2bd44df9ae538a314fa8fc8, user_id=4a9d1c2bec3d4ced855415a7373240d0, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:09.928262 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c07d3-6230-4a17-9962-892430dd6e16 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:09.941515 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1459/2886] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:06:09 2022] PUT /identity/v3/projects/0ddc8c8da2bd44df9ae538a314fa8fc8/users/4a9d1c2bec3d4ced855415a7373240d0/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:09.953389 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f9a1e-92f0-4673-ae0b-dd3ebc097534 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:09.953678 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f9a1e-92f0-4673-ae0b-dd3ebc097534 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:09.953956 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f9a1e-92f0-4673-ae0b-dd3ebc097534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:09.983754 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ce2f9a1e-92f0-4673-ae0b-dd3ebc097534 None None] MFA Rules not processed for user `4a9d1c2bec3d4ced855415a7373240d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:09.984917 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ce2f9a1e-92f0-4673-ae0b-dd3ebc097534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:10.049466 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1428/2887] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:10.060776 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c07d3-6230-4a17-9962-892430dd6e16 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:10.063228 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-425c07d3-6230-4a17-9962-892430dd6e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:10.083989 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:10.126752 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c07d3-6230-4a17-9962-892430dd6e16 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:10.130554 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2928c-b253-4d4d-9e6f-155c89e97de3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:10.131160 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2928c-b253-4d4d-9e6f-155c89e97de3 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:10.131441 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2928c-b253-4d4d-9e6f-155c89e97de3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:10.131717 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2928c-b253-4d4d-9e6f-155c89e97de3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:10.141182 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2928c-b253-4d4d-9e6f-155c89e97de3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:10.142628 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2928c-b253-4d4d-9e6f-155c89e97de3 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:10.151766 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1460/2888] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:10.172465 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f9a1e-92f0-4673-ae0b-dd3ebc097534 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:10.237584 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f9a1e-92f0-4673-ae0b-dd3ebc097534 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:10.242481 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29559e-44b9-45a8-adfc-a85a3fe28b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:10.243114 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29559e-44b9-45a8-adfc-a85a3fe28b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:10.243395 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29559e-44b9-45a8-adfc-a85a3fe28b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:10.243666 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29559e-44b9-45a8-adfc-a85a3fe28b11 admin admin] PATH_INFO: `/v3/users/4a9d1c2bec3d4ced855415a7373240d0` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:10.244798 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29559e-44b9-45a8-adfc-a85a3fe28b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a9d1c2bec3d4ced855415a7373240d0)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:10.246832 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29559e-44b9-45a8-adfc-a85a3fe28b11 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:10.292225 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1a29559e-44b9-45a8-adfc-a85a3fe28b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a9d1c2bec3d4ced855415a7373240d0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:10.292893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1a29559e-44b9-45a8-adfc-a85a3fe28b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a9d1c2bec3d4ced855415a7373240d0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:10.300761 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1a29559e-44b9-45a8-adfc-a85a3fe28b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a9d1c2bec3d4ced855415a7373240d0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:10.301462 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1a29559e-44b9-45a8-adfc-a85a3fe28b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a9d1c2bec3d4ced855415a7373240d0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:10.308538 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1a29559e-44b9-45a8-adfc-a85a3fe28b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a9d1c2bec3d4ced855415a7373240d0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:10.310507 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:10.328524 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1429/2889] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:10 2022] DELETE /identity/v3/users/4a9d1c2bec3d4ced855415a7373240d0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:10.332992 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9b25e-4e0a-4f69-8a2c-200da7841c42 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:10.333284 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9b25e-4e0a-4f69-8a2c-200da7841c42 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:10.333563 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9b25e-4e0a-4f69-8a2c-200da7841c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:10.353266 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ffb9b25e-4e0a-4f69-8a2c-200da7841c42 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:10.354473 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ffb9b25e-4e0a-4f69-8a2c-200da7841c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:10.424652 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1461/2890] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:10.434376 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29559e-44b9-45a8-adfc-a85a3fe28b11 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:10.435774 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1a29559e-44b9-45a8-adfc-a85a3fe28b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:10.495668 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29559e-44b9-45a8-adfc-a85a3fe28b11 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:10.499860 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed2c8c-0724-452d-9e14-98d6ab8f5167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:10.500612 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed2c8c-0724-452d-9e14-98d6ab8f5167 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:10.500912 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed2c8c-0724-452d-9e14-98d6ab8f5167 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:10.501216 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed2c8c-0724-452d-9e14-98d6ab8f5167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:10.510541 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed2c8c-0724-452d-9e14-98d6ab8f5167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:10.511973 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed2c8c-0724-452d-9e14-98d6ab8f5167 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:10.522567 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1430/2891] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:10.787000 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9b25e-4e0a-4f69-8a2c-200da7841c42 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:10.788471 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ffb9b25e-4e0a-4f69-8a2c-200da7841c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:10.802868 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9b25e-4e0a-4f69-8a2c-200da7841c42 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:10.808701 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17aae5-2722-414b-a6a9-d2aa1ca63884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:10.809450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17aae5-2722-414b-a6a9-d2aa1ca63884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:10.809664 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17aae5-2722-414b-a6a9-d2aa1ca63884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:10.809936 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17aae5-2722-414b-a6a9-d2aa1ca63884 admin admin] PATH_INFO: `/v3/projects/0ddc8c8da2bd44df9ae538a314fa8fc8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:10.811087 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17aae5-2722-414b-a6a9-d2aa1ca63884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ddc8c8da2bd44df9ae538a314fa8fc8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:10.813685 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17aae5-2722-414b-a6a9-d2aa1ca63884 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:10.865334 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8f17aae5-2722-414b-a6a9-d2aa1ca63884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddc8c8da2bd44df9ae538a314fa8fc8', 'request_id': 'req-8f17aae5-2722-414b-a6a9-d2aa1ca63884'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:10.871602 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8f17aae5-2722-414b-a6a9-d2aa1ca63884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddc8c8da2bd44df9ae538a314fa8fc8', 'request_id': 'req-8f17aae5-2722-414b-a6a9-d2aa1ca63884'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:10.879570 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8f17aae5-2722-414b-a6a9-d2aa1ca63884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddc8c8da2bd44df9ae538a314fa8fc8', 'request_id': 'req-8f17aae5-2722-414b-a6a9-d2aa1ca63884'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:10.891177 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8f17aae5-2722-414b-a6a9-d2aa1ca63884 admin admin] The token cache is being invalidate because project 0ddc8c8da2bd44df9ae538a314fa8fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:10.891450 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8f17aae5-2722-414b-a6a9-d2aa1ca63884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:10.892134 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8f17aae5-2722-414b-a6a9-d2aa1ca63884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:10.893716 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1462/2892] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:10 2022] DELETE /identity/v3/projects/0ddc8c8da2bd44df9ae538a314fa8fc8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:10.898528 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0be54-71ab-416b-9200-3f84817fff6b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:10.898891 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0be54-71ab-416b-9200-3f84817fff6b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:10.899218 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0be54-71ab-416b-9200-3f84817fff6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:10.918639 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-13a0be54-71ab-416b-9200-3f84817fff6b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:10.919823 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-13a0be54-71ab-416b-9200-3f84817fff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:10.981550 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1431/2893] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:10.990061 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432313e-1705-4932-8f6f-6ad3179a3d79 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:10.990345 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432313e-1705-4932-8f6f-6ad3179a3d79 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:10.990617 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432313e-1705-4932-8f6f-6ad3179a3d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:11.010611 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7432313e-1705-4932-8f6f-6ad3179a3d79 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:11.011800 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7432313e-1705-4932-8f6f-6ad3179a3d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:11.019637 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1463/2894] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:11.023899 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0be54-71ab-416b-9200-3f84817fff6b None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:11.034544 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0be54-71ab-416b-9200-3f84817fff6b None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:11.039164 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22ae58-cd56-475f-9b95-56ffbba0b20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:11.039762 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22ae58-cd56-475f-9b95-56ffbba0b20c admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:11.040049 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22ae58-cd56-475f-9b95-56ffbba0b20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:11.040323 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22ae58-cd56-475f-9b95-56ffbba0b20c admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:11.040995 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22ae58-cd56-475f-9b95-56ffbba0b20c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:06:11.041300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22ae58-cd56-475f-9b95-56ffbba0b20c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:11.042901 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22ae58-cd56-475f-9b95-56ffbba0b20c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:11.055491 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1432/2895] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:06:11.059845 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432313e-1705-4932-8f6f-6ad3179a3d79 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:11.069192 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432313e-1705-4932-8f6f-6ad3179a3d79 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:11.073801 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7580-df1c-4790-b11c-1cfdf178132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:11.074376 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7580-df1c-4790-b11c-1cfdf178132b admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:11.074649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7580-df1c-4790-b11c-1cfdf178132b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:11.074914 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7580-df1c-4790-b11c-1cfdf178132b admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:11.075531 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb7580-df1c-4790-b11c-1cfdf178132b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:11.077519 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb7580-df1c-4790-b11c-1cfdf178132b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:11.105057 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1464/2896] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:06:11 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:11.110195 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22ae58-cd56-475f-9b95-56ffbba0b20c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:11.121982 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22ae58-cd56-475f-9b95-56ffbba0b20c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:11.179093 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95871b0-f90e-4aa4-8ad9-e2418140b29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:11.179731 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95871b0-f90e-4aa4-8ad9-e2418140b29e admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:11.180058 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95871b0-f90e-4aa4-8ad9-e2418140b29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:11.180331 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95871b0-f90e-4aa4-8ad9-e2418140b29e admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:11.181014 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95871b0-f90e-4aa4-8ad9-e2418140b29e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:11.183059 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95871b0-f90e-4aa4-8ad9-e2418140b29e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:11.203470 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1433/2897] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:06:11 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:11.207834 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7580-df1c-4790-b11c-1cfdf178132b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:11.218772 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7580-df1c-4790-b11c-1cfdf178132b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:11.223335 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c57b46-26ce-4eed-8f33-35e6a0b0389d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:11.223931 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c57b46-26ce-4eed-8f33-35e6a0b0389d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:11.224213 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c57b46-26ce-4eed-8f33-35e6a0b0389d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:11.224488 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c57b46-26ce-4eed-8f33-35e6a0b0389d admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:11.225155 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c57b46-26ce-4eed-8f33-35e6a0b0389d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:11.226926 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c57b46-26ce-4eed-8f33-35e6a0b0389d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:11.237765 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1465/2898] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:11.242101 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95871b0-f90e-4aa4-8ad9-e2418140b29e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:11.247219 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:11.253102 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95871b0-f90e-4aa4-8ad9-e2418140b29e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:11.258617 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2784087-938b-4aa5-a79a-2180560bc67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:11.259445 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2784087-938b-4aa5-a79a-2180560bc67e admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:11.259897 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2784087-938b-4aa5-a79a-2180560bc67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:11.260218 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2784087-938b-4aa5-a79a-2180560bc67e admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:11.261063 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2784087-938b-4aa5-a79a-2180560bc67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:11.262703 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2784087-938b-4aa5-a79a-2180560bc67e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:11.273797 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1434/2899] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:11.278178 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c57b46-26ce-4eed-8f33-35e6a0b0389d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:11.285184 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:11.288787 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c57b46-26ce-4eed-8f33-35e6a0b0389d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:11.294888 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d6c8c-c240-4ab0-8ecb-8a61afee0d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:11.296456 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d6c8c-c240-4ab0-8ecb-8a61afee0d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:11.296791 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d6c8c-c240-4ab0-8ecb-8a61afee0d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:11.297265 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d6c8c-c240-4ab0-8ecb-8a61afee0d8f admin admin] PATH_INFO: `/v3/projects/4d953250fcae4b87b7ce982e2259c2e6/users/8ddcc8122c384ebbb054bc67d0b99b61/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:11.311798 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d6c8c-c240-4ab0-8ecb-8a61afee0d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d953250fcae4b87b7ce982e2259c2e6, user_id=8ddcc8122c384ebbb054bc67d0b99b61, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:11.314531 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d6c8c-c240-4ab0-8ecb-8a61afee0d8f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:11.327815 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1466/2900] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:06:11 2022] PUT /identity/v3/projects/4d953250fcae4b87b7ce982e2259c2e6/users/8ddcc8122c384ebbb054bc67d0b99b61/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:06:11.338274 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89920b-3c19-4662-862a-343b26c0d5a9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:11.338648 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89920b-3c19-4662-862a-343b26c0d5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:11.338920 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89920b-3c19-4662-862a-343b26c0d5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:11.370207 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3a89920b-3c19-4662-862a-343b26c0d5a9 None None] MFA Rules not processed for user `8ddcc8122c384ebbb054bc67d0b99b61`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:11.371471 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3a89920b-3c19-4662-862a-343b26c0d5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:11.443465 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1435/2901] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:11.447990 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d6c8c-c240-4ab0-8ecb-8a61afee0d8f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:11.510019 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d6c8c-c240-4ab0-8ecb-8a61afee0d8f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:11.515250 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9051dfa-ee65-482a-8daa-2291a00ca072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:11.515858 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9051dfa-ee65-482a-8daa-2291a00ca072 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:11.516137 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9051dfa-ee65-482a-8daa-2291a00ca072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:11.516410 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9051dfa-ee65-482a-8daa-2291a00ca072 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:11.517080 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9051dfa-ee65-482a-8daa-2291a00ca072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:11.519033 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9051dfa-ee65-482a-8daa-2291a00ca072 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:11.553069 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1467/2902] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:06:11 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:11.553782 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89920b-3c19-4662-862a-343b26c0d5a9 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:11.567811 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89920b-3c19-4662-862a-343b26c0d5a9 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:11.629377 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac80b7c-586c-4a22-aaac-1aa5f8762aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:11.630021 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac80b7c-586c-4a22-aaac-1aa5f8762aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:11.630324 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac80b7c-586c-4a22-aaac-1aa5f8762aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:11.630598 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac80b7c-586c-4a22-aaac-1aa5f8762aa3 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:11.631289 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac80b7c-586c-4a22-aaac-1aa5f8762aa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:11.633252 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac80b7c-586c-4a22-aaac-1aa5f8762aa3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:11.662115 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1436/2903] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:06:11 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:11.663276 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9051dfa-ee65-482a-8daa-2291a00ca072 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:11.673867 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9051dfa-ee65-482a-8daa-2291a00ca072 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:11.678596 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fc5d6-82fb-4bdd-b190-e2eea5305f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:11.679206 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fc5d6-82fb-4bdd-b190-e2eea5305f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:11.679475 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fc5d6-82fb-4bdd-b190-e2eea5305f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:11.679754 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fc5d6-82fb-4bdd-b190-e2eea5305f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:11.680401 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15fc5d6-82fb-4bdd-b190-e2eea5305f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:11.682072 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15fc5d6-82fb-4bdd-b190-e2eea5305f40 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:11.693623 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1468/2904] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:11.697762 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac80b7c-586c-4a22-aaac-1aa5f8762aa3 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:11.709501 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac80b7c-586c-4a22-aaac-1aa5f8762aa3 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:11.714632 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c16ee-0118-4e2d-b708-3621bf0d8643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:11.715417 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c16ee-0118-4e2d-b708-3621bf0d8643 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:11.715820 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c16ee-0118-4e2d-b708-3621bf0d8643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:11.716098 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c16ee-0118-4e2d-b708-3621bf0d8643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:11.716772 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c16ee-0118-4e2d-b708-3621bf0d8643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:11.719102 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c16ee-0118-4e2d-b708-3621bf0d8643 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:11.729916 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1437/2905] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:11.734637 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fc5d6-82fb-4bdd-b190-e2eea5305f40 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:11.745328 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fc5d6-82fb-4bdd-b190-e2eea5305f40 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:11.751224 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658f075-b41a-4aba-a992-f8c2bf3edb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:11.751987 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658f075-b41a-4aba-a992-f8c2bf3edb01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:11.752346 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658f075-b41a-4aba-a992-f8c2bf3edb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:11.752692 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658f075-b41a-4aba-a992-f8c2bf3edb01 admin admin] PATH_INFO: `/v3/projects/2dac7d9830a1444186971c3ac1ead077/users/7a18bfcda4094a22984627a2b59acecf/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:11.769284 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658f075-b41a-4aba-a992-f8c2bf3edb01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dac7d9830a1444186971c3ac1ead077, user_id=7a18bfcda4094a22984627a2b59acecf, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:11.772035 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658f075-b41a-4aba-a992-f8c2bf3edb01 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:11.786221 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1469/2906] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:06:11 2022] PUT /identity/v3/projects/2dac7d9830a1444186971c3ac1ead077/users/7a18bfcda4094a22984627a2b59acecf/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:11.800890 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9120b-ad1c-4ced-99fb-e0407b13c6fd None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:11.801402 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9120b-ad1c-4ced-99fb-e0407b13c6fd None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:11.801783 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9120b-ad1c-4ced-99fb-e0407b13c6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:11.830065 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-54d9120b-ad1c-4ced-99fb-e0407b13c6fd None None] MFA Rules not processed for user `7a18bfcda4094a22984627a2b59acecf`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:11.831196 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-54d9120b-ad1c-4ced-99fb-e0407b13c6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:11.879471 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:11.898452 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1438/2907] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:11.903003 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658f075-b41a-4aba-a992-f8c2bf3edb01 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:11.966507 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658f075-b41a-4aba-a992-f8c2bf3edb01 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:11.971808 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd69f75-864b-4db2-9a65-650c5dc2cf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:11.972427 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd69f75-864b-4db2-9a65-650c5dc2cf85 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:11.972690 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd69f75-864b-4db2-9a65-650c5dc2cf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:11.972993 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd69f75-864b-4db2-9a65-650c5dc2cf85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:11.973633 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd69f75-864b-4db2-9a65-650c5dc2cf85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:11.975624 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd69f75-864b-4db2-9a65-650c5dc2cf85 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:12.004152 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1470/2908] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:06:11 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:12.009968 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9120b-ad1c-4ced-99fb-e0407b13c6fd None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:12.021534 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9120b-ad1c-4ced-99fb-e0407b13c6fd None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:12.083208 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5aeff2-8fef-4601-a02f-bf9cdd3d310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:12.083738 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aeff2-8fef-4601-a02f-bf9cdd3d310f admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:12.084026 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aeff2-8fef-4601-a02f-bf9cdd3d310f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:12.084300 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aeff2-8fef-4601-a02f-bf9cdd3d310f admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:12.084960 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5aeff2-8fef-4601-a02f-bf9cdd3d310f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:12.086918 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5aeff2-8fef-4601-a02f-bf9cdd3d310f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:12.108844 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1439/2909] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:06:12 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:06:12.113073 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd69f75-864b-4db2-9a65-650c5dc2cf85 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:12.123608 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd69f75-864b-4db2-9a65-650c5dc2cf85 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:12.128385 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c3424-c106-46c9-b358-1afbffecb894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:12.129016 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c3424-c106-46c9-b358-1afbffecb894 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:12.129302 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c3424-c106-46c9-b358-1afbffecb894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:12.129577 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c3424-c106-46c9-b358-1afbffecb894 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:12.130221 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c3424-c106-46c9-b358-1afbffecb894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:12.131823 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c3424-c106-46c9-b358-1afbffecb894 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:12.144561 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1471/2910] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:12.148796 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5aeff2-8fef-4601-a02f-bf9cdd3d310f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:12.159457 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5aeff2-8fef-4601-a02f-bf9cdd3d310f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:12.164029 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4489d0-e076-4dee-b7a9-fe66c0ef22d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:12.164674 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4489d0-e076-4dee-b7a9-fe66c0ef22d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:12.164980 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4489d0-e076-4dee-b7a9-fe66c0ef22d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:12.165263 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4489d0-e076-4dee-b7a9-fe66c0ef22d3 admin admin] PATH_INFO: `/v3/projects/ce3f3d730428465cbd774dbb4e144190/users/771af2d802fb428db955f954507f0048/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:12.179941 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4489d0-e076-4dee-b7a9-fe66c0ef22d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3f3d730428465cbd774dbb4e144190, user_id=771af2d802fb428db955f954507f0048, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:12.183069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4489d0-e076-4dee-b7a9-fe66c0ef22d3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:12.195493 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1440/2911] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:06:12 2022] PUT /identity/v3/projects/ce3f3d730428465cbd774dbb4e144190/users/771af2d802fb428db955f954507f0048/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:12.199566 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c3424-c106-46c9-b358-1afbffecb894 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:12.206878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:12.210986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c3424-c106-46c9-b358-1afbffecb894 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:12.269141 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789ddb5-0485-48f2-8c04-df2af91a956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:12.269754 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789ddb5-0485-48f2-8c04-df2af91a956b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:12.270037 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789ddb5-0485-48f2-8c04-df2af91a956b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:12.270307 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789ddb5-0485-48f2-8c04-df2af91a956b admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:12.270944 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789ddb5-0485-48f2-8c04-df2af91a956b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:12.272541 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789ddb5-0485-48f2-8c04-df2af91a956b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:12.283737 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1472/2912] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:12.288030 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4489d0-e076-4dee-b7a9-fe66c0ef22d3 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:12.298723 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4489d0-e076-4dee-b7a9-fe66c0ef22d3 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:12.303350 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415db5e0-3355-4345-a4b3-9647fc34a55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:12.303992 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415db5e0-3355-4345-a4b3-9647fc34a55b admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:12.304272 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415db5e0-3355-4345-a4b3-9647fc34a55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:12.304546 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415db5e0-3355-4345-a4b3-9647fc34a55b admin admin] PATH_INFO: `/v3/projects/ce3f3d730428465cbd774dbb4e144190/users/771af2d802fb428db955f954507f0048/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:12.306481 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415db5e0-3355-4345-a4b3-9647fc34a55b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3f3d730428465cbd774dbb4e144190, user_id=771af2d802fb428db955f954507f0048, role_id=76e9c7ae04ed4d5c88956b26c9b2ce3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:12.309174 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415db5e0-3355-4345-a4b3-9647fc34a55b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:12.319500 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1441/2913] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:06:12 2022] PUT /identity/v3/projects/ce3f3d730428465cbd774dbb4e144190/users/771af2d802fb428db955f954507f0048/roles/76e9c7ae04ed4d5c88956b26c9b2ce3e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:12.330588 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c1730-b6d5-44be-bc5a-1235c84ac002 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:12.330878 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c1730-b6d5-44be-bc5a-1235c84ac002 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:12.331157 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c1730-b6d5-44be-bc5a-1235c84ac002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:12.360560 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-518c1730-b6d5-44be-bc5a-1235c84ac002 None None] MFA Rules not processed for user `771af2d802fb428db955f954507f0048`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:12.361715 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-518c1730-b6d5-44be-bc5a-1235c84ac002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:12.433321 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1473/2914] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:12.445613 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415db5e0-3355-4345-a4b3-9647fc34a55b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:12.447325 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-415db5e0-3355-4345-a4b3-9647fc34a55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:12.506633 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415db5e0-3355-4345-a4b3-9647fc34a55b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:12.510217 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3562050-1331-4e61-aee5-cb2bf4936106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:12.510879 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3562050-1331-4e61-aee5-cb2bf4936106 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:12.511156 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3562050-1331-4e61-aee5-cb2bf4936106 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:12.511450 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3562050-1331-4e61-aee5-cb2bf4936106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:12.567205 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:12.570027 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3562050-1331-4e61-aee5-cb2bf4936106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:12.572065 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3562050-1331-4e61-aee5-cb2bf4936106 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:12.583026 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1442/2915] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:14.099848 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c1730-b6d5-44be-bc5a-1235c84ac002 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:14.101316 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-518c1730-b6d5-44be-bc5a-1235c84ac002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:14.114547 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c1730-b6d5-44be-bc5a-1235c84ac002 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:14.118105 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a55f87-b0d6-4d94-8929-f4786f36eabf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:14.118707 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a55f87-b0d6-4d94-8929-f4786f36eabf service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:14.118986 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a55f87-b0d6-4d94-8929-f4786f36eabf service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:14.119263 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a55f87-b0d6-4d94-8929-f4786f36eabf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:14.177512 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a55f87-b0d6-4d94-8929-f4786f36eabf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:14.178959 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a55f87-b0d6-4d94-8929-f4786f36eabf service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:14.188514 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1474/2916] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:14.715618 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3562050-1331-4e61-aee5-cb2bf4936106 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:14.725288 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3562050-1331-4e61-aee5-cb2bf4936106 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:14.729009 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcb085-1615-4e1b-9131-8e61e3f62624 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:14.729601 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcb085-1615-4e1b-9131-8e61e3f62624 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:14.729878 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcb085-1615-4e1b-9131-8e61e3f62624 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:14.730145 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcb085-1615-4e1b-9131-8e61e3f62624 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:14.739887 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcb085-1615-4e1b-9131-8e61e3f62624 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:14.741356 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcb085-1615-4e1b-9131-8e61e3f62624 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:14.751374 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1443/2917] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:18.639150 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a55f87-b0d6-4d94-8929-f4786f36eabf service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:18.666638 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:18.703858 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a55f87-b0d6-4d94-8929-f4786f36eabf service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:18.708432 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2ab4d-e5f0-4497-ab2c-ab929a73bd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:18.709092 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2ab4d-e5f0-4497-ab2c-ab929a73bd1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:18.709378 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2ab4d-e5f0-4497-ab2c-ab929a73bd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:18.709649 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2ab4d-e5f0-4497-ab2c-ab929a73bd1e admin admin] PATH_INFO: `/v3/users/8ddcc8122c384ebbb054bc67d0b99b61` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:18.710811 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2ab4d-e5f0-4497-ab2c-ab929a73bd1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ddcc8122c384ebbb054bc67d0b99b61)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:18.712739 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2ab4d-e5f0-4497-ab2c-ab929a73bd1e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:18.763846 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6ba2ab4d-e5f0-4497-ab2c-ab929a73bd1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ddcc8122c384ebbb054bc67d0b99b61'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:18.765624 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6ba2ab4d-e5f0-4497-ab2c-ab929a73bd1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ddcc8122c384ebbb054bc67d0b99b61'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:18.779312 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6ba2ab4d-e5f0-4497-ab2c-ab929a73bd1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ddcc8122c384ebbb054bc67d0b99b61'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:18.786948 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6ba2ab4d-e5f0-4497-ab2c-ab929a73bd1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ddcc8122c384ebbb054bc67d0b99b61'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:18.787647 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6ba2ab4d-e5f0-4497-ab2c-ab929a73bd1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ddcc8122c384ebbb054bc67d0b99b61'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:18.800170 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1475/2918] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:18 2022] DELETE /identity/v3/users/8ddcc8122c384ebbb054bc67d0b99b61 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:18.804862 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2aef44-58fe-4ee3-8560-d2020561d267 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:18.805387 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2aef44-58fe-4ee3-8560-d2020561d267 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:18.805513 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2aef44-58fe-4ee3-8560-d2020561d267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:18.825337 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5d2aef44-58fe-4ee3-8560-d2020561d267 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:18.826561 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5d2aef44-58fe-4ee3-8560-d2020561d267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:18.886657 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1444/2919] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:06:18.896503 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2ab4d-e5f0-4497-ab2c-ab929a73bd1e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:18.897928 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6ba2ab4d-e5f0-4497-ab2c-ab929a73bd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:18.956608 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2ab4d-e5f0-4497-ab2c-ab929a73bd1e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:18.960119 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b44eb4-3fd5-4d67-a964-6e7296dde5c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:18.960714 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b44eb4-3fd5-4d67-a964-6e7296dde5c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:18.961013 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b44eb4-3fd5-4d67-a964-6e7296dde5c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:18.961283 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b44eb4-3fd5-4d67-a964-6e7296dde5c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:18.970229 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b44eb4-3fd5-4d67-a964-6e7296dde5c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:18.971644 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b44eb4-3fd5-4d67-a964-6e7296dde5c3 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:18.981219 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1476/2920] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:06:19.256899 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2aef44-58fe-4ee3-8560-d2020561d267 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:19.258427 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5d2aef44-58fe-4ee3-8560-d2020561d267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:19.274550 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2aef44-58fe-4ee3-8560-d2020561d267 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:19.279363 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d97bc-cd1b-42ff-91c1-ecd4e3d562d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:19.280735 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d97bc-cd1b-42ff-91c1-ecd4e3d562d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:19.281277 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d97bc-cd1b-42ff-91c1-ecd4e3d562d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:19.281799 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d97bc-cd1b-42ff-91c1-ecd4e3d562d4 admin admin] PATH_INFO: `/v3/projects/4d953250fcae4b87b7ce982e2259c2e6` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:19.283370 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d97bc-cd1b-42ff-91c1-ecd4e3d562d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d953250fcae4b87b7ce982e2259c2e6)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:19.285688 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d97bc-cd1b-42ff-91c1-ecd4e3d562d4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:19.333351 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5a0d97bc-cd1b-42ff-91c1-ecd4e3d562d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d953250fcae4b87b7ce982e2259c2e6', 'request_id': 'req-5a0d97bc-cd1b-42ff-91c1-ecd4e3d562d4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:19.339457 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5a0d97bc-cd1b-42ff-91c1-ecd4e3d562d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d953250fcae4b87b7ce982e2259c2e6', 'request_id': 'req-5a0d97bc-cd1b-42ff-91c1-ecd4e3d562d4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:19.347550 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5a0d97bc-cd1b-42ff-91c1-ecd4e3d562d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d953250fcae4b87b7ce982e2259c2e6', 'request_id': 'req-5a0d97bc-cd1b-42ff-91c1-ecd4e3d562d4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:19.358638 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5a0d97bc-cd1b-42ff-91c1-ecd4e3d562d4 admin admin] The token cache is being invalidate because project 4d953250fcae4b87b7ce982e2259c2e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:19.358972 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5a0d97bc-cd1b-42ff-91c1-ecd4e3d562d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:19.359760 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5a0d97bc-cd1b-42ff-91c1-ecd4e3d562d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:19.361266 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1445/2921] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:19 2022] DELETE /identity/v3/projects/4d953250fcae4b87b7ce982e2259c2e6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:19.365550 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b44eb4-3fd5-4d67-a964-6e7296dde5c3 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:19.376374 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b44eb4-3fd5-4d67-a964-6e7296dde5c3 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:19.421686 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:19.435407 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d57890-34b5-49b8-a7fb-1301d16a52b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:19.436042 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d57890-34b5-49b8-a7fb-1301d16a52b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:19.437117 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d57890-34b5-49b8-a7fb-1301d16a52b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:19.437536 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d57890-34b5-49b8-a7fb-1301d16a52b9 admin admin] PATH_INFO: `/v3/users/7a18bfcda4094a22984627a2b59acecf` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:19.438696 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d57890-34b5-49b8-a7fb-1301d16a52b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a18bfcda4094a22984627a2b59acecf)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:19.440671 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d57890-34b5-49b8-a7fb-1301d16a52b9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:19.487018 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a7d57890-34b5-49b8-a7fb-1301d16a52b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a18bfcda4094a22984627a2b59acecf'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:19.487659 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a7d57890-34b5-49b8-a7fb-1301d16a52b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a18bfcda4094a22984627a2b59acecf'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:19.500534 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a7d57890-34b5-49b8-a7fb-1301d16a52b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a18bfcda4094a22984627a2b59acecf'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:19.508003 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a7d57890-34b5-49b8-a7fb-1301d16a52b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a18bfcda4094a22984627a2b59acecf'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:19.508626 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a7d57890-34b5-49b8-a7fb-1301d16a52b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a18bfcda4094a22984627a2b59acecf'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:19.521665 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1477/2922] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:19 2022] DELETE /identity/v3/users/7a18bfcda4094a22984627a2b59acecf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:19.795305 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d97bc-cd1b-42ff-91c1-ecd4e3d562d4 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:19.797347 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5a0d97bc-cd1b-42ff-91c1-ecd4e3d562d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:19.811919 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d97bc-cd1b-42ff-91c1-ecd4e3d562d4 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:19.871034 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86d3f3-cfb7-4a6e-9c99-3097c6596fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:19.872243 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86d3f3-cfb7-4a6e-9c99-3097c6596fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:19.872729 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86d3f3-cfb7-4a6e-9c99-3097c6596fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:19.873269 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86d3f3-cfb7-4a6e-9c99-3097c6596fe3 admin admin] PATH_INFO: `/v3/projects/2dac7d9830a1444186971c3ac1ead077` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:19.875249 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86d3f3-cfb7-4a6e-9c99-3097c6596fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dac7d9830a1444186971c3ac1ead077)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:19.878009 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86d3f3-cfb7-4a6e-9c99-3097c6596fe3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:19.889759 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:19.930528 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3e86d3f3-cfb7-4a6e-9c99-3097c6596fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dac7d9830a1444186971c3ac1ead077', 'request_id': 'req-3e86d3f3-cfb7-4a6e-9c99-3097c6596fe3'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:19.936698 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3e86d3f3-cfb7-4a6e-9c99-3097c6596fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dac7d9830a1444186971c3ac1ead077', 'request_id': 'req-3e86d3f3-cfb7-4a6e-9c99-3097c6596fe3'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:19.943987 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3e86d3f3-cfb7-4a6e-9c99-3097c6596fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dac7d9830a1444186971c3ac1ead077', 'request_id': 'req-3e86d3f3-cfb7-4a6e-9c99-3097c6596fe3'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:19.955144 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3e86d3f3-cfb7-4a6e-9c99-3097c6596fe3 admin admin] The token cache is being invalidate because project 2dac7d9830a1444186971c3ac1ead077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:19.955477 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3e86d3f3-cfb7-4a6e-9c99-3097c6596fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:19.956118 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3e86d3f3-cfb7-4a6e-9c99-3097c6596fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:19.957633 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1446/2923] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:19 2022] DELETE /identity/v3/projects/2dac7d9830a1444186971c3ac1ead077 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:19.961671 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d57890-34b5-49b8-a7fb-1301d16a52b9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:19.963238 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a7d57890-34b5-49b8-a7fb-1301d16a52b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:19.976536 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d57890-34b5-49b8-a7fb-1301d16a52b9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:20.036078 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf576ec4-3cb6-4531-9c0c-08f8b965d661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:20.036717 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf576ec4-3cb6-4531-9c0c-08f8b965d661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:20.037029 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf576ec4-3cb6-4531-9c0c-08f8b965d661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:20.037306 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf576ec4-3cb6-4531-9c0c-08f8b965d661 admin admin] PATH_INFO: `/v3/users/771af2d802fb428db955f954507f0048` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:20.038508 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf576ec4-3cb6-4531-9c0c-08f8b965d661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=771af2d802fb428db955f954507f0048)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:20.040642 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf576ec4-3cb6-4531-9c0c-08f8b965d661 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:20.088513 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cf576ec4-3cb6-4531-9c0c-08f8b965d661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771af2d802fb428db955f954507f0048'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:20.089260 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cf576ec4-3cb6-4531-9c0c-08f8b965d661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771af2d802fb428db955f954507f0048'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:20.101598 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cf576ec4-3cb6-4531-9c0c-08f8b965d661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771af2d802fb428db955f954507f0048'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:20.104099 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:20.109492 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cf576ec4-3cb6-4531-9c0c-08f8b965d661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771af2d802fb428db955f954507f0048'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:20.110487 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cf576ec4-3cb6-4531-9c0c-08f8b965d661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771af2d802fb428db955f954507f0048'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:20.124803 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1478/2924] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:19 2022] DELETE /identity/v3/users/771af2d802fb428db955f954507f0048 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:20.407020 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86d3f3-cfb7-4a6e-9c99-3097c6596fe3 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:20.408521 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3e86d3f3-cfb7-4a6e-9c99-3097c6596fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:20.424377 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86d3f3-cfb7-4a6e-9c99-3097c6596fe3 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:20.482023 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c60e3-85f3-45da-b22e-e589a6325137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:20.482649 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c60e3-85f3-45da-b22e-e589a6325137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:20.482929 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c60e3-85f3-45da-b22e-e589a6325137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:20.483704 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c60e3-85f3-45da-b22e-e589a6325137 admin admin] PATH_INFO: `/v3/projects/ce3f3d730428465cbd774dbb4e144190` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:20.484839 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c60e3-85f3-45da-b22e-e589a6325137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce3f3d730428465cbd774dbb4e144190)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:20.486787 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c60e3-85f3-45da-b22e-e589a6325137 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:20.537703 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a05c60e3-85f3-45da-b22e-e589a6325137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3f3d730428465cbd774dbb4e144190', 'request_id': 'req-a05c60e3-85f3-45da-b22e-e589a6325137'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:20.543907 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a05c60e3-85f3-45da-b22e-e589a6325137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3f3d730428465cbd774dbb4e144190', 'request_id': 'req-a05c60e3-85f3-45da-b22e-e589a6325137'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:20.552718 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a05c60e3-85f3-45da-b22e-e589a6325137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3f3d730428465cbd774dbb4e144190', 'request_id': 'req-a05c60e3-85f3-45da-b22e-e589a6325137'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:20.564089 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a05c60e3-85f3-45da-b22e-e589a6325137 admin admin] The token cache is being invalidate because project ce3f3d730428465cbd774dbb4e144190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:20.564377 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a05c60e3-85f3-45da-b22e-e589a6325137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:20.565030 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a05c60e3-85f3-45da-b22e-e589a6325137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:20.566505 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1447/2925] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:20 2022] DELETE /identity/v3/projects/ce3f3d730428465cbd774dbb4e144190 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:20.571550 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969c6f3-82a9-435c-878e-f6a1186b9310 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:20.571835 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969c6f3-82a9-435c-878e-f6a1186b9310 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:20.572107 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969c6f3-82a9-435c-878e-f6a1186b9310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:20.593054 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5969c6f3-82a9-435c-878e-f6a1186b9310 None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:20.594167 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5969c6f3-82a9-435c-878e-f6a1186b9310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:20.653621 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1479/2926] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:20.662204 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b6482-3e9b-406e-9073-d54677b9bd5b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:20.662612 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b6482-3e9b-406e-9073-d54677b9bd5b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:20.662896 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b6482-3e9b-406e-9073-d54677b9bd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:20.683162 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3c3b6482-3e9b-406e-9073-d54677b9bd5b None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:20.684380 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3c3b6482-3e9b-406e-9073-d54677b9bd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:20.692997 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1448/2927] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:20.697401 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969c6f3-82a9-435c-878e-f6a1186b9310 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:20.707290 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969c6f3-82a9-435c-878e-f6a1186b9310 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:20.711806 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962e672-b243-421b-9ca0-b10d3e2be6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:20.712401 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962e672-b243-421b-9ca0-b10d3e2be6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:20.712683 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962e672-b243-421b-9ca0-b10d3e2be6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:20.712983 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962e672-b243-421b-9ca0-b10d3e2be6a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:20.713634 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962e672-b243-421b-9ca0-b10d3e2be6a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:06:20.713970 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962e672-b243-421b-9ca0-b10d3e2be6a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:20.715562 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962e672-b243-421b-9ca0-b10d3e2be6a7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:20.728533 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1480/2928] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Oct 2 01:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:06:20.733853 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b6482-3e9b-406e-9073-d54677b9bd5b None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:20.743480 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b6482-3e9b-406e-9073-d54677b9bd5b None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:20.748078 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0de0d-3846-4c13-993a-7295cabae366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:20.748737 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0de0d-3846-4c13-993a-7295cabae366 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:20.749174 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0de0d-3846-4c13-993a-7295cabae366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:20.749473 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0de0d-3846-4c13-993a-7295cabae366 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:20.750091 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0de0d-3846-4c13-993a-7295cabae366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:20.752019 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0de0d-3846-4c13-993a-7295cabae366 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:20.773280 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:20.783277 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1449/2929] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Oct 2 01:06:20 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:20.788475 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962e672-b243-421b-9ca0-b10d3e2be6a7 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:20.800342 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962e672-b243-421b-9ca0-b10d3e2be6a7 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:20.862435 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c732e-9b11-45d9-ace7-d30cc4420e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:20.862954 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c732e-9b11-45d9-ace7-d30cc4420e96 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:20.863237 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c732e-9b11-45d9-ace7-d30cc4420e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:20.863509 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c732e-9b11-45d9-ace7-d30cc4420e96 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:20.864383 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c732e-9b11-45d9-ace7-d30cc4420e96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:20.866333 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c732e-9b11-45d9-ace7-d30cc4420e96 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:20.888379 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1481/2930] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Oct 2 01:06:20 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:20.892888 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0de0d-3846-4c13-993a-7295cabae366 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:20.903157 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0de0d-3846-4c13-993a-7295cabae366 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:20.908536 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f398a-4952-4f47-ac1d-d4829182659f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:20.909159 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f398a-4952-4f47-ac1d-d4829182659f admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:20.909435 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f398a-4952-4f47-ac1d-d4829182659f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:20.909702 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f398a-4952-4f47-ac1d-d4829182659f admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:20.910348 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f398a-4952-4f47-ac1d-d4829182659f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:20.911922 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f398a-4952-4f47-ac1d-d4829182659f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:20.922748 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1450/2931] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:20.926691 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c732e-9b11-45d9-ace7-d30cc4420e96 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:20.936772 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c732e-9b11-45d9-ace7-d30cc4420e96 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:20.941455 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea7ad9-dbe3-4634-b475-1efb56c6d8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:20.942074 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea7ad9-dbe3-4634-b475-1efb56c6d8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:20.942358 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea7ad9-dbe3-4634-b475-1efb56c6d8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:20.942629 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea7ad9-dbe3-4634-b475-1efb56c6d8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:20.943266 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea7ad9-dbe3-4634-b475-1efb56c6d8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:20.944857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea7ad9-dbe3-4634-b475-1efb56c6d8e3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:20.955196 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1482/2932] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:20.959302 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f398a-4952-4f47-ac1d-d4829182659f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:20.969921 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f398a-4952-4f47-ac1d-d4829182659f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:20.974491 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b85024-d7db-47e9-9fa1-fb3c0b5bf04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:20.975134 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b85024-d7db-47e9-9fa1-fb3c0b5bf04c admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:20.975412 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b85024-d7db-47e9-9fa1-fb3c0b5bf04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:20.975684 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b85024-d7db-47e9-9fa1-fb3c0b5bf04c admin admin] PATH_INFO: `/v3/projects/b8946863447f493d8179ddb0d26f69f7/users/9ae106a964af4b2393c93d2ef6386c42/roles/424fdbf5034b4445bf8a3022b9fb8b4c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:20.991198 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b85024-d7db-47e9-9fa1-fb3c0b5bf04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8946863447f493d8179ddb0d26f69f7, user_id=9ae106a964af4b2393c93d2ef6386c42, role_id=424fdbf5034b4445bf8a3022b9fb8b4c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:20.994110 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b85024-d7db-47e9-9fa1-fb3c0b5bf04c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:21.007407 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1451/2933] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Oct 2 01:06:20 2022] PUT /identity/v3/projects/b8946863447f493d8179ddb0d26f69f7/users/9ae106a964af4b2393c93d2ef6386c42/roles/424fdbf5034b4445bf8a3022b9fb8b4c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:21.017675 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9c308-a564-48bb-863d-329d076aeb88 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:21.018199 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9c308-a564-48bb-863d-329d076aeb88 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:21.018310 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9c308-a564-48bb-863d-329d076aeb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:21.048017 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-79b9c308-a564-48bb-863d-329d076aeb88 None None] MFA Rules not processed for user `9ae106a964af4b2393c93d2ef6386c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:21.049277 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-79b9c308-a564-48bb-863d-329d076aeb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:21.089543 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:21.117085 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1483/2934] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:21.127961 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b85024-d7db-47e9-9fa1-fb3c0b5bf04c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:21.129685 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b3b85024-d7db-47e9-9fa1-fb3c0b5bf04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:21.192900 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b85024-d7db-47e9-9fa1-fb3c0b5bf04c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:21.197837 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a73745-aaf1-4abc-8fdf-f36222c22ea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3469f1e6a9bf47b58d208bffc3415014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:21.198449 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a73745-aaf1-4abc-8fdf-f36222c22ea1 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:21.198732 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a73745-aaf1-4abc-8fdf-f36222c22ea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:21.199004 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a73745-aaf1-4abc-8fdf-f36222c22ea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:21.208529 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a73745-aaf1-4abc-8fdf-f36222c22ea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:21.210007 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a73745-aaf1-4abc-8fdf-f36222c22ea1 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:21.219536 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1452/2935] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:31.113661 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=9 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:31.214862 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:31.431059 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9c308-a564-48bb-863d-329d076aeb88 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:31.495255 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9c308-a564-48bb-863d-329d076aeb88 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:31.499857 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a930083-c3a0-4766-adfe-89ed174acfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:31.500483 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a930083-c3a0-4766-adfe-89ed174acfdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:31.500763 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a930083-c3a0-4766-adfe-89ed174acfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:31.501064 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a930083-c3a0-4766-adfe-89ed174acfdd admin admin] PATH_INFO: `/v3/users/9ae106a964af4b2393c93d2ef6386c42` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:31.502270 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a930083-c3a0-4766-adfe-89ed174acfdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae106a964af4b2393c93d2ef6386c42)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:31.504203 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a930083-c3a0-4766-adfe-89ed174acfdd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:31.551048 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1a930083-c3a0-4766-adfe-89ed174acfdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae106a964af4b2393c93d2ef6386c42'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:31.551724 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1a930083-c3a0-4766-adfe-89ed174acfdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae106a964af4b2393c93d2ef6386c42'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:31.563753 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1a930083-c3a0-4766-adfe-89ed174acfdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae106a964af4b2393c93d2ef6386c42'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:31.571246 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1a930083-c3a0-4766-adfe-89ed174acfdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae106a964af4b2393c93d2ef6386c42'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:31.572028 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1a930083-c3a0-4766-adfe-89ed174acfdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae106a964af4b2393c93d2ef6386c42'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:31.586331 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1484/2936] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:31 2022] DELETE /identity/v3/users/9ae106a964af4b2393c93d2ef6386c42 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:31.590893 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57957182-ac93-4f61-bfff-a0e4d313c02c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:31.591186 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57957182-ac93-4f61-bfff-a0e4d313c02c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:31.591518 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57957182-ac93-4f61-bfff-a0e4d313c02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:31.613923 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-57957182-ac93-4f61-bfff-a0e4d313c02c None None] MFA Rules not processed for user `1ae9e9d2d4e74a049733205286b14514`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:31.615420 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-57957182-ac93-4f61-bfff-a0e4d313c02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:31.675700 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1453/2937] 10.222.0.26 () {58 vars in 958 bytes} [Sun Oct 2 01:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:31.685454 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a930083-c3a0-4766-adfe-89ed174acfdd admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:31.686919 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1a930083-c3a0-4766-adfe-89ed174acfdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:31.747012 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a930083-c3a0-4766-adfe-89ed174acfdd admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:31.751079 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2443c24-8ebe-4afe-98fa-53600b6a5489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5100db0c968c406fa89e117877604c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:31.751725 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2443c24-8ebe-4afe-98fa-53600b6a5489 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:31.752005 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2443c24-8ebe-4afe-98fa-53600b6a5489 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:31.752303 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2443c24-8ebe-4afe-98fa-53600b6a5489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:31.762241 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2443c24-8ebe-4afe-98fa-53600b6a5489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:31.764352 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2443c24-8ebe-4afe-98fa-53600b6a5489 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:31.775318 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1485/2938] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:32.043895 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57957182-ac93-4f61-bfff-a0e4d313c02c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:32.045348 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-57957182-ac93-4f61-bfff-a0e4d313c02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:32.057559 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57957182-ac93-4f61-bfff-a0e4d313c02c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:32.062162 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7249eb-d9ac-43d1-94fd-fe1881c3208c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae9e9d2d4e74a049733205286b14514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6575bddc339f4fb18300234b880a2b64', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:32.062795 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7249eb-d9ac-43d1-94fd-fe1881c3208c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:32.063075 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7249eb-d9ac-43d1-94fd-fe1881c3208c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:32.063347 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7249eb-d9ac-43d1-94fd-fe1881c3208c admin admin] PATH_INFO: `/v3/projects/b8946863447f493d8179ddb0d26f69f7` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:32.065069 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7249eb-d9ac-43d1-94fd-fe1881c3208c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8946863447f493d8179ddb0d26f69f7)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:32.067004 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7249eb-d9ac-43d1-94fd-fe1881c3208c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:32.115167 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ec7249eb-d9ac-43d1-94fd-fe1881c3208c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8946863447f493d8179ddb0d26f69f7', 'request_id': 'req-ec7249eb-d9ac-43d1-94fd-fe1881c3208c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:32.121354 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ec7249eb-d9ac-43d1-94fd-fe1881c3208c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8946863447f493d8179ddb0d26f69f7', 'request_id': 'req-ec7249eb-d9ac-43d1-94fd-fe1881c3208c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:32.129642 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ec7249eb-d9ac-43d1-94fd-fe1881c3208c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8946863447f493d8179ddb0d26f69f7', 'request_id': 'req-ec7249eb-d9ac-43d1-94fd-fe1881c3208c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:32.140342 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ec7249eb-d9ac-43d1-94fd-fe1881c3208c admin admin] The token cache is being invalidate because project b8946863447f493d8179ddb0d26f69f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:32.140657 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ec7249eb-d9ac-43d1-94fd-fe1881c3208c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:32.141441 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ec7249eb-d9ac-43d1-94fd-fe1881c3208c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:32.144552 dv-cinder-master-3-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1454/2939] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:32 2022] DELETE /identity/v3/projects/b8946863447f493d8179ddb0d26f69f7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:41.770937 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:42.137236 dv-cinder-master-3-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:16.248384 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2443c24-8ebe-4afe-98fa-53600b6a5489 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:16.249819 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b2443c24-8ebe-4afe-98fa-53600b6a5489 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:16.318511 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2443c24-8ebe-4afe-98fa-53600b6a5489 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:16.379834 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff2893-78c6-47f7-af68-936d91abedb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78481cceebd4138b893eba7e51c9c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec935005514f808eb735bfb01fee6e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:16.380436 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff2893-78c6-47f7-af68-936d91abedb0 service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:16.380718 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff2893-78c6-47f7-af68-936d91abedb0 service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:16.381019 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff2893-78c6-47f7-af68-936d91abedb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:16.383420 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-47ff2893-78c6-47f7-af68-936d91abedb0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:16.396793 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff2893-78c6-47f7-af68-936d91abedb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:16.399234 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff2893-78c6-47f7-af68-936d91abedb0 service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:16.410026 dv-cinder-master-3-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1486/2940] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Oct 2 01:10:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:10:26.405025 dv-cinder-master-3-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=58 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}